2024-01-20T10:51:51.890 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-20T10:51:51.890 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617 --name yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/strays} -- /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/orig.config.yaml 2024-01-20T10:51:51.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T10:51:52.023 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/strays} email: yweinste@redhat.com first_in_suite: false job_id: '7522617' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 450 sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdz4tlrW+p4p97mpnf38K/F5wSYtN2jYm1y4zfk8Zk5UvSBLOQEzAbLvHZ7b7C7gg4Vs+5DUgwZCWhH9bZej3Y= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6aFtOJmsPEB7Lb/+0fkmqRqZmCHGK/g14gkygGM/HGu/bTjRcQVtOjX92KKZi8wChCpNaKMGsmF1KuCKQifIA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_strays teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-19_15:24:44 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-20T10:51:52.023 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa; will attempt to use it 2024-01-20T10:51:52.023 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks 2024-01-20T10:51:52.024 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-20T10:51:52.025 INFO:teuthology.task.internal:Checking packages... 2024-01-20T10:51:52.048 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167' 2024-01-20T10:51:52.048 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-20T10:51:52.048 INFO:teuthology.packaging:ref: None 2024-01-20T10:51:52.048 INFO:teuthology.packaging:tag: None 2024-01-20T10:51:52.048 INFO:teuthology.packaging:branch: main 2024-01-20T10:51:52.048 INFO:teuthology.packaging:sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T10:51:52.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-01-20T10:51:52.301 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-772.gd7e2a322 2024-01-20T10:51:52.303 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-20T10:51:52.310 INFO:teuthology.task.internal:no buildpackages task found 2024-01-20T10:51:52.311 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-20T10:51:52.335 INFO:teuthology.task.internal:Saving configuration 2024-01-20T10:51:52.350 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-20T10:51:52.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T10:51:52.402 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 10:46:45.791961', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdz4tlrW+p4p97mpnf38K/F5wSYtN2jYm1y4zfk8Zk5UvSBLOQEzAbLvHZ7b7C7gg4Vs+5DUgwZCWhH9bZej3Y='} 2024-01-20T10:51:52.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 10:46:45.793935', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6aFtOJmsPEB7Lb/+0fkmqRqZmCHGK/g14gkygGM/HGu/bTjRcQVtOjX92KKZi8wChCpNaKMGsmF1KuCKQifIA='} 2024-01-20T10:51:52.423 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-20T10:51:52.432 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-20T10:51:52.432 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-20T10:51:52.432 INFO:teuthology.run_tasks:Running task console_log... 2024-01-20T10:51:52.504 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7bbcf0c430>, signals=[15]) 2024-01-20T10:51:52.505 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-20T10:51:52.516 INFO:teuthology.task.internal:Opening connections... 2024-01-20T10:51:52.517 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T10:51:52.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:51:52.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T10:51:52.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:51:52.701 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-20T10:51:52.708 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-01-20T10:51:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-01-20T10:51:52.725 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-01-20T10:51:52.781 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-01-20T10:51:52.781 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-01-20T10:51:52.781 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-01-20T10:51:52.781 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-01-20T10:51:52.781 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-20T10:51:52.782 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-20T10:51:52.783 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-01-20T10:51:52.804 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-01-20T10:51:52.822 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-01-20T10:51:52.822 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-20T10:51:52.879 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-01-20T10:51:52.880 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-01-20T10:51:52.880 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-20T10:51:52.880 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-01-20T10:51:52.880 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T10:51:52.880 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-20T10:51:52.880 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-20T10:51:52.880 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-01-20T10:51:52.896 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-20T10:51:52.911 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-20T10:51:52.963 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-20T10:51:52.963 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-01-20T10:51:52.965 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-01-20T10:51:52.981 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-20T10:51:52.991 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-20T10:51:52.991 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-01-20T10:51:53.020 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-01-20T10:51:53.122 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-20T10:51:53.184 INFO:teuthology.run_tasks:Running task kernel... 2024-01-20T10:51:53.204 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-01-20T10:51:53.204 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-01-20T10:51:53.204 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-01-20T10:51:53.204 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-20T10:51:53.205 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-20T10:51:53.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T10:51:53.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T10:51:53.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-01-20T10:51:53.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-01-20T10:51:53.524 DEBUG:teuthology.task.kernel:sha1 for client.0 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T10:51:53.525 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-20T10:51:53.525 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-01-20T10:51:53.531 DEBUG:teuthology.task.kernel:sha1 for client.1 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T10:51:53.531 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-20T10:51:53.531 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-01-20T10:51:53.542 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-361.el9.x86_64 2024-01-20T10:51:53.542 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T10:51:53.542 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-20T10:51:53.542 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum upgrade -y linux-firmware 2024-01-20T10:51:53.548 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-361.el9.x86_64 2024-01-20T10:51:53.549 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T10:51:53.549 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-20T10:51:53.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum upgrade -y linux-firmware 2024-01-20T10:51:55.728 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2024-01-20T10:51:55.739 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2024-01-20T10:51:57.082 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2024-01-20T10:51:57.304 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2024-01-20T10:51:59.189 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.0 MB 00:01 2024-01-20T10:51:59.477 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.0 MB 00:01 2024-01-20T10:52:01.479 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-01-20T10:52:02.565 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 19 MB 00:02 2024-01-20T10:52:06.962 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 5.9 MB 00:02 2024-01-20T10:52:07.393 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 5.9 MB 00:01 2024-01-20T10:52:08.604 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-01-20T10:52:08.867 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 15 kB 00:00 2024-01-20T10:52:09.602 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2024-01-20T10:52:11.357 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 20 MB 00:02 2024-01-20T10:52:14.427 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-01-20T10:52:16.204 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-01-20T10:52:16.673 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-01-20T10:52:16.685 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-01-20T10:52:16.685 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-01-20T10:52:16.685 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-01-20T10:52:16.685 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-01-20T10:52:16.685 INFO:teuthology.orchestra.run.smithi179.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-01-20T10:52:16.686 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T10:52:16.686 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-01-20T10:52:16.686 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-01-20T10:52:16.686 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 1 Package 2024-01-20T10:52:16.686 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T10:52:16.686 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 375 M 2024-01-20T10:52:16.686 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-01-20T10:52:18.520 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-01-20T10:52:18.524 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-01-20T10:52:18.524 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-01-20T10:52:18.524 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-01-20T10:52:18.524 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-01-20T10:52:18.524 INFO:teuthology.orchestra.run.smithi162.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-01-20T10:52:18.525 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T10:52:18.525 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-01-20T10:52:18.525 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-01-20T10:52:18.525 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 1 Package 2024-01-20T10:52:18.525 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T10:52:18.525 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 375 M 2024-01-20T10:52:18.525 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-01-20T10:52:25.178 INFO:teuthology.orchestra.run.smithi179.stdout:linux-firmware-20240109-142.el9.noarch.rpm 44 MB/s | 375 MB 00:08 2024-01-20T10:52:25.179 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-01-20T10:52:25.179 INFO:teuthology.orchestra.run.smithi179.stdout:Total 44 MB/s | 375 MB 00:08 2024-01-20T10:52:25.180 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-01-20T10:52:25.259 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-01-20T10:52:25.259 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-01-20T10:52:27.644 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-01-20T10:52:27.644 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-01-20T10:52:28.012 INFO:teuthology.orchestra.run.smithi162.stdout:linux-firmware-20240109-142.el9.noarch.rpm 40 MB/s | 375 MB 00:09 2024-01-20T10:52:28.013 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-01-20T10:52:28.014 INFO:teuthology.orchestra.run.smithi162.stdout:Total 40 MB/s | 375 MB 00:09 2024-01-20T10:52:28.014 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-01-20T10:52:28.099 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-01-20T10:52:28.099 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-01-20T10:52:30.549 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-01-20T10:52:30.550 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-01-20T10:52:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-01-20T10:52:33.984 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T10:52:34.080 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T10:52:35.512 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T10:52:35.512 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T10:52:35.944 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T10:52:35.944 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T10:52:35.944 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-01-20T10:52:35.945 INFO:teuthology.orchestra.run.smithi179.stdout: linux-firmware-20240109-142.el9.noarch 2024-01-20T10:52:35.945 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T10:52:35.945 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-01-20T10:52:36.239 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-20T10:52:36.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T10:52:36.461 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ 2024-01-20T10:52:36.461 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_g06652275eb93-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ --input-file=- 2024-01-20T10:52:36.463 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi179.front.sepia.ceph.com to complete... 2024-01-20T10:52:36.730 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-01-20T10:52:36.978 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T10:52:37.068 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T10:52:38.454 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T10:52:38.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T10:52:38.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T10:52:38.848 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T10:52:38.848 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-01-20T10:52:38.848 INFO:teuthology.orchestra.run.smithi162.stdout: linux-firmware-20240109-142.el9.noarch 2024-01-20T10:52:38.848 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T10:52:38.848 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-01-20T10:52:39.133 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-20T10:52:39.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T10:52:39.286 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ 2024-01-20T10:52:39.286 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_g06652275eb93-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ --input-file=- 2024-01-20T10:52:39.289 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi162.front.sepia.ceph.com to complete... 2024-01-20T10:52:49.183 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20 10:52:49 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/kernel-6.7.0_g06652275eb93-1.x86_64.rpm [330048165/330048165] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-20T10:52:49.183 INFO:teuthology.orchestra.run.smithi179.stderr:FINISHED --2024-01-20 10:52:49-- 2024-01-20T10:52:49.184 INFO:teuthology.orchestra.run.smithi179.stderr:Total wall clock time: 13s 2024-01-20T10:52:49.184 INFO:teuthology.orchestra.run.smithi179.stderr:Downloaded: 1 files, 315M in 12s (25.5 MB/s) 2024-01-20T10:52:49.186 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-20T10:52:49.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-20T10:52:51.084 INFO:teuthology.orchestra.run.smithi179.stdout:Verifying... ######################################## 2024-01-20T10:52:51.216 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing... ######################################## 2024-01-20T10:52:51.295 INFO:teuthology.orchestra.run.smithi179.stdout:Updating / installing... 2024-01-20T10:52:58.692 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-6.7.0_g06652275eb93-1 ######################################## 2024-01-20T10:53:06.542 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20 10:53:06 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/kernel-6.7.0_g06652275eb93-1.x86_64.rpm [330048165/330048165] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-20T10:53:06.542 INFO:teuthology.orchestra.run.smithi162.stderr:FINISHED --2024-01-20 10:53:06-- 2024-01-20T10:53:06.542 INFO:teuthology.orchestra.run.smithi162.stderr:Total wall clock time: 27s 2024-01-20T10:53:06.542 INFO:teuthology.orchestra.run.smithi162.stderr:Downloaded: 1 files, 315M in 27s (11.8 MB/s) 2024-01-20T10:53:06.548 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-20T10:53:06.548 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-20T10:53:08.435 INFO:teuthology.orchestra.run.smithi162.stdout:Verifying... ######################################## 2024-01-20T10:53:08.569 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing... ######################################## 2024-01-20T10:53:08.648 INFO:teuthology.orchestra.run.smithi162.stdout:Updating / installing... 2024-01-20T10:53:15.114 INFO:teuthology.orchestra.run.smithi179.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-20T10:53:16.019 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-6.7.0_g06652275eb93-1 ######################################## 2024-01-20T10:53:30.194 INFO:teuthology.orchestra.run.smithi162.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-20T10:53:37.382 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-20T10:53:37.383 DEBUG:teuthology.orchestra.run.smithi179:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-20T10:53:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/System.map-6.7.0-g06652275eb93 2024-01-20T10:53:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/config-6.7.0-g06652275eb93 2024-01-20T10:53:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/vmlinuz-6.7.0-g06652275eb93 2024-01-20T10:53:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93 2024-01-20T10:53:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel 2024-01-20T10:53:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch 2024-01-20T10:53:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-20T10:53:37.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-20T10:53:37.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-20T10:53:37.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-20T10:53:37.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-20T10:53:37.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-20T10:53:37.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi 2024-01-20T10:53:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/custom_method.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ata_generic.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-20T10:53:37.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-20T10:53:37.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-20T10:53:37.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sis.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-20T10:53:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-20T10:53:37.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/brd.ko 2024-01-20T10:53:37.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/loop.ko 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-20T10:53:37.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/virtio_blk.ko 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkfront.ko 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char 2024-01-20T10:53:37.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi 2024-01-20T10:53:37.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-20T10:53:37.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-20T10:53:37.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-20T10:53:37.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-20T10:53:37.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-20T10:53:37.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-20T10:53:37.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-20T10:53:37.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave 2024-01-20T10:53:37.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-20T10:53:37.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-20T10:53:37.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-20T10:53:37.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm 2024-01-20T10:53:37.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm.ko 2024-01-20T10:53:37.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/uv_mmtimer.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/virtio_console.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-20T10:53:37.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-20T10:53:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-20T10:53:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-20T10:53:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio 2024-01-20T10:53:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-20T10:53:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca 2024-01-20T10:53:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-20T10:53:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq 2024-01-20T10:53:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-20T10:53:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma 2024-01-20T10:53:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw 2024-01-20T10:53:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-20T10:53:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat 2024-01-20T10:53:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-20T10:53:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac 2024-01-20T10:53:37.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-20T10:53:37.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-20T10:53:37.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-20T10:53:37.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-20T10:53:37.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-20T10:53:37.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-20T10:53:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware 2024-01-20T10:53:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/edd.ko 2024-01-20T10:53:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-20T10:53:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio 2024-01-20T10:53:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-20T10:53:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-20T10:53:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid 2024-01-20T10:53:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-20T10:53:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-20T10:53:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-20T10:53:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-20T10:53:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-20T10:53:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-20T10:53:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-20T10:53:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-20T10:53:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-20T10:53:37.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-20T10:53:37.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-20T10:53:37.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-20T10:53:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-20T10:53:37.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-20T10:53:37.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-20T10:53:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-20T10:53:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-20T10:53:37.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-20T10:53:37.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-20T10:53:37.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-20T10:53:37.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-20T10:53:37.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-20T10:53:37.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-20T10:53:37.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-20T10:53:37.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-dev.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-20T10:53:37.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-20T10:53:37.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-20T10:53:37.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4 2024-01-20T10:53:37.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-20T10:53:37.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-20T10:53:37.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-20T10:53:37.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-20T10:53:37.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mfd-core.ko 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-20T10:53:37.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-20T10:53:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc 2024-01-20T10:53:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl 2024-01-20T10:53:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-20T10:53:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-20T10:53:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-20T10:53:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-20T10:53:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710 2024-01-20T10:53:37.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-20T10:53:37.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom 2024-01-20T10:53:37.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-20T10:53:37.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-20T10:53:37.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-20T10:53:37.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-20T10:53:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-20T10:53:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-20T10:53:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-20T10:53:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d 2024-01-20T10:53:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-20T10:53:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-20T10:53:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei 2024-01-20T10:53:37.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-20T10:53:37.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-20T10:53:37.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-20T10:53:37.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru 2024-01-20T10:53:37.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-20T10:53:37.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp 2024-01-20T10:53:37.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci 2024-01-20T10:53:37.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-20T10:53:37.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net 2024-01-20T10:53:37.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding 2024-01-20T10:53:37.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-20T10:53:37.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa 2024-01-20T10:53:37.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53 2024-01-20T10:53:37.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-20T10:53:37.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-20T10:53:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-20T10:53:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx 2024-01-20T10:53:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-20T10:53:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-20T10:53:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-20T10:53:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet 2024-01-20T10:53:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com 2024-01-20T10:53:37.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-20T10:53:37.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-20T10:53:37.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon 2024-01-20T10:53:37.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx 2024-01-20T10:53:37.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-20T10:53:37.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec 2024-01-20T10:53:37.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-20T10:53:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-20T10:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-20T10:53:37.534 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-20T10:53:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-20T10:53:37.536 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan 2024-01-20T10:53:37.537 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-20T10:53:37.538 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-20T10:53:37.539 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-20T10:53:37.540 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/net_failover.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-20T10:53:37.541 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/dp83640.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-20T10:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slhc.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-20T10:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tun.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/virtio_net.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-20T10:53:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netfront.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci 2024-01-20T10:53:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-20T10:53:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-20T10:53:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-20T10:53:37.548 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-20T10:53:37.549 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-20T10:53:37.550 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-20T10:53:37.551 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc 2024-01-20T10:53:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-20T10:53:37.553 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-20T10:53:37.554 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-20T10:53:37.555 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-20T10:53:37.556 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-20T10:53:37.557 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-20T10:53:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-20T10:53:37.559 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-20T10:53:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-20T10:53:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-20T10:53:37.562 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-20T10:53:37.563 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial 2024-01-20T10:53:37.564 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-20T10:53:37.565 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-20T10:53:37.566 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-20T10:53:37.567 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-20T10:53:37.568 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-20T10:53:37.569 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_balloon.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_mmio.ko 2024-01-20T10:53:37.570 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_ring.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-20T10:53:37.571 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-20T10:53:37.572 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-20T10:53:37.573 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-20T10:53:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-20T10:53:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/fat.ko 2024-01-20T10:53:37.576 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/vfat.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/fuse.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-20T10:53:37.577 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout 2024-01-20T10:53:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-20T10:53:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-20T10:53:37.580 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-20T10:53:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-20T10:53:37.582 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs 2024-01-20T10:53:37.583 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs 2024-01-20T10:53:37.584 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu/rcutorture.ko 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace 2024-01-20T10:53:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/asn1_encoder.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math 2024-01-20T10:53:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd/zstd_compress.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-20T10:53:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-20T10:53:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-20T10:53:37.589 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-20T10:53:37.590 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/failover.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver 2024-01-20T10:53:37.591 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver/dns_resolver.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-20T10:53:37.592 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-20T10:53:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-20T10:53:37.594 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-20T10:53:37.595 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-20T10:53:37.596 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-20T10:53:37.597 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-20T10:53:37.598 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-20T10:53:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-20T10:53:37.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-20T10:53:37.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_quota.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tunnel.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-20T10:53:37.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-20T10:53:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-20T10:53:37.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-20T10:53:37.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-20T10:53:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-20T10:53:37.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-20T10:53:37.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-20T10:53:37.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-20T10:53:37.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys/trusted.ko 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-20T10:53:37.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-20T10:53:37.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-20T10:53:37.617 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-20T10:53:37.617 DEBUG:teuthology.orchestra.run.smithi179:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-20T10:53:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:postinstall scriptlet (using /bin/sh): 2024-01-20T10:53:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-g06652275eb93 -a -r /boot/System.map-6.7.0-g06652275eb93 ]; then 2024-01-20T10:53:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/vmlinuz-6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/System.map-6.7.0-g06652275eb93 /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/vmlinuz-6.7.0-g06652275eb93 /boot/System.map-6.7.0-g06652275eb93 2024-01-20T10:53:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/installkernel 6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:new-kernel-pkg --remove 6.7.0-g06652275eb93 --rminitrd --initrdfile=/boot/initramfs-6.7.0-g06652275eb93.img 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-install remove 6.7.0-g06652275eb93 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/update-bootloader --remove 6.7.0-g06652275eb93 2024-01-20T10:53:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-01-20T10:53:37.642 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2024-01-20T10:53:37.717 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2024-01-20T10:53:37.717 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2024-01-20T10:53:37.717 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.06 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 68.el9 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Group : Unspecified 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 8264254 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : builder@centos.org 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2024-01-20T10:53:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2024-01-20T10:53:37.720 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-20T10:53:37.720 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 6.7.0-g06652275eb93 2024-01-20T10:53:37.720 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-20T10:53:38.391 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-01-20T10:53:39.756 INFO:teuthology.orchestra.run.smithi179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-20T10:53:39.791 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-01-20T10:53:39.802 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-01-20T10:53:39.817 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.umeup7lOWQ 2024-01-20T10:53:39.817 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.umeup7lOWQ 2024-01-20T10:53:39.886 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.umeup7lOWQ 2024-01-20T10:53:40.028 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.umeup7lOWQ is 6KB 2024-01-20T10:53:40.076 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.umeup7lOWQ 2024-01-20T10:53:40.091 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2024-01-20T10:53:40.155 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-20T10:53:40.155 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-20T10:53:40.155 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-20T10:53:40.155 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93.conf 2024-01-20T10:53:40.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93 2024-01-20T10:53:40.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-01-20T10:53:52.539 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-20T10:53:52.539 DEBUG:teuthology.orchestra.run.smithi162:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-20T10:53:52.611 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/System.map-6.7.0-g06652275eb93 2024-01-20T10:53:52.611 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/config-6.7.0-g06652275eb93 2024-01-20T10:53:52.611 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/vmlinuz-6.7.0-g06652275eb93 2024-01-20T10:53:52.611 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93 2024-01-20T10:53:52.611 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel 2024-01-20T10:53:52.611 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-20T10:53:52.612 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm 2024-01-20T10:53:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-20T10:53:52.614 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-20T10:53:52.615 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-20T10:53:52.616 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers 2024-01-20T10:53:52.617 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/custom_method.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata 2024-01-20T10:53:52.618 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ata_generic.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-20T10:53:52.619 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-20T10:53:52.620 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sis.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-20T10:53:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-20T10:53:52.622 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/brd.ko 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-20T10:53:52.623 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/loop.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/virtio_blk.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkfront.ko 2024-01-20T10:53:52.624 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-20T10:53:52.625 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/uv_mmtimer.ko 2024-01-20T10:53:52.626 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/virtio_console.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common 2024-01-20T10:53:52.627 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma 2024-01-20T10:53:52.628 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-20T10:53:52.629 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/edd.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-20T10:53:52.630 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-20T10:53:52.631 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-20T10:53:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-20T10:53:52.633 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-20T10:53:52.634 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-20T10:53:52.635 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-20T10:53:52.636 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-20T10:53:52.637 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-20T10:53:52.638 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-20T10:53:52.639 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-20T10:53:52.640 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-20T10:53:52.641 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-20T10:53:52.642 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-20T10:53:52.643 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-20T10:53:52.644 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-20T10:53:52.645 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-dev.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-20T10:53:52.646 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-20T10:53:52.647 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-20T10:53:52.648 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4 2024-01-20T10:53:52.649 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-20T10:53:52.650 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-20T10:53:52.651 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-20T10:53:52.652 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-20T10:53:52.653 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mfd-core.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710 2024-01-20T10:53:52.654 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-20T10:53:52.655 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-20T10:53:52.656 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-20T10:53:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera 2024-01-20T10:53:52.658 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-20T10:53:52.659 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-20T10:53:52.660 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-20T10:53:52.661 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel 2024-01-20T10:53:52.662 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-20T10:53:52.663 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-20T10:53:52.664 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-20T10:53:52.665 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-20T10:53:52.666 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-20T10:53:52.667 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-20T10:53:52.668 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-20T10:53:52.669 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/net_failover.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy 2024-01-20T10:53:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/dp83640.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-20T10:53:52.671 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-20T10:53:52.672 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slhc.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-20T10:53:52.673 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tun.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/virtio_net.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netfront.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-20T10:53:52.674 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-20T10:53:52.675 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-20T10:53:52.676 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-20T10:53:52.677 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-20T10:53:52.678 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-20T10:53:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-20T10:53:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-20T10:53:52.681 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor 2024-01-20T10:53:52.682 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r 2024-01-20T10:53:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci 2024-01-20T10:53:52.684 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-20T10:53:52.685 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-20T10:53:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-20T10:53:52.687 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-20T10:53:52.688 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-20T10:53:52.689 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250 2024-01-20T10:53:52.690 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb 2024-01-20T10:53:52.691 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-20T10:53:52.692 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy 2024-01-20T10:53:52.693 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-20T10:53:52.694 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-20T10:53:52.695 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-20T10:53:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-20T10:53:52.697 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost 2024-01-20T10:53:52.698 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_balloon.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_mmio.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-20T10:53:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_ring.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-20T10:53:52.700 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-20T10:53:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-20T10:53:52.702 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p 2024-01-20T10:53:52.703 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-20T10:53:52.704 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/fat.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/vfat.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse 2024-01-20T10:53:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/fuse.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-20T10:53:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common 2024-01-20T10:53:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-20T10:53:52.708 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-20T10:53:52.709 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-20T10:53:52.710 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-20T10:53:52.711 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-20T10:53:52.712 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-20T10:53:52.713 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu/rcutorture.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/asn1_encoder.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto 2024-01-20T10:53:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-20T10:53:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd/zstd_compress.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-20T10:53:52.716 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv 2024-01-20T10:53:52.717 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-20T10:53:52.718 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-20T10:53:52.719 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/failover.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver/dns_resolver.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-20T10:53:52.720 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-20T10:53:52.721 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-20T10:53:52.722 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-20T10:53:52.723 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-20T10:53:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-20T10:53:52.725 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-20T10:53:52.726 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-20T10:53:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-20T10:53:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs 2024-01-20T10:53:52.729 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-20T10:53:52.730 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-20T10:53:52.731 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-20T10:53:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-20T10:53:52.733 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_quota.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tunnel.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-20T10:53:52.734 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-20T10:53:52.735 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-20T10:53:52.736 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-20T10:53:52.737 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-20T10:53:52.738 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-20T10:53:52.739 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-20T10:53:52.740 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-20T10:53:52.741 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-20T10:53:52.742 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-20T10:53:52.743 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-20T10:53:52.744 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys/trusted.ko 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-20T10:53:52.745 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-20T10:53:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-20T10:53:52.747 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-20T10:53:52.747 DEBUG:teuthology.orchestra.run.smithi162:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:postinstall scriptlet (using /bin/sh): 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-g06652275eb93 -a -r /boot/System.map-6.7.0-g06652275eb93 ]; then 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:cp /boot/vmlinuz-6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:cp /boot/System.map-6.7.0-g06652275eb93 /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:rm -f /boot/vmlinuz-6.7.0-g06652275eb93 /boot/System.map-6.7.0-g06652275eb93 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:/sbin/installkernel 6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:rm -f /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-01-20T10:53:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:new-kernel-pkg --remove 6.7.0-g06652275eb93 --rminitrd --initrdfile=/boot/initramfs-6.7.0-g06652275eb93.img 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-install remove 6.7.0-g06652275eb93 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:/sbin/update-bootloader --remove 6.7.0-g06652275eb93 2024-01-20T10:53:52.772 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-01-20T10:53:52.773 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-01-20T10:53:52.851 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-01-20T10:53:52.851 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 68.el9 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8264254 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-01-20T10:53:52.852 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T10:53:52.853 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-01-20T10:53:52.854 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-20T10:53:52.854 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 6.7.0-g06652275eb93 2024-01-20T10:53:52.854 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-20T10:53:53.493 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-01-20T10:53:54.857 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-20T10:53:54.878 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-01-20T10:53:54.880 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-01-20T10:53:54.895 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.sbnZbK9jZx 2024-01-20T10:53:54.896 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sbnZbK9jZx 2024-01-20T10:53:54.972 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.sbnZbK9jZx 2024-01-20T10:53:55.113 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.sbnZbK9jZx is 6KB 2024-01-20T10:53:55.162 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.sbnZbK9jZx 2024-01-20T10:53:55.177 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-01-20T10:53:55.241 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-20T10:53:55.241 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-20T10:53:55.241 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-20T10:53:55.242 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93.conf 2024-01-20T10:53:55.242 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93 2024-01-20T10:53:55.376 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-01-20T10:54:10.358 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-20T10:54:10.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-20T10:54:10.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:54:25.390 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-20T10:54:25.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T10:54:25.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:54:28.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-01-20T10:54:37.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-20T10:54:37.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:54:40.992 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-01-20T10:54:43.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-01-20T10:54:52.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T10:54:52.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:54:52.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-20T10:54:52.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:54:55.836 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-01-20T10:55:07.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T10:55:07.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:55:11.424 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-01-20T10:55:26.268 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-01-20T10:55:26.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-20T10:55:26.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:55:26.934 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-01-20T10:55:27.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-20T10:55:27.525 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.7.0-g06652275eb93"... 2024-01-20T10:55:27.525 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-01-20T10:55:27.563 INFO:teuthology.orchestra.run.smithi179.stdout:6.7.0-g06652275eb93 2024-01-20T10:55:27.564 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-20T10:55:27.564 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-20T10:55:27.564 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-20T10:55:28.567 DEBUG:teuthology.parallel:result is None 2024-01-20T10:55:41.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T10:55:41.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:55:44.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-01-20T10:56:02.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T10:56:02.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T10:56:02.729 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-01-20T10:56:03.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T10:56:03.286 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-g06652275eb93"... 2024-01-20T10:56:03.286 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-01-20T10:56:03.324 INFO:teuthology.orchestra.run.smithi162.stdout:6.7.0-g06652275eb93 2024-01-20T10:56:03.325 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-20T10:56:03.325 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-20T10:56:03.325 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-20T10:56:04.327 DEBUG:teuthology.parallel:result is None 2024-01-20T10:56:04.328 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-20T10:56:04.341 INFO:teuthology.task.internal:Creating test directory... 2024-01-20T10:56:04.341 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-20T10:56:04.349 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-20T10:56:04.411 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-20T10:56:04.421 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-20T10:56:04.435 INFO:teuthology.task.internal:Creating archive directory... 2024-01-20T10:56:04.435 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-20T10:56:04.440 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-20T10:56:04.506 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-20T10:56:04.517 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-20T10:56:04.517 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-20T10:56:04.523 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-20T10:56:04.679 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T10:56:04.716 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T10:56:04.750 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T10:56:04.807 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T10:56:04.811 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-20T10:56:04.820 INFO:teuthology.task.internal:Configuring sudo... 2024-01-20T10:56:04.820 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-20T10:56:04.825 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-20T10:56:04.917 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-20T10:56:04.931 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-20T10:56:04.932 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-20T10:56:04.936 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-20T10:56:04.990 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T10:56:05.075 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T10:56:05.202 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T10:56:05.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T10:56:05.454 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T10:56:05.455 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-20T10:56:05.593 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T10:56:05.680 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T10:56:05.786 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T10:56:05.874 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T10:56:05.973 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T10:56:05.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-20T10:56:06.063 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-01-20T10:56:06.072 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-01-20T10:56:06.235 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T10:56:06.247 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T10:56:06.788 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-20T10:56:06.800 INFO:teuthology.task.internal:Starting timer... 2024-01-20T10:56:06.800 INFO:teuthology.run_tasks:Running task pcp... 2024-01-20T10:56:06.817 INFO:teuthology.run_tasks:Running task selinux... 2024-01-20T10:56:06.832 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-01-20T10:56:06.994 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-01-20T10:56:06.999 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-01-20T10:56:07.141 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-01-20T10:56:07.145 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-20T10:56:07.145 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-01-20T10:56:07.202 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-01-20T10:56:07.202 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-01-20T10:56:07.274 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-01-20T10:56:07.274 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi162.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-01-20T10:56:07.275 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T10:56:07.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T10:56:07.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T10:56:07.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T10:56:07.455 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-20T10:56:07.455 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-01-20T10:56:07.539 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-01-20T10:56:07.674 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-20T10:56:07.689 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-20T10:56:07.694 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-20T10:56:07.817 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-20T10:56:07.833 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-20T10:56:07.834 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi162.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-20T11:01:46.173 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi162.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-01-20T11:01:46.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T11:01:46.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T11:01:46.318 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-01-20T11:01:46.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-01-20T11:01:46.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-20T11:01:46.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T11:01:46.611 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-01-20T11:01:46.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-20T11:01:46.763 INFO:teuthology.run_tasks:Running task clock... 2024-01-20T11:01:46.774 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-20T11:01:46.774 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-20T11:01:46.775 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T11:01:46.782 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-20T11:01:46.782 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T11:01:46.878 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-20T11:01:46.884 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-20T11:01:46.930 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-20T11:01:46.934 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-20T11:01:47.022 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-01-20T11:01:47.026 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-01-20T11:01:47.063 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-01-20T11:01:47.065 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-01-20T11:01:47.112 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-20T11:01:47.115 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-20T11:01:47.166 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-20T11:01:47.166 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-20T11:01:47.285 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-01-20T11:01:47.285 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-01-20T11:01:47.292 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T11:01:47.292 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-01-20T11:01:47.292 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.292 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.292 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.292 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.294 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T11:01:47.294 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-01-20T11:01:47.294 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.294 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.294 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.294 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:01:47.295 INFO:teuthology.run_tasks:Running task install... 2024-01-20T11:01:47.304 DEBUG:teuthology.task.install:project ceph 2024-01-20T11:01:47.304 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}} 2024-01-20T11:01:47.304 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'} 2024-01-20T11:01:47.304 INFO:teuthology.task.install:Using flavor: default 2024-01-20T11:01:47.310 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-20T11:01:47.310 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-20T11:01:47.311 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'tag': None, 'wait_for_package': False} 2024-01-20T11:01:47.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T11:01:47.313 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'tag': None, 'wait_for_package': False} 2024-01-20T11:01:47.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T11:01:47.467 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/ 2024-01-20T11:01:47.467 INFO:teuthology.task.install.rpm:Package version is 19.0.0-763.ga00c9940 2024-01-20T11:01:47.533 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/ 2024-01-20T11:01:47.533 INFO:teuthology.task.install.rpm:Package version is 19.0.0-763.ga00c9940 2024-01-20T11:01:47.576 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-20T11:01:47.577 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:01:47.577 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-20T11:01:47.644 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-20T11:01:47.644 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:01:47.644 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-20T11:01:47.674 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-20T11:01:47.674 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-20T11:01:47.740 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-20T11:01:47.741 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-20T11:01:47.812 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-20T11:01:47.880 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-20T11:01:47.945 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-20T11:01:48.013 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-20T11:01:48.038 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-01-20T11:01:48.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-01-20T11:01:48.103 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-01-20T11:01:48.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-01-20T11:01:48.392 INFO:teuthology.orchestra.run.smithi179.stdout:73 files removed 2024-01-20T11:01:48.431 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-20T11:01:48.459 INFO:teuthology.orchestra.run.smithi162.stdout:73 files removed 2024-01-20T11:01:48.498 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-20T11:01:49.502 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 140 kB/s | 80 kB 00:00 2024-01-20T11:01:49.511 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 157 kB/s | 80 kB 00:00 2024-01-20T11:01:50.012 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2024-01-20T11:01:50.019 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2024-01-20T11:01:50.471 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-01-20T11:01:50.503 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-01-20T11:01:51.057 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2024-01-20T11:01:51.123 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2024-01-20T11:01:52.613 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-01-20T11:01:52.665 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2024-01-20T11:01:53.570 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-01-20T11:02:03.627 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 765 kB/s | 8.0 MB 00:10 2024-01-20T11:02:06.531 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 1.6 MB/s | 19 MB 00:11 2024-01-20T11:02:08.177 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-01-20T11:02:11.199 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 5.9 MB 00:00 2024-01-20T11:02:12.791 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 15 kB 00:00 2024-01-20T11:02:13.708 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 5.9 MB 00:01 2024-01-20T11:02:14.209 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2024-01-20T11:02:15.353 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 15 kB 00:00 2024-01-20T11:02:17.673 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 20 MB 00:02 2024-01-20T11:02:19.826 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-01-20T11:02:22.467 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T11:02:22.469 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T11:02:22.491 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-20T11:02:22.492 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-20T11:02:22.494 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-20T11:02:22.495 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-20T11:02:22.498 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-20T11:02:22.502 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-20T11:02:22.503 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-20T11:02:22.585 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout:=========================================================================================== 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout:=========================================================================================== 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.0.0-763.ga00c9940.el9 ceph 6.6 k 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.0.0-763.ga00c9940.el9 ceph 5.1 M 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 886 k 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-763.ga00c9940.el9 ceph 145 k 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.0.0-763.ga00c9940.el9 ceph 1.5 M 2024-01-20T11:02:22.602 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 133 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 1.7 M 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 7.4 M 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 51 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 8.6 M 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.0.0-763.ga00c9940.el9 ceph 46 M 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 262 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 742 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 217 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell x86_64 2:19.0.0-763.ga00c9940.el9 ceph 27 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 18 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-20T11:02:22.603 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 31 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 742 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 127 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.0.0-763.ga00c9940.el9 ceph 162 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.0.0-763.ga00c9940.el9 ceph 320 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 297 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 99 k 2024-01-20T11:02:22.604 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 85 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 170 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-20T11:02:22.605 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.4 M 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 19 M 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 28 k 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.0.0-763.ga00c9940.el9 ceph 2.1 M 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 245 k 2024-01-20T11:02:22.606 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.7 M 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 17 M 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 15 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.0.0-763.ga00c9940.el9 ceph 25 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.0.0-763.ga00c9940.el9 ceph 163 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-20T11:02:22.607 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 499 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.8 M 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-20T11:02:22.608 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 45 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 130 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-20T11:02:22.609 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.26.0-1.el9 epel 202 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-20T11:02:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-20T11:02:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-20T11:02:22.612 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout:=========================================================================================== 2024-01-20T11:02:22.613 INFO:teuthology.orchestra.run.smithi179.stdout:Install 139 Packages 2024-01-20T11:02:22.614 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 16 Packages 2024-01-20T11:02:22.614 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:02:22.614 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 209 M 2024-01-20T11:02:22.614 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-01-20T11:02:23.229 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-01-20T11:02:25.971 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T11:02:25.972 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T11:02:25.996 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-20T11:02:25.997 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-20T11:02:25.999 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-20T11:02:26.000 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-20T11:02:26.003 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-20T11:02:26.007 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-20T11:02:26.008 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-20T11:02:26.096 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-01-20T11:02:26.117 INFO:teuthology.orchestra.run.smithi162.stdout:=========================================================================================== 2024-01-20T11:02:26.117 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-01-20T11:02:26.117 INFO:teuthology.orchestra.run.smithi162.stdout:=========================================================================================== 2024-01-20T11:02:26.117 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-01-20T11:02:26.117 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-20T11:02:26.117 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.0.0-763.ga00c9940.el9 ceph 6.6 k 2024-01-20T11:02:26.117 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.0.0-763.ga00c9940.el9 ceph 5.1 M 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 886 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-763.ga00c9940.el9 ceph 145 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.0.0-763.ga00c9940.el9 ceph 1.5 M 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 133 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 1.7 M 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 7.4 M 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 51 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 8.6 M 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.0.0-763.ga00c9940.el9 ceph 46 M 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 262 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 742 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 217 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.0.0-763.ga00c9940.el9 ceph 27 k 2024-01-20T11:02:26.118 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 18 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 31 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 742 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 127 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.0.0-763.ga00c9940.el9 ceph 162 k 2024-01-20T11:02:26.119 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.0.0-763.ga00c9940.el9 ceph 320 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 297 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 99 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 85 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 170 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-20T11:02:26.120 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.4 M 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-20T11:02:26.121 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 19 M 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 28 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.0.0-763.ga00c9940.el9 ceph 2.1 M 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 245 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.7 M 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 17 M 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 15 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.0.0-763.ga00c9940.el9 ceph 25 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-20T11:02:26.122 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.0.0-763.ga00c9940.el9 ceph 163 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 499 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.8 M 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-20T11:02:26.123 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 45 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 130 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-20T11:02:26.124 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.26.0-1.el9 epel 202 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-20T11:02:26.125 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-20T11:02:26.126 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-20T11:02:26.127 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-01-20T11:02:26.128 INFO:teuthology.orchestra.run.smithi162.stdout:=========================================================================================== 2024-01-20T11:02:26.129 INFO:teuthology.orchestra.run.smithi162.stdout:Install 139 Packages 2024-01-20T11:02:26.129 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 16 Packages 2024-01-20T11:02:26.129 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:02:26.129 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 209 M 2024-01-20T11:02:26.129 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-01-20T11:02:27.016 INFO:teuthology.orchestra.run.smithi162.stdout:(1/155): ceph-19.0.0-763.ga00c9940.el9.x86_64.r 21 kB/s | 6.6 kB 00:00 2024-01-20T11:02:27.505 INFO:teuthology.orchestra.run.smithi162.stdout:(2/155): ceph-base-19.0.0-763.ga00c9940.el9.x86 6.3 MB/s | 5.1 MB 00:00 2024-01-20T11:02:27.564 INFO:teuthology.orchestra.run.smithi162.stdout:(3/155): ceph-immutable-object-cache-19.0.0-763 2.5 MB/s | 145 kB 00:00 2024-01-20T11:02:27.806 INFO:teuthology.orchestra.run.smithi162.stdout:(4/155): ceph-mds-19.0.0-763.ga00c9940.el9.x86_ 8.8 MB/s | 2.1 MB 00:00 2024-01-20T11:02:27.989 INFO:teuthology.orchestra.run.smithi162.stdout:(5/155): ceph-mgr-19.0.0-763.ga00c9940.el9.x86_ 8.2 MB/s | 1.5 MB 00:00 2024-01-20T11:02:28.298 INFO:teuthology.orchestra.run.smithi162.stdout:(6/155): ceph-common-19.0.0-763.ga00c9940.el9.x 12 MB/s | 19 MB 00:01 2024-01-20T11:02:28.340 INFO:teuthology.orchestra.run.smithi162.stdout:(7/155): ceph-fuse-19.0.0-763.ga00c9940.el9.x86 669 kB/s | 886 kB 00:01 2024-01-20T11:02:28.498 INFO:teuthology.orchestra.run.smithi162.stdout:(8/155): ceph-mon-19.0.0-763.ga00c9940.el9.x86_ 9.2 MB/s | 4.7 MB 00:00 2024-01-20T11:02:28.557 INFO:teuthology.orchestra.run.smithi162.stdout:(9/155): ceph-selinux-19.0.0-763.ga00c9940.el9. 440 kB/s | 25 kB 00:00 2024-01-20T11:02:29.507 INFO:teuthology.orchestra.run.smithi162.stdout:(10/155): ceph-osd-19.0.0-763.ga00c9940.el9.x86 14 MB/s | 17 MB 00:01 2024-01-20T11:02:29.557 INFO:teuthology.orchestra.run.smithi162.stdout:(11/155): cephfs-mirror-19.0.0-763.ga00c9940.el 4.3 MB/s | 217 kB 00:00 2024-01-20T11:02:29.616 INFO:teuthology.orchestra.run.smithi162.stdout:(12/155): cephfs-shell-19.0.0-763.ga00c9940.el9 472 kB/s | 27 kB 00:00 2024-01-20T11:02:29.699 INFO:teuthology.orchestra.run.smithi162.stdout:(13/155): libcephfs-devel-19.0.0-763.ga00c9940. 378 kB/s | 31 kB 00:00 2024-01-20T11:02:29.875 INFO:teuthology.orchestra.run.smithi162.stdout:(14/155): libcephfs2-19.0.0-763.ga00c9940.el9.x 4.2 MB/s | 742 kB 00:00 2024-01-20T11:02:29.950 INFO:teuthology.orchestra.run.smithi162.stdout:(15/155): libcephsqlite-19.0.0-763.ga00c9940.el 2.2 MB/s | 163 kB 00:00 2024-01-20T11:02:30.033 INFO:teuthology.orchestra.run.smithi162.stdout:(16/155): librados-devel-19.0.0-763.ga00c9940.e 1.5 MB/s | 127 kB 00:00 2024-01-20T11:02:30.142 INFO:teuthology.orchestra.run.smithi162.stdout:(17/155): libradosstriper1-19.0.0-763.ga00c9940 4.5 MB/s | 499 kB 00:00 2024-01-20T11:02:30.656 INFO:teuthology.orchestra.run.smithi162.stdout:(18/155): librgw2-19.0.0-763.ga00c9940.el9.x86_ 9.3 MB/s | 4.8 MB 00:00 2024-01-20T11:02:30.709 INFO:teuthology.orchestra.run.smithi162.stdout:(19/155): python3-ceph-argparse-19.0.0-763.ga00 868 kB/s | 45 kB 00:00 2024-01-20T11:02:30.769 INFO:teuthology.orchestra.run.smithi162.stdout:(20/155): python3-ceph-common-19.0.0-763.ga00c9 2.2 MB/s | 130 kB 00:00 2024-01-20T11:02:30.835 INFO:teuthology.orchestra.run.smithi162.stdout:(21/155): python3-cephfs-19.0.0-763.ga00c9940.e 2.4 MB/s | 162 kB 00:00 2024-01-20T11:02:30.910 INFO:teuthology.orchestra.run.smithi162.stdout:(22/155): python3-rados-19.0.0-763.ga00c9940.el 4.2 MB/s | 320 kB 00:00 2024-01-20T11:02:30.977 INFO:teuthology.orchestra.run.smithi162.stdout:(23/155): python3-rbd-19.0.0-763.ga00c9940.el9. 4.4 MB/s | 297 kB 00:00 2024-01-20T11:02:31.036 INFO:teuthology.orchestra.run.smithi162.stdout:(24/155): python3-rgw-19.0.0-763.ga00c9940.el9. 1.7 MB/s | 99 kB 00:00 2024-01-20T11:02:31.094 INFO:teuthology.orchestra.run.smithi162.stdout:(25/155): rbd-fuse-19.0.0-763.ga00c9940.el9.x86 1.4 MB/s | 85 kB 00:00 2024-01-20T11:02:31.386 INFO:teuthology.orchestra.run.smithi162.stdout:(26/155): rbd-mirror-19.0.0-763.ga00c9940.el9.x 11 MB/s | 3.1 MB 00:00 2024-01-20T11:02:31.445 INFO:teuthology.orchestra.run.smithi162.stdout:(27/155): rbd-nbd-19.0.0-763.ga00c9940.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-01-20T11:02:31.503 INFO:teuthology.orchestra.run.smithi162.stdout:(28/155): ceph-grafana-dashboards-19.0.0-763.ga 495 kB/s | 28 kB 00:00 2024-01-20T11:02:31.570 INFO:teuthology.orchestra.run.smithi162.stdout:(29/155): ceph-mgr-cephadm-19.0.0-763.ga00c9940 2.0 MB/s | 133 kB 00:00 2024-01-20T11:02:31.762 INFO:teuthology.orchestra.run.smithi162.stdout:(30/155): ceph-mgr-dashboard-19.0.0-763.ga00c99 9.1 MB/s | 1.7 MB 00:00 2024-01-20T11:02:32.238 INFO:teuthology.orchestra.run.smithi162.stdout:(31/155): ceph-test-19.0.0-763.ga00c9940.el9.x8 12 MB/s | 46 MB 00:03 2024-01-20T11:02:32.313 INFO:teuthology.orchestra.run.smithi162.stdout:(32/155): ceph-mgr-modules-core-19.0.0-763.ga00 3.3 MB/s | 245 kB 00:00 2024-01-20T11:02:32.379 INFO:teuthology.orchestra.run.smithi162.stdout:(33/155): ceph-mgr-rook-19.0.0-763.ga00c9940.el 773 kB/s | 51 kB 00:00 2024-01-20T11:02:32.547 INFO:teuthology.orchestra.run.smithi162.stdout:(34/155): ceph-mgr-diskprediction-local-19.0.0- 9.5 MB/s | 7.4 MB 00:00 2024-01-20T11:02:32.572 INFO:teuthology.orchestra.run.smithi162.stdout:(35/155): ceph-prometheus-alerts-19.0.0-763.ga0 79 kB/s | 15 kB 00:00 2024-01-20T11:02:32.630 INFO:teuthology.orchestra.run.smithi162.stdout:(36/155): ceph-volume-19.0.0-763.ga00c9940.el9. 4.5 MB/s | 262 kB 00:00 2024-01-20T11:02:32.672 INFO:teuthology.orchestra.run.smithi162.stdout:(37/155): cephadm-19.0.0-763.ga00c9940.el9.noar 7.3 MB/s | 742 kB 00:00 2024-01-20T11:02:32.697 INFO:teuthology.orchestra.run.smithi162.stdout:(38/155): cephfs-top-19.0.0-763.ga00c9940.el9.n 276 kB/s | 18 kB 00:00 2024-01-20T11:02:32.998 INFO:teuthology.orchestra.run.smithi162.stdout:(39/155): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2024-01-20T11:02:33.048 INFO:teuthology.orchestra.run.smithi162.stdout:(40/155): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 920 kB 00:00 2024-01-20T11:02:33.098 INFO:teuthology.orchestra.run.smithi162.stdout:(41/155): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2024-01-20T11:02:33.115 INFO:teuthology.orchestra.run.smithi162.stdout:(42/155): elfutils-libelf-devel-0.190-2.el9.x86 313 kB/s | 20 kB 00:00 2024-01-20T11:02:33.166 INFO:teuthology.orchestra.run.smithi162.stdout:(43/155): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2024-01-20T11:02:33.183 INFO:teuthology.orchestra.run.smithi162.stdout:(44/155): flexiblas-3.0.4-8.el9.x86_64.rpm 499 kB/s | 32 kB 00:00 2024-01-20T11:02:33.283 INFO:teuthology.orchestra.run.smithi162.stdout:(45/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-01-20T11:02:33.299 INFO:teuthology.orchestra.run.smithi162.stdout:(46/155): flexiblas-openblas-openmp-3.0.4-8.el9 161 kB/s | 17 kB 00:00 2024-01-20T11:02:33.324 INFO:teuthology.orchestra.run.smithi162.stdout:(47/155): libaio-devel-0.3.111-13.el9.x86_64.rp 424 kB/s | 10 kB 00:00 2024-01-20T11:02:33.349 INFO:teuthology.orchestra.run.smithi162.stdout:(48/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2024-01-20T11:02:33.367 INFO:teuthology.orchestra.run.smithi162.stdout:(49/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-01-20T11:02:33.409 INFO:teuthology.orchestra.run.smithi162.stdout:(50/155): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-01-20T11:02:33.451 INFO:teuthology.orchestra.run.smithi162.stdout:(51/155): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-01-20T11:02:33.476 INFO:teuthology.orchestra.run.smithi162.stdout:(52/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 398 kB/s | 24 kB 00:00 2024-01-20T11:02:33.501 INFO:teuthology.orchestra.run.smithi162.stdout:(53/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 937 kB/s | 46 kB 00:00 2024-01-20T11:02:33.543 INFO:teuthology.orchestra.run.smithi162.stdout:(54/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-01-20T11:02:33.602 INFO:teuthology.orchestra.run.smithi162.stdout:(55/155): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 187 kB 00:00 2024-01-20T11:02:33.627 INFO:teuthology.orchestra.run.smithi162.stdout:(56/155): openblas-0.3.21-2.el9.x86_64.rpm 420 kB/s | 34 kB 00:00 2024-01-20T11:02:33.761 INFO:teuthology.orchestra.run.smithi162.stdout:(57/155): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-01-20T11:02:33.836 INFO:teuthology.orchestra.run.smithi162.stdout:(58/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 15 MB/s | 3.0 MB 00:00 2024-01-20T11:02:33.895 INFO:teuthology.orchestra.run.smithi162.stdout:(59/155): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2024-01-20T11:02:33.937 INFO:teuthology.orchestra.run.smithi162.stdout:(60/155): postgresql-contrib-13.11-1.el9.x86_64 9.1 MB/s | 811 kB 00:00 2024-01-20T11:02:33.962 INFO:teuthology.orchestra.run.smithi162.stdout:(61/155): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2024-01-20T11:02:34.104 INFO:teuthology.orchestra.run.smithi162.stdout:(62/155): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-01-20T11:02:34.129 INFO:teuthology.orchestra.run.smithi162.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 509 kB/s | 78 kB 00:00 2024-01-20T11:02:34.280 INFO:teuthology.orchestra.run.smithi162.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-01-20T11:02:34.313 INFO:teuthology.orchestra.run.smithi162.stdout:(65/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2024-01-20T11:02:34.338 INFO:teuthology.orchestra.run.smithi162.stdout:(66/155): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 24 kB 00:00 2024-01-20T11:02:34.364 INFO:teuthology.orchestra.run.smithi162.stdout:(67/155): python3-jsonpointer-2.0-4.el9.noarch. 368 kB/s | 18 kB 00:00 2024-01-20T11:02:34.389 INFO:teuthology.orchestra.run.smithi162.stdout:(68/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2024-01-20T11:02:34.414 INFO:teuthology.orchestra.run.smithi162.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 654 kB/s | 32 kB 00:00 2024-01-20T11:02:34.581 INFO:teuthology.orchestra.run.smithi162.stdout:(70/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2024-01-20T11:02:34.606 INFO:teuthology.orchestra.run.smithi162.stdout:(71/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-01-20T11:02:34.765 INFO:teuthology.orchestra.run.smithi162.stdout:(72/155): ceph-radosgw-19.0.0-763.ga00c9940.el9 1.3 MB/s | 8.6 MB 00:06 2024-01-20T11:02:34.798 INFO:teuthology.orchestra.run.smithi162.stdout:(73/155): python3-oauthlib-3.1.1-5.el9.noarch.r 915 kB/s | 174 kB 00:00 2024-01-20T11:02:34.823 INFO:teuthology.orchestra.run.smithi162.stdout:(74/155): python3-prettytable-0.7.2-27.el9.noar 191 kB/s | 41 kB 00:00 2024-01-20T11:02:34.849 INFO:teuthology.orchestra.run.smithi162.stdout:(75/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2024-01-20T11:02:34.882 INFO:teuthology.orchestra.run.smithi162.stdout:(76/155): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-01-20T11:02:34.907 INFO:teuthology.orchestra.run.smithi162.stdout:(77/155): python3-pytz-2021.1-5.el9.noarch.rpm 580 kB/s | 47 kB 00:00 2024-01-20T11:02:34.933 INFO:teuthology.orchestra.run.smithi162.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 528 kB/s | 43 kB 00:00 2024-01-20T11:02:34.958 INFO:teuthology.orchestra.run.smithi162.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 797 kB/s | 39 kB 00:00 2024-01-20T11:02:35.100 INFO:teuthology.orchestra.run.smithi162.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 247 kB/s | 41 kB 00:00 2024-01-20T11:02:35.334 INFO:teuthology.orchestra.run.smithi162.stdout:(81/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-01-20T11:02:35.367 INFO:teuthology.orchestra.run.smithi162.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 760 kB/s | 300 kB 00:00 2024-01-20T11:02:35.392 INFO:teuthology.orchestra.run.smithi162.stdout:(83/155): uuid-1.6.2-55.el9.x86_64.rpm 201 kB/s | 56 kB 00:00 2024-01-20T11:02:35.418 INFO:teuthology.orchestra.run.smithi162.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-01-20T11:02:35.434 INFO:teuthology.orchestra.run.smithi162.stdout:(85/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-01-20T11:02:35.485 INFO:teuthology.orchestra.run.smithi162.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 489 kB/s | 44 kB 00:00 2024-01-20T11:02:35.510 INFO:teuthology.orchestra.run.smithi162.stdout:(87/155): fuse-2.9.9-15.el9.x86_64.rpm 868 kB/s | 79 kB 00:00 2024-01-20T11:02:35.544 INFO:teuthology.orchestra.run.smithi162.stdout:(88/155): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2024-01-20T11:02:35.577 INFO:teuthology.orchestra.run.smithi162.stdout:(89/155): libgfortran-11.4.1-3.el9.x86_64.rpm 8.7 MB/s | 802 kB 00:00 2024-01-20T11:02:35.611 INFO:teuthology.orchestra.run.smithi162.stdout:(90/155): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 194 kB 00:00 2024-01-20T11:02:35.636 INFO:teuthology.orchestra.run.smithi162.stdout:(91/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.8 MB/s | 217 kB 00:00 2024-01-20T11:02:35.670 INFO:teuthology.orchestra.run.smithi162.stdout:(92/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-01-20T11:02:35.720 INFO:teuthology.orchestra.run.smithi162.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-01-20T11:02:35.745 INFO:teuthology.orchestra.run.smithi162.stdout:(94/155): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-01-20T11:02:35.770 INFO:teuthology.orchestra.run.smithi162.stdout:(95/155): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2024-01-20T11:02:35.795 INFO:teuthology.orchestra.run.smithi162.stdout:(96/155): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2024-01-20T11:02:35.829 INFO:teuthology.orchestra.run.smithi162.stdout:(97/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-01-20T11:02:35.904 INFO:teuthology.orchestra.run.smithi162.stdout:(98/155): lua-devel-5.4.4-4.el9.x86_64.rpm 210 kB/s | 22 kB 00:00 2024-01-20T11:02:36.080 INFO:teuthology.orchestra.run.smithi162.stdout:(99/155): python3-devel-3.9.17-2.el9.x86_64.rpm 799 kB/s | 245 kB 00:00 2024-01-20T11:02:36.497 INFO:teuthology.orchestra.run.smithi162.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 63 kB/s | 26 kB 00:00 2024-01-20T11:02:36.530 INFO:teuthology.orchestra.run.smithi162.stdout:(101/155): gperftools-libs-2.9.1-2.el9.x86_64.r 441 kB/s | 309 kB 00:00 2024-01-20T11:02:36.647 INFO:teuthology.orchestra.run.smithi162.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 581 kB/s | 67 kB 00:00 2024-01-20T11:02:36.672 INFO:teuthology.orchestra.run.smithi162.stdout:(103/155): liboath-2.6.7-2.el9.x86_64.rpm 278 kB/s | 49 kB 00:00 2024-01-20T11:02:36.781 INFO:teuthology.orchestra.run.smithi162.stdout:(104/155): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-01-20T11:02:36.956 INFO:teuthology.orchestra.run.smithi162.stdout:(105/155): libarrow-9.0.0-10.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-01-20T11:02:37.023 INFO:teuthology.orchestra.run.smithi162.stdout:(106/155): python3-asyncssh-2.13.2-3.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-01-20T11:02:37.065 INFO:teuthology.orchestra.run.smithi162.stdout:(107/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.1 MB/s | 838 kB 00:00 2024-01-20T11:02:37.090 INFO:teuthology.orchestra.run.smithi162.stdout:(108/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 327 kB/s | 43 kB 00:00 2024-01-20T11:02:37.132 INFO:teuthology.orchestra.run.smithi162.stdout:(109/155): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-01-20T11:02:37.165 INFO:teuthology.orchestra.run.smithi162.stdout:(110/155): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-01-20T11:02:37.199 INFO:teuthology.orchestra.run.smithi162.stdout:(111/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-01-20T11:02:37.258 INFO:teuthology.orchestra.run.smithi162.stdout:(112/155): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-01-20T11:02:37.291 INFO:teuthology.orchestra.run.smithi162.stdout:(113/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-01-20T11:02:37.325 INFO:teuthology.orchestra.run.smithi162.stdout:(114/155): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2024-01-20T11:02:37.392 INFO:teuthology.orchestra.run.smithi162.stdout:(115/155): python3-google-auth-2.26.0-1.el9.noa 1.5 MB/s | 202 kB 00:00 2024-01-20T11:02:37.420 INFO:teuthology.orchestra.run.smithi162.stdout:(116/155): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-01-20T11:02:37.442 INFO:teuthology.orchestra.run.smithi162.stdout:(117/155): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-01-20T11:02:37.493 INFO:teuthology.orchestra.run.smithi162.stdout:(118/155): python3-jaraco-collections-3.0.0-8.e 232 kB/s | 23 kB 00:00 2024-01-20T11:02:37.518 INFO:teuthology.orchestra.run.smithi162.stdout:(119/155): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-01-20T11:02:37.543 INFO:teuthology.orchestra.run.smithi162.stdout:(120/155): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-01-20T11:02:37.619 INFO:teuthology.orchestra.run.smithi162.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 466 kB/s | 46 kB 00:00 2024-01-20T11:02:37.644 INFO:teuthology.orchestra.run.smithi162.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 791 kB/s | 79 kB 00:00 2024-01-20T11:02:37.702 INFO:teuthology.orchestra.run.smithi162.stdout:(123/155): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-01-20T11:02:37.728 INFO:teuthology.orchestra.run.smithi162.stdout:(124/155): python3-natsort-7.1.1-5.el9.noarch.r 534 kB/s | 58 kB 00:00 2024-01-20T11:02:37.761 INFO:teuthology.orchestra.run.smithi162.stdout:(125/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-01-20T11:02:37.803 INFO:teuthology.orchestra.run.smithi162.stdout:(126/155): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-01-20T11:02:37.828 INFO:teuthology.orchestra.run.smithi162.stdout:(127/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 902 kB/s | 90 kB 00:00 2024-01-20T11:02:37.887 INFO:teuthology.orchestra.run.smithi162.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 226 kB/s | 28 kB 00:00 2024-01-20T11:02:37.912 INFO:teuthology.orchestra.run.smithi162.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2024-01-20T11:02:37.946 INFO:teuthology.orchestra.run.smithi162.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-01-20T11:02:37.988 INFO:teuthology.orchestra.run.smithi162.stdout:(131/155): python3-rsa-4.9-2.el9.noarch.rpm 593 kB/s | 59 kB 00:00 2024-01-20T11:02:38.013 INFO:teuthology.orchestra.run.smithi162.stdout:(132/155): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2024-01-20T11:02:38.047 INFO:teuthology.orchestra.run.smithi162.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 510 kB/s | 51 kB 00:00 2024-01-20T11:02:38.105 INFO:teuthology.orchestra.run.smithi162.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-01-20T11:02:38.130 INFO:teuthology.orchestra.run.smithi162.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 769 kB/s | 90 kB 00:00 2024-01-20T11:02:38.164 INFO:teuthology.orchestra.run.smithi162.stdout:(136/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-01-20T11:02:38.206 INFO:teuthology.orchestra.run.smithi162.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2024-01-20T11:02:38.239 INFO:teuthology.orchestra.run.smithi162.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-01-20T11:02:38.348 INFO:teuthology.orchestra.run.smithi162.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-01-20T11:02:38.390 INFO:teuthology.orchestra.run.smithi162.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-01-20T11:02:38.490 INFO:teuthology.orchestra.run.smithi162.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 23 MB/s | 2.2 MB 00:00 2024-01-20T11:02:38.574 INFO:teuthology.orchestra.run.smithi162.stdout:(142/155): NetworkManager-libnm-1.45.10-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-01-20T11:02:38.607 INFO:teuthology.orchestra.run.smithi162.stdout:(143/155): NetworkManager-team-1.45.10-1.el9.x8 1.3 MB/s | 42 kB 00:00 2024-01-20T11:02:38.650 INFO:teuthology.orchestra.run.smithi162.stdout:(144/155): NetworkManager-tui-1.45.10-1.el9.x86 5.9 MB/s | 246 kB 00:00 2024-01-20T11:02:38.725 INFO:teuthology.orchestra.run.smithi162.stdout:(145/155): librbd1-19.0.0-763.ga00c9940.el9.x86 6.5 MB/s | 3.1 MB 00:00 2024-01-20T11:02:38.750 INFO:teuthology.orchestra.run.smithi162.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 692 kB/s | 69 kB 00:00 2024-01-20T11:02:38.775 INFO:teuthology.orchestra.run.smithi162.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 723 kB/s | 35 kB 00:00 2024-01-20T11:02:38.833 INFO:teuthology.orchestra.run.smithi162.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 191 kB 00:00 2024-01-20T11:02:38.868 INFO:teuthology.orchestra.run.smithi162.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 2.8 MB/s | 254 kB 00:00 2024-01-20T11:02:38.885 INFO:teuthology.orchestra.run.smithi162.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 459 kB/s | 22 kB 00:00 2024-01-20T11:02:38.954 INFO:teuthology.orchestra.run.smithi162.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-01-20T11:02:39.087 INFO:teuthology.orchestra.run.smithi162.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 11 MB/s | 2.1 MB 00:00 2024-01-20T11:02:39.121 INFO:teuthology.orchestra.run.smithi162.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 2.0 MB/s | 321 kB 00:00 2024-01-20T11:02:39.196 INFO:teuthology.orchestra.run.smithi162.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 10 MB/s | 1.1 MB 00:00 2024-01-20T11:02:39.638 INFO:teuthology.orchestra.run.smithi162.stdout:(155/155): librados2-19.0.0-763.ga00c9940.el9.x 2.3 MB/s | 3.4 MB 00:01 2024-01-20T11:02:39.652 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-01-20T11:02:39.653 INFO:teuthology.orchestra.run.smithi162.stdout:Total 15 MB/s | 209 MB 00:13 2024-01-20T11:02:39.748 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-01-20T11:02:40.096 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-01-20T11:02:40.096 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-01-20T11:02:42.364 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-01-20T11:02:42.364 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-01-20T11:02:49.227 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-01-20T11:02:49.336 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-20T11:02:49.410 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-20T11:02:49.504 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-20T11:02:49.579 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-20T11:02:49.612 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-20T11:02:49.715 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-20T11:02:50.158 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-20T11:02:50.202 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T11:02:50.360 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T11:02:50.394 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T11:02:50.523 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T11:02:50.569 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T11:02:50.718 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-20T11:02:50.827 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-20T11:02:51.119 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-20T11:02:51.176 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-20T11:02:51.201 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T11:02:51.351 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T11:02:51.394 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T11:02:51.511 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T11:02:51.824 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-20T11:02:51.988 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T11:02:52.078 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T11:02:52.290 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T11:02:52.335 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T11:02:52.841 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T11:02:52.874 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-20T11:02:52.957 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-20T11:02:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-20T11:02:53.061 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-20T11:02:53.117 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-20T11:02:53.170 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-20T11:02:53.275 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-20T11:02:53.321 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-20T11:02:53.367 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-20T11:02:53.435 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-20T11:02:53.562 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-20T11:02:53.603 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 31/171 2024-01-20T11:02:53.659 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 32/171 2024-01-20T11:02:53.693 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 33/171 2024-01-20T11:02:53.811 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-20T11:02:53.912 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-20T11:02:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-20T11:02:54.155 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-20T11:02:54.842 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-20T11:02:54.943 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-20T11:02:54.991 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-20T11:02:55.053 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-20T11:02:55.093 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 42/171 2024-01-20T11:02:55.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-20T11:02:55.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-20T11:02:55.665 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-20T11:02:55.831 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-20T11:02:55.876 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-20T11:02:55.946 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-20T11:02:56.045 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-20T11:02:56.085 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-20T11:02:56.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-20T11:02:56.193 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-20T11:02:56.232 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-20T11:02:56.293 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-20T11:02:56.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-20T11:02:56.553 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-20T11:02:56.621 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-20T11:02:56.659 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-20T11:02:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-20T11:02:56.838 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-20T11:02:56.883 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.26.0-1.el9.noarch 61/171 2024-01-20T11:02:56.932 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-20T11:02:56.972 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-20T11:02:57.119 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-20T11:02:57.177 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-20T11:02:57.244 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-20T11:02:57.326 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-20T11:02:57.594 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-20T11:02:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-20T11:02:57.883 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-20T11:02:57.929 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-20T11:02:57.971 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-20T11:02:58.022 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-20T11:02:58.068 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-20T11:02:58.113 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-20T11:02:58.156 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-20T11:02:58.236 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-20T11:02:58.313 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-20T11:02:58.369 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-20T11:02:58.413 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T11:02:58.540 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-20T11:02:58.583 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-20T11:02:58.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-20T11:02:58.684 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-20T11:02:58.732 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-20T11:02:58.876 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-20T11:02:58.930 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-20T11:02:59.071 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-20T11:02:59.144 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-20T11:03:00.137 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-20T11:03:00.192 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-20T11:03:00.226 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-20T11:03:00.283 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-20T11:03:00.394 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-20T11:03:00.435 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-20T11:03:00.674 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-20T11:03:00.716 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-20T11:03:00.815 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-20T11:03:01.619 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-20T11:03:01.760 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-20T11:03:03.298 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-20T11:03:03.388 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-20T11:03:03.424 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-20T11:03:03.459 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-20T11:03:03.832 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-20T11:03:03.868 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T11:03:04.013 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T11:03:04.049 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 107/171 2024-01-20T11:03:04.106 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-20T11:03:04.591 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-20T11:03:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T11:03:05.276 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T11:03:05.315 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 111/171 2024-01-20T11:03:07.854 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T11:03:07.894 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T11:03:08.516 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T11:03:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T11:03:08.732 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T11:03:08.733 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-20T11:03:08.733 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-20T11:03:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:08.776 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T11:03:21.622 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T11:03:21.622 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-01-20T11:03:21.623 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-01-20T11:03:21.623 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-01-20T11:03:21.623 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-01-20T11:03:21.623 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-01-20T11:03:21.623 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-01-20T11:03:21.623 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-01-20T11:03:21.623 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:21.856 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T11:03:21.904 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T11:03:21.904 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:21.905 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-20T11:03:21.905 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:23.552 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T11:03:23.643 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T11:03:23.643 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:23.643 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-20T11:03:23.643 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T11:03:23.643 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T11:03:23.643 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:23.868 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T11:03:23.939 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T11:03:23.939 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:23.939 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-20T11:03:23.939 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T11:03:23.939 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T11:03:23.939 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:24.428 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T11:03:24.496 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T11:03:24.496 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:24.496 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-20T11:03:24.496 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T11:03:24.496 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T11:03:24.496 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:24.613 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-20T11:03:25.219 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T11:03:25.277 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T11:03:25.327 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 121/171 2024-01-20T11:03:25.425 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 122/171 2024-01-20T11:03:25.451 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T11:03:25.771 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T11:03:25.811 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T11:03:26.964 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T11:03:27.002 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T11:03:27.146 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T11:03:27.336 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 126/171 2024-01-20T11:03:27.363 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T11:03:27.431 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T11:03:27.431 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:27.431 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-20T11:03:27.431 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T11:03:27.432 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T11:03:27.432 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:27.497 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T11:03:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T11:03:27.597 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 129/171 2024-01-20T11:03:28.461 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-20T11:03:28.500 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T11:03:28.566 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T11:03:28.567 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:28.567 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-20T11:03:28.567 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T11:03:28.567 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T11:03:28.567 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:28.649 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T11:03:28.730 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T11:03:28.730 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:28.730 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-20T11:03:28.730 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:28.810 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T11:03:28.888 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T11:03:28.889 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:28.889 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-20T11:03:28.889 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T11:03:28.889 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T11:03:28.889 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T11:03:29.310 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T11:03:29.311 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:03:29.311 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-20T11:03:29.311 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T11:03:29.311 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T11:03:29.311 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:34.017 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 135/171 2024-01-20T11:03:34.084 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 136/171 2024-01-20T11:03:34.149 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 137/171 2024-01-20T11:03:34.183 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-20T11:03:34.222 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-20T11:03:34.513 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T11:03:34.651 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-20T11:03:34.688 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T11:03:34.721 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 143/171 2024-01-20T11:03:34.760 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-20T11:03:34.807 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-20T11:03:34.944 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T11:03:35.014 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-20T11:03:35.057 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-20T11:03:35.996 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T11:03:36.038 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T11:03:36.132 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T11:03:36.223 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-20T11:03:37.587 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 151/171 2024-01-20T11:03:37.670 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-20T11:03:37.722 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-20T11:03:37.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-20T11:03:37.923 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-20T11:03:37.965 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-20T11:03:37.999 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T11:03:38.041 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-20T11:03:38.042 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T11:03:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T11:03:38.242 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-20T11:03:38.296 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-20T11:03:38.338 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-20T11:03:38.370 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-20T11:03:38.370 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T11:03:38.508 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T11:03:38.547 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-20T11:03:38.584 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T11:03:38.584 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T11:03:38.920 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T11:03:38.921 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T11:03:39.063 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T11:03:39.100 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-20T11:03:39.139 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-20T11:03:39.209 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-20T11:03:39.330 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T11:03:39.592 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T11:03:39.592 INFO:teuthology.orchestra.run.smithi162.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-20T11:03:39.593 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:44.428 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 1/171 2024-01-20T11:03:44.428 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2/171 2024-01-20T11:03:44.428 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 3/171 2024-01-20T11:03:44.428 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 4/171 2024-01-20T11:03:44.428 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 5/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 6/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 7/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 11/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 12/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 13/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 14/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 15/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 16/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 17/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 18/171 2024-01-20T11:03:44.431 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 19/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 20/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 21/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 22/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 23/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 24/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 25/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 26/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 27/171 2024-01-20T11:03:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 28/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 29/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 30/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 31/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 32/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 33/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 34/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 35/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 36/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 37/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 38/171 2024-01-20T11:03:44.445 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 39/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-20T11:03:44.446 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-20T11:03:44.447 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-20T11:03:44.448 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-20T11:03:44.449 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-20T11:03:44.450 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.26.0-1.el9.noarch 115/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-20T11:03:44.451 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-20T11:03:44.452 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-20T11:03:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-20T11:03:44.454 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-20T11:03:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-20T11:03:44.455 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-20T11:03:46.788 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-20T11:03:46.788 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:46.788 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: acl-2.3.1-4.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.789 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.790 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.791 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-20T11:03:46.792 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: jq-1.6-16.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-20T11:03:46.793 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-01-20T11:03:46.794 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.11-1.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-20T11:03:46.795 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-20T11:03:46.796 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.26.0-1.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-20T11:03:46.797 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-20T11:03:46.798 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-20T11:03:46.799 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-20T11:03:46.800 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-3.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-20T11:03:46.801 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-20T11:03:46.802 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:03:46.802 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-01-20T11:03:47.457 DEBUG:teuthology.parallel:result is None 2024-01-20T11:05:06.125 INFO:teuthology.orchestra.run.smithi179.stdout:(1/155): ceph-19.0.0-763.ga00c9940.el9.x86_64.r 26 kB/s | 6.6 kB 00:00 2024-01-20T11:05:06.658 INFO:teuthology.orchestra.run.smithi179.stdout:(2/155): ceph-fuse-19.0.0-763.ga00c9940.el9.x86 1.6 MB/s | 886 kB 00:00 2024-01-20T11:05:06.766 INFO:teuthology.orchestra.run.smithi179.stdout:(3/155): ceph-immutable-object-cache-19.0.0-763 1.3 MB/s | 145 kB 00:00 2024-01-20T11:05:07.225 INFO:teuthology.orchestra.run.smithi179.stdout:(4/155): ceph-mds-19.0.0-763.ga00c9940.el9.x86_ 4.6 MB/s | 2.1 MB 00:00 2024-01-20T11:05:07.467 INFO:teuthology.orchestra.run.smithi179.stdout:(5/155): ceph-mgr-19.0.0-763.ga00c9940.el9.x86_ 6.2 MB/s | 1.5 MB 00:00 2024-01-20T11:05:08.042 INFO:teuthology.orchestra.run.smithi179.stdout:(6/155): ceph-base-19.0.0-763.ga00c9940.el9.x86 2.4 MB/s | 5.1 MB 00:02 2024-01-20T11:05:08.151 INFO:teuthology.orchestra.run.smithi179.stdout:(7/155): ceph-mon-19.0.0-763.ga00c9940.el9.x86_ 6.9 MB/s | 4.7 MB 00:00 2024-01-20T11:05:08.417 INFO:teuthology.orchestra.run.smithi179.stdout:(8/155): ceph-common-19.0.0-763.ga00c9940.el9.x 7.6 MB/s | 19 MB 00:02 2024-01-20T11:05:08.476 INFO:teuthology.orchestra.run.smithi179.stdout:(9/155): ceph-selinux-19.0.0-763.ga00c9940.el9. 436 kB/s | 25 kB 00:00 2024-01-20T11:05:08.934 INFO:teuthology.orchestra.run.smithi179.stdout:(10/155): ceph-radosgw-19.0.0-763.ga00c9940.el9 11 MB/s | 8.6 MB 00:00 2024-01-20T11:05:09.027 INFO:teuthology.orchestra.run.smithi179.stdout:(11/155): cephfs-mirror-19.0.0-763.ga00c9940.el 2.3 MB/s | 217 kB 00:00 2024-01-20T11:05:09.120 INFO:teuthology.orchestra.run.smithi179.stdout:(12/155): cephfs-shell-19.0.0-763.ga00c9940.el9 292 kB/s | 27 kB 00:00 2024-01-20T11:05:09.202 INFO:teuthology.orchestra.run.smithi179.stdout:(13/155): libcephfs-devel-19.0.0-763.ga00c9940. 385 kB/s | 31 kB 00:00 2024-01-20T11:05:09.319 INFO:teuthology.orchestra.run.smithi179.stdout:(14/155): libcephfs2-19.0.0-763.ga00c9940.el9.x 6.3 MB/s | 742 kB 00:00 2024-01-20T11:05:09.403 INFO:teuthology.orchestra.run.smithi179.stdout:(15/155): libcephsqlite-19.0.0-763.ga00c9940.el 1.9 MB/s | 163 kB 00:00 2024-01-20T11:05:09.478 INFO:teuthology.orchestra.run.smithi179.stdout:(16/155): librados-devel-19.0.0-763.ga00c9940.e 1.7 MB/s | 127 kB 00:00 2024-01-20T11:05:09.570 INFO:teuthology.orchestra.run.smithi179.stdout:(17/155): libradosstriper1-19.0.0-763.ga00c9940 5.4 MB/s | 499 kB 00:00 2024-01-20T11:05:10.112 INFO:teuthology.orchestra.run.smithi179.stdout:(18/155): librgw2-19.0.0-763.ga00c9940.el9.x86_ 8.9 MB/s | 4.8 MB 00:00 2024-01-20T11:05:10.195 INFO:teuthology.orchestra.run.smithi179.stdout:(19/155): python3-ceph-argparse-19.0.0-763.ga00 550 kB/s | 45 kB 00:00 2024-01-20T11:05:10.288 INFO:teuthology.orchestra.run.smithi179.stdout:(20/155): python3-ceph-common-19.0.0-763.ga00c9 1.4 MB/s | 130 kB 00:00 2024-01-20T11:05:10.371 INFO:teuthology.orchestra.run.smithi179.stdout:(21/155): python3-cephfs-19.0.0-763.ga00c9940.e 1.9 MB/s | 162 kB 00:00 2024-01-20T11:05:10.463 INFO:teuthology.orchestra.run.smithi179.stdout:(22/155): python3-rados-19.0.0-763.ga00c9940.el 3.4 MB/s | 320 kB 00:00 2024-01-20T11:05:10.555 INFO:teuthology.orchestra.run.smithi179.stdout:(23/155): python3-rbd-19.0.0-763.ga00c9940.el9. 3.2 MB/s | 297 kB 00:00 2024-01-20T11:05:10.789 INFO:teuthology.orchestra.run.smithi179.stdout:(24/155): ceph-osd-19.0.0-763.ga00c9940.el9.x86 6.1 MB/s | 17 MB 00:02 2024-01-20T11:05:10.814 INFO:teuthology.orchestra.run.smithi179.stdout:(25/155): python3-rgw-19.0.0-763.ga00c9940.el9. 386 kB/s | 99 kB 00:00 2024-01-20T11:05:10.856 INFO:teuthology.orchestra.run.smithi179.stdout:(26/155): rbd-fuse-19.0.0-763.ga00c9940.el9.x86 1.3 MB/s | 85 kB 00:00 2024-01-20T11:05:10.948 INFO:teuthology.orchestra.run.smithi179.stdout:(27/155): rbd-nbd-19.0.0-763.ga00c9940.el9.x86_ 1.8 MB/s | 170 kB 00:00 2024-01-20T11:05:11.048 INFO:teuthology.orchestra.run.smithi179.stdout:(28/155): ceph-grafana-dashboards-19.0.0-763.ga 286 kB/s | 28 kB 00:00 2024-01-20T11:05:11.172 INFO:teuthology.orchestra.run.smithi179.stdout:(29/155): rbd-mirror-19.0.0-763.ga00c9940.el9.x 8.7 MB/s | 3.1 MB 00:00 2024-01-20T11:05:11.207 INFO:teuthology.orchestra.run.smithi179.stdout:(30/155): ceph-mgr-cephadm-19.0.0-763.ga00c9940 842 kB/s | 133 kB 00:00 2024-01-20T11:05:11.799 INFO:teuthology.orchestra.run.smithi179.stdout:(31/155): ceph-test-19.0.0-763.ga00c9940.el9.x8 14 MB/s | 46 MB 00:03 2024-01-20T11:05:11.857 INFO:teuthology.orchestra.run.smithi179.stdout:(32/155): ceph-mgr-dashboard-19.0.0-763.ga00c99 2.5 MB/s | 1.7 MB 00:00 2024-01-20T11:05:11.891 INFO:teuthology.orchestra.run.smithi179.stdout:(33/155): ceph-mgr-modules-core-19.0.0-763.ga00 2.6 MB/s | 245 kB 00:00 2024-01-20T11:05:11.916 INFO:teuthology.orchestra.run.smithi179.stdout:(34/155): ceph-mgr-rook-19.0.0-763.ga00c9940.el 882 kB/s | 51 kB 00:00 2024-01-20T11:05:11.941 INFO:teuthology.orchestra.run.smithi179.stdout:(35/155): ceph-prometheus-alerts-19.0.0-763.ga0 304 kB/s | 15 kB 00:00 2024-01-20T11:05:11.992 INFO:teuthology.orchestra.run.smithi179.stdout:(36/155): ceph-volume-19.0.0-763.ga00c9940.el9. 3.4 MB/s | 262 kB 00:00 2024-01-20T11:05:12.042 INFO:teuthology.orchestra.run.smithi179.stdout:(37/155): cephadm-19.0.0-763.ga00c9940.el9.noar 7.3 MB/s | 742 kB 00:00 2024-01-20T11:05:12.067 INFO:teuthology.orchestra.run.smithi179.stdout:(38/155): cephfs-top-19.0.0-763.ga00c9940.el9.n 245 kB/s | 18 kB 00:00 2024-01-20T11:05:12.326 INFO:teuthology.orchestra.run.smithi179.stdout:(39/155): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-01-20T11:05:12.376 INFO:teuthology.orchestra.run.smithi179.stdout:(40/155): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 662 kB 00:00 2024-01-20T11:05:12.401 INFO:teuthology.orchestra.run.smithi179.stdout:(41/155): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2024-01-20T11:05:12.452 INFO:teuthology.orchestra.run.smithi179.stdout:(42/155): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 920 kB 00:00 2024-01-20T11:05:12.477 INFO:teuthology.orchestra.run.smithi179.stdout:(43/155): elfutils-libelf-devel-0.190-2.el9.x86 213 kB/s | 20 kB 00:00 2024-01-20T11:05:12.510 INFO:teuthology.orchestra.run.smithi179.stdout:(44/155): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 307 kB 00:00 2024-01-20T11:05:12.544 INFO:teuthology.orchestra.run.smithi179.stdout:(45/155): flexiblas-3.0.4-8.el9.x86_64.rpm 498 kB/s | 32 kB 00:00 2024-01-20T11:05:12.636 INFO:teuthology.orchestra.run.smithi179.stdout:(46/155): flexiblas-openblas-openmp-3.0.4-8.el9 142 kB/s | 17 kB 00:00 2024-01-20T11:05:12.720 INFO:teuthology.orchestra.run.smithi179.stdout:(47/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-01-20T11:05:12.745 INFO:teuthology.orchestra.run.smithi179.stdout:(48/155): libaio-devel-0.3.111-13.el9.x86_64.rp 53 kB/s | 10 kB 00:00 2024-01-20T11:05:12.770 INFO:teuthology.orchestra.run.smithi179.stdout:(49/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2024-01-20T11:05:12.804 INFO:teuthology.orchestra.run.smithi179.stdout:(50/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 784 kB/s | 44 kB 00:00 2024-01-20T11:05:12.846 INFO:teuthology.orchestra.run.smithi179.stdout:(51/155): librdkafka-1.6.1-102.el9.x86_64.rpm 6.6 MB/s | 661 kB 00:00 2024-01-20T11:05:12.887 INFO:teuthology.orchestra.run.smithi179.stdout:(52/155): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 578 kB 00:00 2024-01-20T11:05:12.913 INFO:teuthology.orchestra.run.smithi179.stdout:(53/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 238 kB/s | 24 kB 00:00 2024-01-20T11:05:12.938 INFO:teuthology.orchestra.run.smithi179.stdout:(54/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 941 kB/s | 46 kB 00:00 2024-01-20T11:05:12.963 INFO:teuthology.orchestra.run.smithi179.stdout:(55/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-01-20T11:05:12.997 INFO:teuthology.orchestra.run.smithi179.stdout:(56/155): lua-5.4.4-4.el9.x86_64.rpm 2.3 MB/s | 187 kB 00:00 2024-01-20T11:05:13.031 INFO:teuthology.orchestra.run.smithi179.stdout:(57/155): openblas-0.3.21-2.el9.x86_64.rpm 531 kB/s | 34 kB 00:00 2024-01-20T11:05:13.256 INFO:teuthology.orchestra.run.smithi179.stdout:(58/155): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-01-20T11:05:13.365 INFO:teuthology.orchestra.run.smithi179.stdout:(59/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2024-01-20T11:05:13.415 INFO:teuthology.orchestra.run.smithi179.stdout:(60/155): postgresql-13.11-1.el9.x86_64.rpm 4.1 MB/s | 1.5 MB 00:00 2024-01-20T11:05:13.448 INFO:teuthology.orchestra.run.smithi179.stdout:(61/155): postgresql-contrib-13.11-1.el9.x86_64 4.4 MB/s | 811 kB 00:00 2024-01-20T11:05:13.473 INFO:teuthology.orchestra.run.smithi179.stdout:(62/155): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-01-20T11:05:13.507 INFO:teuthology.orchestra.run.smithi179.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-01-20T11:05:13.657 INFO:teuthology.orchestra.run.smithi179.stdout:(64/155): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2024-01-20T11:05:13.791 INFO:teuthology.orchestra.run.smithi179.stdout:(65/155): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-01-20T11:05:13.816 INFO:teuthology.orchestra.run.smithi179.stdout:(66/155): python3-jinja2-2.11.3-4.el9.noarch.rp 777 kB/s | 228 kB 00:00 2024-01-20T11:05:13.833 INFO:teuthology.orchestra.run.smithi179.stdout:(67/155): python3-jsonpatch-1.21-16.el9.noarch. 151 kB/s | 24 kB 00:00 2024-01-20T11:05:13.858 INFO:teuthology.orchestra.run.smithi179.stdout:(68/155): python3-jsonpointer-2.0-4.el9.noarch. 766 kB/s | 18 kB 00:00 2024-01-20T11:05:13.875 INFO:teuthology.orchestra.run.smithi179.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 787 kB/s | 32 kB 00:00 2024-01-20T11:05:13.917 INFO:teuthology.orchestra.run.smithi179.stdout:(70/155): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2024-01-20T11:05:14.034 INFO:teuthology.orchestra.run.smithi179.stdout:(71/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2024-01-20T11:05:14.059 INFO:teuthology.orchestra.run.smithi179.stdout:(72/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-01-20T11:05:14.084 INFO:teuthology.orchestra.run.smithi179.stdout:(73/155): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-01-20T11:05:14.126 INFO:teuthology.orchestra.run.smithi179.stdout:(74/155): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-01-20T11:05:14.152 INFO:teuthology.orchestra.run.smithi179.stdout:(75/155): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-01-20T11:05:14.177 INFO:teuthology.orchestra.run.smithi179.stdout:(76/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2024-01-20T11:05:14.202 INFO:teuthology.orchestra.run.smithi179.stdout:(77/155): python3-pytz-2021.1-5.el9.noarch.rpm 642 kB/s | 47 kB 00:00 2024-01-20T11:05:14.259 INFO:teuthology.orchestra.run.smithi179.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 408 kB/s | 43 kB 00:00 2024-01-20T11:05:14.286 INFO:teuthology.orchestra.run.smithi179.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 471 kB/s | 39 kB 00:00 2024-01-20T11:05:14.511 INFO:teuthology.orchestra.run.smithi179.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 163 kB/s | 41 kB 00:00 2024-01-20T11:05:14.720 INFO:teuthology.orchestra.run.smithi179.stdout:(81/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-01-20T11:05:14.744 INFO:teuthology.orchestra.run.smithi179.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 674 kB/s | 300 kB 00:00 2024-01-20T11:05:14.770 INFO:teuthology.orchestra.run.smithi179.stdout:(83/155): uuid-1.6.2-55.el9.x86_64.rpm 219 kB/s | 56 kB 00:00 2024-01-20T11:05:14.787 INFO:teuthology.orchestra.run.smithi179.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.1 MB/s | 87 kB 00:00 2024-01-20T11:05:14.812 INFO:teuthology.orchestra.run.smithi179.stdout:(85/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 964 kB/s | 63 kB 00:00 2024-01-20T11:05:14.837 INFO:teuthology.orchestra.run.smithi179.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 677 kB/s | 44 kB 00:00 2024-01-20T11:05:14.862 INFO:teuthology.orchestra.run.smithi179.stdout:(87/155): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-01-20T11:05:14.888 INFO:teuthology.orchestra.run.smithi179.stdout:(88/155): jq-1.6-16.el9.x86_64.rpm 2.5 MB/s | 186 kB 00:00 2024-01-20T11:05:14.938 INFO:teuthology.orchestra.run.smithi179.stdout:(89/155): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 802 kB 00:00 2024-01-20T11:05:14.972 INFO:teuthology.orchestra.run.smithi179.stdout:(90/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-01-20T11:05:15.005 INFO:teuthology.orchestra.run.smithi179.stdout:(91/155): libquadmath-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 194 kB 00:00 2024-01-20T11:05:15.031 INFO:teuthology.orchestra.run.smithi179.stdout:(92/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-01-20T11:05:15.089 INFO:teuthology.orchestra.run.smithi179.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2024-01-20T11:05:15.114 INFO:teuthology.orchestra.run.smithi179.stdout:(94/155): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-01-20T11:05:15.139 INFO:teuthology.orchestra.run.smithi179.stdout:(95/155): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2024-01-20T11:05:15.165 INFO:teuthology.orchestra.run.smithi179.stdout:(96/155): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2024-01-20T11:05:15.199 INFO:teuthology.orchestra.run.smithi179.stdout:(97/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-01-20T11:05:15.332 INFO:teuthology.orchestra.run.smithi179.stdout:(98/155): lua-devel-5.4.4-4.el9.x86_64.rpm 136 kB/s | 22 kB 00:00 2024-01-20T11:05:15.399 INFO:teuthology.orchestra.run.smithi179.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.5 MB/s | 309 kB 00:00 2024-01-20T11:05:15.449 INFO:teuthology.orchestra.run.smithi179.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 526 kB/s | 26 kB 00:00 2024-01-20T11:05:15.500 INFO:teuthology.orchestra.run.smithi179.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 984 kB/s | 49 kB 00:00 2024-01-20T11:05:15.550 INFO:teuthology.orchestra.run.smithi179.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-01-20T11:05:15.617 INFO:teuthology.orchestra.run.smithi179.stdout:(103/155): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-01-20T11:05:15.734 INFO:teuthology.orchestra.run.smithi179.stdout:(104/155): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-01-20T11:05:15.767 INFO:teuthology.orchestra.run.smithi179.stdout:(105/155): python3-devel-3.9.17-2.el9.x86_64.rp 392 kB/s | 245 kB 00:00 2024-01-20T11:05:15.818 INFO:teuthology.orchestra.run.smithi179.stdout:(106/155): python3-asyncssh-2.13.2-3.el9.noarch 6.5 MB/s | 548 kB 00:00 2024-01-20T11:05:15.860 INFO:teuthology.orchestra.run.smithi179.stdout:(107/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2024-01-20T11:05:15.885 INFO:teuthology.orchestra.run.smithi179.stdout:(108/155): python3-cachetools-4.2.4-1.el9.noarc 487 kB/s | 32 kB 00:00 2024-01-20T11:05:15.910 INFO:teuthology.orchestra.run.smithi179.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 304 kB/s | 15 kB 00:00 2024-01-20T11:05:15.935 INFO:teuthology.orchestra.run.smithi179.stdout:(110/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 260 kB/s | 43 kB 00:00 2024-01-20T11:05:15.969 INFO:teuthology.orchestra.run.smithi179.stdout:(111/155): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-01-20T11:05:16.002 INFO:teuthology.orchestra.run.smithi179.stdout:(112/155): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-01-20T11:05:16.019 INFO:teuthology.orchestra.run.smithi179.stdout:(113/155): python3-colorama-0.4.4-12.el9.noarch 712 kB/s | 35 kB 00:00 2024-01-20T11:05:16.061 INFO:teuthology.orchestra.run.smithi179.stdout:(114/155): python3-google-auth-2.26.0-1.el9.noa 3.4 MB/s | 202 kB 00:00 2024-01-20T11:05:16.087 INFO:teuthology.orchestra.run.smithi179.stdout:(115/155): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2024-01-20T11:05:16.112 INFO:teuthology.orchestra.run.smithi179.stdout:(116/155): python3-jaraco-classes-3.2.1-5.el9.n 357 kB/s | 18 kB 00:00 2024-01-20T11:05:16.137 INFO:teuthology.orchestra.run.smithi179.stdout:(117/155): python3-jaraco-collections-3.0.0-8.e 468 kB/s | 23 kB 00:00 2024-01-20T11:05:16.163 INFO:teuthology.orchestra.run.smithi179.stdout:(118/155): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2024-01-20T11:05:16.197 INFO:teuthology.orchestra.run.smithi179.stdout:(119/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-01-20T11:05:16.222 INFO:teuthology.orchestra.run.smithi179.stdout:(120/155): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2024-01-20T11:05:16.300 INFO:teuthology.orchestra.run.smithi179.stdout:(121/155): python3-kubernetes-26.1.0-2.el9.noar 7.5 MB/s | 1.0 MB 00:00 2024-01-20T11:05:16.330 INFO:teuthology.orchestra.run.smithi179.stdout:(122/155): python3-logutils-0.3.5-21.el9.noarch 430 kB/s | 46 kB 00:00 2024-01-20T11:05:16.356 INFO:teuthology.orchestra.run.smithi179.stdout:(123/155): python3-more-itertools-8.12.0-2.el9. 594 kB/s | 79 kB 00:00 2024-01-20T11:05:16.381 INFO:teuthology.orchestra.run.smithi179.stdout:(124/155): python3-natsort-7.1.1-5.el9.noarch.r 724 kB/s | 58 kB 00:00 2024-01-20T11:05:16.406 INFO:teuthology.orchestra.run.smithi179.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 331 kB/s | 16 kB 00:00 2024-01-20T11:05:16.440 INFO:teuthology.orchestra.run.smithi179.stdout:(126/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-01-20T11:05:16.465 INFO:teuthology.orchestra.run.smithi179.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 488 kB/s | 28 kB 00:00 2024-01-20T11:05:16.490 INFO:teuthology.orchestra.run.smithi179.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 623 kB/s | 31 kB 00:00 2024-01-20T11:05:16.516 INFO:teuthology.orchestra.run.smithi179.stdout:(129/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 673 kB/s | 90 kB 00:00 2024-01-20T11:05:16.541 INFO:teuthology.orchestra.run.smithi179.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-01-20T11:05:16.566 INFO:teuthology.orchestra.run.smithi179.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 726 kB/s | 36 kB 00:00 2024-01-20T11:05:16.591 INFO:teuthology.orchestra.run.smithi179.stdout:(132/155): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-01-20T11:05:16.617 INFO:teuthology.orchestra.run.smithi179.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 681 kB/s | 51 kB 00:00 2024-01-20T11:05:16.634 INFO:teuthology.orchestra.run.smithi179.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-01-20T11:05:16.667 INFO:teuthology.orchestra.run.smithi179.stdout:(135/155): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-01-20T11:05:16.692 INFO:teuthology.orchestra.run.smithi179.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 345 kB/s | 20 kB 00:00 2024-01-20T11:05:16.726 INFO:teuthology.orchestra.run.smithi179.stdout:(137/155): re2-20211101-3.el9.x86_64.rpm 3.3 MB/s | 192 kB 00:00 2024-01-20T11:05:16.760 INFO:teuthology.orchestra.run.smithi179.stdout:(138/155): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-01-20T11:05:16.826 INFO:teuthology.orchestra.run.smithi179.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-01-20T11:05:16.877 INFO:teuthology.orchestra.run.smithi179.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2024-01-20T11:05:16.985 INFO:teuthology.orchestra.run.smithi179.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 21 MB/s | 2.2 MB 00:00 2024-01-20T11:05:17.086 INFO:teuthology.orchestra.run.smithi179.stdout:(142/155): NetworkManager-libnm-1.45.10-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-01-20T11:05:17.119 INFO:teuthology.orchestra.run.smithi179.stdout:(143/155): NetworkManager-team-1.45.10-1.el9.x8 1.3 MB/s | 42 kB 00:00 2024-01-20T11:05:17.169 INFO:teuthology.orchestra.run.smithi179.stdout:(144/155): NetworkManager-tui-1.45.10-1.el9.x86 4.9 MB/s | 246 kB 00:00 2024-01-20T11:05:17.270 INFO:teuthology.orchestra.run.smithi179.stdout:(145/155): librados2-19.0.0-763.ga00c9940.el9.x 6.2 MB/s | 3.4 MB 00:00 2024-01-20T11:05:17.321 INFO:teuthology.orchestra.run.smithi179.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 457 kB/s | 69 kB 00:00 2024-01-20T11:05:17.345 INFO:teuthology.orchestra.run.smithi179.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 479 kB/s | 35 kB 00:00 2024-01-20T11:05:17.379 INFO:teuthology.orchestra.run.smithi179.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 3.3 MB/s | 191 kB 00:00 2024-01-20T11:05:17.421 INFO:teuthology.orchestra.run.smithi179.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 3.4 MB/s | 254 kB 00:00 2024-01-20T11:05:17.455 INFO:teuthology.orchestra.run.smithi179.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 301 kB/s | 22 kB 00:00 2024-01-20T11:05:17.505 INFO:teuthology.orchestra.run.smithi179.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-01-20T11:05:17.580 INFO:teuthology.orchestra.run.smithi179.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 19 MB/s | 2.1 MB 00:00 2024-01-20T11:05:17.614 INFO:teuthology.orchestra.run.smithi179.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 3.3 MB/s | 321 kB 00:00 2024-01-20T11:05:17.667 INFO:teuthology.orchestra.run.smithi179.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-20T11:05:17.756 INFO:teuthology.orchestra.run.smithi179.stdout:(155/155): librbd1-19.0.0-763.ga00c9940.el9.x86 3.1 MB/s | 3.1 MB 00:00 2024-01-20T11:05:17.764 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-01-20T11:05:17.765 INFO:teuthology.orchestra.run.smithi179.stdout:Total 1.2 MB/s | 209 MB 02:55 2024-01-20T11:05:17.856 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-01-20T11:05:18.203 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-01-20T11:05:18.203 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-01-20T11:05:20.402 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-01-20T11:05:20.402 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-01-20T11:05:26.800 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-01-20T11:05:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-20T11:05:26.986 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-20T11:05:27.158 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-20T11:05:27.218 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-20T11:05:27.247 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-20T11:05:27.341 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-20T11:05:27.756 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-20T11:05:27.795 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T11:05:27.944 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T11:05:27.971 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T11:05:28.072 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T11:05:28.107 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T11:05:28.242 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-20T11:05:28.353 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-20T11:05:28.625 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-20T11:05:28.686 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-20T11:05:28.711 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T11:05:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T11:05:28.888 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T11:05:28.954 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T11:05:29.261 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-20T11:05:29.451 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T11:05:29.538 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T11:05:29.753 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T11:05:29.820 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T11:05:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T11:05:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-20T11:05:30.444 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-20T11:05:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-20T11:05:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-20T11:05:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-20T11:05:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-20T11:05:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-20T11:05:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-20T11:05:30.902 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-20T11:05:30.933 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-20T11:05:31.049 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-20T11:05:31.086 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 31/171 2024-01-20T11:05:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 32/171 2024-01-20T11:05:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 33/171 2024-01-20T11:05:31.283 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-20T11:05:31.388 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-20T11:05:31.562 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-20T11:05:31.631 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-20T11:05:32.339 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-20T11:05:32.435 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-20T11:05:32.476 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-20T11:05:32.528 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-20T11:05:32.567 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 42/171 2024-01-20T11:05:32.724 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-20T11:05:33.183 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-20T11:05:33.231 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-20T11:05:33.383 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-20T11:05:33.426 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-20T11:05:33.496 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-20T11:05:33.585 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-20T11:05:33.626 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-20T11:05:33.665 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-20T11:05:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-20T11:05:33.781 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-20T11:05:33.869 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-20T11:05:33.938 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-20T11:05:34.138 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-20T11:05:34.188 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-20T11:05:34.225 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-20T11:05:34.274 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-20T11:05:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-20T11:05:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.26.0-1.el9.noarch 61/171 2024-01-20T11:05:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-20T11:05:34.549 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-20T11:05:34.706 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-20T11:05:34.754 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-20T11:05:34.832 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-20T11:05:34.921 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-20T11:05:35.188 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-20T11:05:35.249 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-20T11:05:35.429 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-20T11:05:35.479 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-20T11:05:35.520 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-20T11:05:35.568 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-20T11:05:35.615 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-20T11:05:35.659 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-20T11:05:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-20T11:05:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-20T11:05:35.834 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-20T11:05:35.916 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-20T11:05:35.964 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T11:05:36.100 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-20T11:05:36.147 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-20T11:05:36.182 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-20T11:05:36.248 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-20T11:05:36.293 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-20T11:05:36.436 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-20T11:05:36.482 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-20T11:05:36.621 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-20T11:05:36.688 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-20T11:05:37.627 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-20T11:05:37.679 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-20T11:05:37.716 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-20T11:05:37.771 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-20T11:05:37.883 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-20T11:05:37.942 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-20T11:05:38.198 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-20T11:05:38.239 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-20T11:05:38.356 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-20T11:05:39.189 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-20T11:05:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-20T11:05:40.827 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-20T11:05:40.910 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-20T11:05:40.947 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-20T11:05:41.006 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-20T11:05:41.367 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-20T11:05:41.399 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T11:05:41.518 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T11:05:41.546 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 107/171 2024-01-20T11:05:41.600 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-20T11:05:42.074 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-20T11:05:42.109 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T11:05:42.200 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T11:05:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 111/171 2024-01-20T11:05:44.781 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T11:05:44.825 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T11:05:45.435 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T11:05:45.487 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T11:05:45.641 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T11:05:45.641 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-20T11:05:45.642 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-20T11:05:45.642 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:05:45.696 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T11:05:58.452 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T11:05:58.452 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-01-20T11:05:58.452 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-01-20T11:05:58.452 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-01-20T11:05:58.452 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-01-20T11:05:58.453 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-01-20T11:05:58.453 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-01-20T11:05:58.453 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-01-20T11:05:58.453 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:05:58.667 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T11:05:58.715 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T11:05:58.715 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:05:58.715 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-20T11:05:58.715 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:00.346 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T11:06:00.421 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T11:06:00.422 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:00.422 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-20T11:06:00.422 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T11:06:00.422 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T11:06:00.422 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:00.645 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T11:06:00.715 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T11:06:00.715 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:00.715 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-20T11:06:00.715 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T11:06:00.715 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T11:06:00.715 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:01.196 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T11:06:01.265 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T11:06:01.266 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:01.266 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-20T11:06:01.266 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T11:06:01.266 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T11:06:01.266 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:01.373 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-20T11:06:01.953 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T11:06:01.992 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T11:06:02.037 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 121/171 2024-01-20T11:06:02.134 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 122/171 2024-01-20T11:06:02.162 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T11:06:02.480 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T11:06:02.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T11:06:03.627 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T11:06:03.655 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T11:06:03.796 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T11:06:03.967 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 126/171 2024-01-20T11:06:04.007 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T11:06:04.076 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T11:06:04.076 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:04.076 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-20T11:06:04.076 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T11:06:04.076 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T11:06:04.077 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:04.133 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T11:06:04.170 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T11:06:04.266 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 129/171 2024-01-20T11:06:05.171 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-20T11:06:05.201 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T11:06:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T11:06:05.288 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:05.288 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-20T11:06:05.288 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T11:06:05.288 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T11:06:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:05.344 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T11:06:05.415 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T11:06:05.415 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:05.415 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-20T11:06:05.415 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:05.478 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T11:06:05.564 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T11:06:05.564 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:05.564 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-20T11:06:05.564 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T11:06:05.564 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T11:06:05.564 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T11:06:06.006 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T11:06:06.006 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T11:06:06.007 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-20T11:06:06.007 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T11:06:06.007 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T11:06:06.007 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 135/171 2024-01-20T11:06:10.708 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 136/171 2024-01-20T11:06:10.764 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 137/171 2024-01-20T11:06:10.800 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-20T11:06:10.839 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-20T11:06:11.120 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T11:06:11.244 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-20T11:06:11.280 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T11:06:11.313 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 143/171 2024-01-20T11:06:11.344 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-20T11:06:11.390 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-20T11:06:11.519 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T11:06:11.581 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-20T11:06:11.623 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-20T11:06:12.541 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T11:06:12.588 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T11:06:12.679 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T11:06:12.756 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-20T11:06:14.100 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 151/171 2024-01-20T11:06:14.177 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-20T11:06:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-20T11:06:14.379 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-20T11:06:14.421 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-20T11:06:14.454 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-20T11:06:14.488 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T11:06:14.529 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-20T11:06:14.529 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T11:06:14.654 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T11:06:14.706 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-20T11:06:14.756 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-20T11:06:14.793 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-20T11:06:14.834 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-20T11:06:14.835 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T11:06:14.955 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T11:06:14.985 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-20T11:06:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T11:06:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T11:06:15.351 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T11:06:15.352 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T11:06:15.493 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T11:06:15.530 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-20T11:06:15.569 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-20T11:06:15.631 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-20T11:06:15.750 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T11:06:16.005 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T11:06:16.006 INFO:teuthology.orchestra.run.smithi179.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-20T11:06:16.006 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 1/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 3/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 4/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 5/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 6/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 7/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T11:06:20.848 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 11/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 12/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 13/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 14/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 15/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 16/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 17/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 18/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 19/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 20/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 21/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 22/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 23/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 24/171 2024-01-20T11:06:20.849 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 25/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 26/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 27/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 28/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 29/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 30/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 31/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 32/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 33/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 34/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 35/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 36/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 37/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 38/171 2024-01-20T11:06:20.850 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 39/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-20T11:06:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-20T11:06:20.852 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-20T11:06:20.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-20T11:06:20.854 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-20T11:06:20.855 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.26.0-1.el9.noarch 115/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-20T11:06:20.856 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-20T11:06:20.857 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-20T11:06:20.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-20T11:06:20.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-20T11:06:20.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-20T11:06:20.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-20T11:06:20.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-20T11:06:20.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-20T11:06:23.049 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: acl-2.3.1-4.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.050 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.051 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.052 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.6-16.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-20T11:06:23.053 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-20T11:06:23.054 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.11-1.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-20T11:06:23.055 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-20T11:06:23.056 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.26.0-1.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-20T11:06:23.057 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-20T11:06:23.058 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-20T11:06:23.059 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-3.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-20T11:06:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-20T11:06:23.061 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-20T11:06:23.061 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:23.061 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-01-20T11:06:23.699 DEBUG:teuthology.parallel:result is None 2024-01-20T11:06:23.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T11:06:24.032 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-20T11:06:24.104 INFO:teuthology.orchestra.run.smithi162.stdout:19.0.0-763.ga00c9940.el9 2024-01-20T11:06:24.104 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-763.ga00c9940.el9 2024-01-20T11:06:24.104 INFO:teuthology.task.install:The correct ceph version 19.0.0-763.ga00c9940 is installed. 2024-01-20T11:06:24.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T11:06:24.325 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-20T11:06:24.379 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-763.ga00c9940.el9 2024-01-20T11:06:24.379 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-763.ga00c9940.el9 2024-01-20T11:06:24.380 INFO:teuthology.task.install:The correct ceph version 19.0.0-763.ga00c9940 is installed. 2024-01-20T11:06:24.381 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-20T11:06:24.382 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:24.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-20T11:06:24.484 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:24.484 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-20T11:06:24.563 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-20T11:06:24.563 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:24.563 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-01-20T11:06:24.662 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-20T11:06:24.756 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:24.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-01-20T11:06:24.834 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-20T11:06:24.948 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-20T11:06:24.948 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:24.949 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-20T11:06:25.049 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-20T11:06:25.187 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:25.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-20T11:06:25.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-20T11:06:25.372 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-20T11:06:25.372 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:25.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-01-20T11:06:25.473 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-20T11:06:25.571 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:25.571 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-01-20T11:06:25.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-20T11:06:25.756 INFO:teuthology.run_tasks:Running task ceph... 2024-01-20T11:06:25.842 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-20T11:06:25.842 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-01-20T11:06:25.851 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-01-20T11:06:25.944 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-20T11:06:25.944 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-20T11:06:25.951 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-20T11:06:26.032 INFO:tasks.ceph:Creating extra log directories... 2024-01-20T11:06:26.033 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-20T11:06:26.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-20T11:06:26.135 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-20T11:06:26.135 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-20T11:06:26.135 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-20T11:06:26.135 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:26.135 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-20T11:06:26.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-20T11:06:26.452 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-20T11:06:26.542 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:26.543 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-20T11:06:26.586 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-20T11:06:26.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-20T11:06:26.873 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-20T11:06:26.873 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-20T11:06:26.873 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/strays}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7522617', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 450, 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdz4tlrW+p4p97mpnf38K/F5wSYtN2jYm1y4zfk8Zk5UvSBLOQEzAbLvHZ7b7C7gg4Vs+5DUgwZCWhH9bZej3Y=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6aFtOJmsPEB7Lb/+0fkmqRqZmCHGK/g14gkygGM/HGu/bTjRcQVtOjX92KKZi8wChCpNaKMGsmF1KuCKQifIA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_strays']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-19_15:24:44', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-20T11:06:26.874 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-20T11:06:26.882 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-20T11:06:26.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-01-20T11:06:26.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-01-20T11:06:27.057 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:27.058 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-01-20T11:06:27.115 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-20T11:06:27.115 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-01-20T11:06:27.169 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-20T11:06:27.169 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:27.169 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-01-20T11:06:27.169 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:27.169 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:27.170 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-01-20 11:03:40.009221315 +0000 2024-01-20T11:06:27.170 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-01-20 11:01:14.984817089 +0000 2024-01-20T11:06:27.170 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-01-20 11:01:14.984817089 +0000 2024-01-20T11:06:27.170 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-01-20 11:01:14.984817089 +0000 2024-01-20T11:06:27.170 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-20T11:06:27.250 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-01-20T11:06:27.250 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-01-20T11:06:27.251 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000358499 s, 1.4 MB/s 2024-01-20T11:06:27.254 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-20T11:06:27.308 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-01-20T11:06:27.357 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-20T11:06:27.357 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:27.358 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-01-20T11:06:27.358 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:27.358 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:27.358 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-01-20 11:03:40.010221295 +0000 2024-01-20T11:06:27.358 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-01-20 11:01:15.541805325 +0000 2024-01-20T11:06:27.358 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-01-20 11:01:15.541805325 +0000 2024-01-20T11:06:27.358 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-01-20 11:01:15.541805325 +0000 2024-01-20T11:06:27.358 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-20T11:06:27.445 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-01-20T11:06:27.445 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-01-20T11:06:27.445 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000342563 s, 1.5 MB/s 2024-01-20T11:06:27.450 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-20T11:06:27.505 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-01-20T11:06:27.553 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-20T11:06:27.553 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-01-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-01-20 11:03:40.011221274 +0000 2024-01-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-01-20 11:01:16.085793835 +0000 2024-01-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-01-20 11:01:16.085793835 +0000 2024-01-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-01-20 11:01:16.085793835 +0000 2024-01-20T11:06:27.554 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-20T11:06:27.637 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-01-20T11:06:27.638 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-01-20T11:06:27.638 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000327113 s, 1.6 MB/s 2024-01-20T11:06:27.641 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-20T11:06:27.699 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-01-20T11:06:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-01-20 11:03:40.011221274 +0000 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-01-20 11:01:16.648781943 +0000 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-01-20 11:01:16.648781943 +0000 2024-01-20T11:06:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-01-20 11:01:16.648781943 +0000 2024-01-20T11:06:27.749 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-20T11:06:27.828 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-01-20T11:06:27.828 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-01-20T11:06:27.828 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000327087 s, 1.6 MB/s 2024-01-20T11:06:27.832 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-20T11:06:27.884 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:27.885 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:27.885 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-01-20T11:06:27.937 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-20T11:06:27.937 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-20 11:06:16.431221048 +0000 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-20 11:01:15.514627339 +0000 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-20 11:01:15.514627339 +0000 2024-01-20T11:06:28.031 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-20 11:01:15.514627339 +0000 2024-01-20T11:06:28.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-20T11:06:28.117 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-20T11:06:28.118 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-20T11:06:28.118 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000423613 s, 1.2 MB/s 2024-01-20T11:06:28.122 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-20T11:06:28.175 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-01-20T11:06:28.221 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-20T11:06:28.221 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:28.222 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-01-20T11:06:28.222 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:28.222 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:28.222 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-20 11:06:16.432221026 +0000 2024-01-20T11:06:28.222 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-20 11:01:16.084614319 +0000 2024-01-20T11:06:28.222 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-20 11:01:16.084614319 +0000 2024-01-20T11:06:28.222 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-20 11:01:16.084614319 +0000 2024-01-20T11:06:28.222 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-20T11:06:28.355 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-20T11:06:28.355 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-20T11:06:28.355 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.00037829 s, 1.4 MB/s 2024-01-20T11:06:28.359 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-20T11:06:28.414 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-20 11:06:16.433221004 +0000 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-20 11:01:16.679600728 +0000 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-20 11:01:16.679600728 +0000 2024-01-20T11:06:28.461 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-20 11:01:16.679600728 +0000 2024-01-20T11:06:28.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-20T11:06:28.538 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-20T11:06:28.538 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-20T11:06:28.538 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000275941 s, 1.9 MB/s 2024-01-20T11:06:28.542 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-20T11:06:28.591 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-01-20T11:06:28.634 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-20T11:06:28.634 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T11:06:28.634 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-01-20T11:06:28.635 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T11:06:28.635 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T11:06:28.635 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-20 11:06:16.434220982 +0000 2024-01-20T11:06:28.635 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-20 11:01:17.234588051 +0000 2024-01-20T11:06:28.635 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-20 11:01:17.234588051 +0000 2024-01-20T11:06:28.635 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-20 11:01:17.234588051 +0000 2024-01-20T11:06:28.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-20T11:06:28.761 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-20T11:06:28.762 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-20T11:06:28.762 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000374291 s, 1.4 MB/s 2024-01-20T11:06:28.765 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-20T11:06:28.821 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:28.821 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-20T11:06:28.821 INFO:tasks.ceph:Generating config... 2024-01-20T11:06:28.822 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-20T11:06:28.822 INFO:tasks.ceph:[client] debug client = 20 2024-01-20T11:06:28.822 INFO:tasks.ceph:[client] debug ms = 1 2024-01-20T11:06:28.822 INFO:tasks.ceph:[client] pid file = 2024-01-20T11:06:28.822 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-20T11:06:28.822 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-20T11:06:28.823 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-20T11:06:28.823 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-20T11:06:28.824 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-20T11:06:28.824 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-20T11:06:28.825 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-20T11:06:28.825 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-20T11:06:28.825 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-20T11:06:28.825 INFO:tasks.ceph:Setting up mon.a... 2024-01-20T11:06:28.825 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-20T11:06:28.981 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.keyring 2024-01-20T11:06:28.990 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-20T11:06:29.119 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-20T11:06:29.206 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.162'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2024-01-20T11:06:29.207 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.162,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-20T11:06:29.207 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:29.208 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-20T11:06:29.259 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.162 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:29.399 INFO:teuthology.orchestra.run.smithi162.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:29.399 INFO:teuthology.orchestra.run.smithi162.stdout:monmaptool: generated fsid c5cb0dc2-b452-4376-8c48-87e4df6f2999 2024-01-20T11:06:29.399 INFO:teuthology.orchestra.run.smithi162.stdout:setting min_mon_release = quincy 2024-01-20T11:06:29.399 INFO:teuthology.orchestra.run.smithi162.stdout:epoch 0 2024-01-20T11:06:29.399 INFO:teuthology.orchestra.run.smithi162.stdout:fsid c5cb0dc2-b452-4376-8c48-87e4df6f2999 2024-01-20T11:06:29.399 INFO:teuthology.orchestra.run.smithi162.stdout:last_changed 2024-01-20T11:06:29.399373+0000 2024-01-20T11:06:29.400 INFO:teuthology.orchestra.run.smithi162.stdout:created 2024-01-20T11:06:29.399373+0000 2024-01-20T11:06:29.400 INFO:teuthology.orchestra.run.smithi162.stdout:min_mon_release 17 (quincy) 2024-01-20T11:06:29.400 INFO:teuthology.orchestra.run.smithi162.stdout:election_strategy: 1 2024-01-20T11:06:29.400 INFO:teuthology.orchestra.run.smithi162.stdout:0: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.a 2024-01-20T11:06:29.400 INFO:teuthology.orchestra.run.smithi162.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-01-20T11:06:29.400 INFO:teuthology.orchestra.run.smithi162.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-01-20T11:06:29.400 INFO:teuthology.orchestra.run.smithi162.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-20T11:06:29.402 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-20T11:06:29.450 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c5cb0dc2-b452-4376-8c48-87e4df6f2999... 2024-01-20T11:06:29.450 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-20T11:06:29.455 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-20T11:06:29.613 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-01-20T11:06:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-01-20T11:06:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-20T11:06:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-01-20T11:06:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-01-20T11:06:29.613 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-01-20T11:06:29.614 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-01-20T11:06:29.615 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.162,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = c5cb0dc2-b452-4376-8c48-87e4df6f2999 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-01-20T11:06:29.616 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.617 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-01-20T11:06:29.618 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-01-20T11:06:29.619 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-20T11:06:29.620 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-01-20T11:06:29.621 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-01-20T11:06:29.622 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-01-20T11:06:29.623 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-01-20T11:06:29.627 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.628 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-01-20T11:06:29.629 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.162,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = c5cb0dc2-b452-4376-8c48-87e4df6f2999 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.630 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-01-20T11:06:29.631 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-01-20T11:06:29.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-01-20T11:06:29.633 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-01-20T11:06:29.634 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-01-20T11:06:29.635 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-01-20T11:06:29.636 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-01-20T11:06:29.637 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-01-20T11:06:29.668 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-20T11:06:29.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-20T11:06:29.812 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-20T11:06:29.812 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:29.812 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-20T11:06:29.861 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:29.861 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-20T11:06:29.955 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:06:29.955 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:29.955 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-20T11:06:29.955 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-20T11:06:30.095 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:06:30.095 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:30.192 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:06:30.193 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:30.193 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-20T11:06:30.193 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-20T11:06:30.329 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:06:30.329 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:30.426 INFO:tasks.ceph:Setting up mon nodes... 2024-01-20T11:06:30.426 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-20T11:06:30.426 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-20T11:06:30.587 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-20T11:06:30.597 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-20T11:06:30.770 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-20T11:06:30.778 INFO:tasks.ceph:Setting up mds nodes... 2024-01-20T11:06:30.778 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-20T11:06:30.953 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-20T11:06:30.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-20T11:06:31.052 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-20T11:06:31.224 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-20T11:06:31.234 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-20T11:06:31.330 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-20T11:06:31.492 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-20T11:06:31.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-20T11:06:31.584 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-20T11:06:31.726 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-20T11:06:31.733 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-20T11:06:31.810 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-20T11:06:31.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-20T11:06:31.941 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-20T11:06:31.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-20T11:06:32.120 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-20T11:06:32.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-20T11:06:32.289 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-20T11:06:32.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-20T11:06:32.457 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-20T11:06:32.508 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-20T11:06:32.508 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-20T11:06:32.508 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-20T11:06:32.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:32.607 INFO:tasks.ceph:role: osd.0 2024-01-20T11:06:32.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:06:32.607 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:32.706 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:33.223 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-01-20T11:06:33.229 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-01-20T11:06:33.229 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-20T11:06:33.415 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-20T11:06:33.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-20T11:06:33.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:33.607 INFO:tasks.ceph:role: osd.1 2024-01-20T11:06:33.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:06:33.608 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-20T11:06:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:33.692 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:33.692 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:33.692 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:33.692 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:33.692 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:33.693 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:33.693 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:34.172 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-01-20T11:06:34.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-01-20T11:06:34.179 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-20T11:06:34.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-20T11:06:34.379 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-20T11:06:34.459 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:34.460 INFO:tasks.ceph:role: osd.2 2024-01-20T11:06:34.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:06:34.460 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-20T11:06:34.546 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:34.547 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:35.073 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-01-20T11:06:35.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-01-20T11:06:35.079 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-20T11:06:35.259 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-20T11:06:35.357 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-20T11:06:35.442 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:35.442 INFO:tasks.ceph:role: osd.3 2024-01-20T11:06:35.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:06:35.442 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:35.540 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:35.998 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-01-20T11:06:36.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-01-20T11:06:36.005 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-20T11:06:36.156 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-20T11:06:36.242 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:36.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:36.381+0000 7f533de0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-20T11:06:36.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:36.385+0000 7f533de0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-20T11:06:36.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:36.385+0000 7f533de0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-20T11:06:36.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:36.385+0000 7f533de0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-20T11:06:36.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:36.385+0000 7f533de0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-20T11:06:36.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:36.389+0000 7f533de0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-20T11:06:39.561 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-20T11:06:39.657 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:39.795+0000 7fe21f81b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-20T11:06:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:39.796+0000 7fe21f81b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-20T11:06:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:39.796+0000 7fe21f81b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-20T11:06:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:39.796+0000 7fe21f81b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-20T11:06:39.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:39.796+0000 7fe21f81b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-20T11:06:39.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:39.798+0000 7fe21f81b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-20T11:06:42.961 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-20T11:06:43.058 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:43.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:43.196+0000 7f87fec1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-20T11:06:43.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:43.197+0000 7f87fec1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-20T11:06:43.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:43.197+0000 7f87fec1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-20T11:06:43.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:43.197+0000 7f87fec1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-20T11:06:43.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:43.197+0000 7f87fec1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-20T11:06:43.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:43.199+0000 7f87fec1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-20T11:06:46.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-20T11:06:46.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:46.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:46.580+0000 7f36682b5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-20T11:06:46.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:46.581+0000 7f36682b5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-20T11:06:46.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:46.581+0000 7f36682b5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-20T11:06:46.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:46.581+0000 7f36682b5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-20T11:06:46.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:46.581+0000 7f36682b5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-20T11:06:46.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:06:46.583+0000 7f36682b5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-20T11:06:49.767 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-20T11:06:49.864 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-20T11:06:49.962 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:49.962 INFO:tasks.ceph:role: osd.4 2024-01-20T11:06:49.962 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:06:49.962 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:50.060 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:50.573 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-01-20T11:06:50.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-01-20T11:06:50.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-20T11:06:50.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-20T11:06:50.887 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-20T11:06:50.974 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:50.974 INFO:tasks.ceph:role: osd.5 2024-01-20T11:06:50.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:06:50.974 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:51.056 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:51.527 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-01-20T11:06:51.533 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-01-20T11:06:51.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-20T11:06:51.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-20T11:06:51.750 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-20T11:06:51.834 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:51.834 INFO:tasks.ceph:role: osd.6 2024-01-20T11:06:51.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:06:51.834 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:51.913 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:52.449 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-01-20T11:06:52.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-01-20T11:06:52.455 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-20T11:06:52.648 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-20T11:06:52.753 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-20T11:06:52.843 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T11:06:52.843 INFO:tasks.ceph:role: osd.7 2024-01-20T11:06:52.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:06:52.843 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-20T11:06:52.941 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T11:06:52.942 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T11:06:53.404 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-01-20T11:06:53.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-01-20T11:06:53.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-20T11:06:53.538 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-20T11:06:53.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:53.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:53.770+0000 7ff8c2e37640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-20T11:06:53.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:53.772+0000 7ff8c2e37640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-20T11:06:53.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:53.772+0000 7ff8c2e37640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-20T11:06:53.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:53.772+0000 7ff8c2e37640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-20T11:06:53.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:53.772+0000 7ff8c2e37640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-20T11:06:53.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:53.775+0000 7ff8c2e37640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-20T11:06:56.875 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:06:56.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:06:56.972 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-20T11:06:57.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:06:57.233 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:57.233+0000 7f8c990d5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-20T11:06:57.233 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:57.233+0000 7f8c990d5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-20T11:06:57.233 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:57.233+0000 7f8c990d5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-20T11:06:57.234 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:57.233+0000 7f8c990d5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-20T11:06:57.234 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:57.233+0000 7f8c990d5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-20T11:06:57.236 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:06:57.235+0000 7f8c990d5640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-20T11:07:00.172 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-20T11:07:00.264 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:07:00.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:00.399+0000 7fc40e76d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-20T11:07:00.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:00.400+0000 7fc40e76d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-20T11:07:00.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:00.400+0000 7fc40e76d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-20T11:07:00.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:00.400+0000 7fc40e76d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-20T11:07:00.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:00.400+0000 7fc40e76d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-20T11:07:00.402 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:00.402+0000 7fc40e76d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-20T11:07:03.572 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-20T11:07:03.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:07:03.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:03.796+0000 7fb8b6f9e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-20T11:07:03.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:03.797+0000 7fb8b6f9e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-20T11:07:03.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:03.797+0000 7fb8b6f9e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-20T11:07:03.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:03.797+0000 7fb8b6f9e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-20T11:07:03.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:03.797+0000 7fb8b6f9e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-20T11:07:03.799 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:03.799+0000 7fb8b6f9e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-20T11:07:06.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-20T11:07:06.817 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-20T11:07:06.817 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:06.817 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-20T11:07:06.920 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:06.920 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-20T11:07:07.006 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:07.006 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-20T11:07:07.138 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:07.138 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-20T11:07:07.232 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:07.232 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-20T11:07:07.370 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:07.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-20T11:07:07.464 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:07.465 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-20T11:07:07.553 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:07.554 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-20T11:07:07.655 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:07.655 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-20T11:07:07.748 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:07.748 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-20T11:07:07.843 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:07.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-20T11:07:07.935 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:07.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-20T11:07:08.076 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:08.076 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-20T11:07:08.171 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:08.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-20T11:07:08.263 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:08.263 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-20T11:07:08.320 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:08.320 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-20T11:07:08.370 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:08.370 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-20T11:07:08.426 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:08.426 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-20T11:07:08.479 INFO:tasks.ceph:Adding keys to all mons... 2024-01-20T11:07:08.480 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-20T11:07:08.487 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-20T11:07:08.574 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-01-20T11:07:08.574 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA2qatlfFkPIxAAg8+vmZmaSmheq0M0JmG30w== 2024-01-20T11:07:08.574 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-01-20T11:07:08.574 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA2qatli4LXOBAAyHG4hThQHVzhS2VuxtIShQ== 2024-01-20T11:07:08.574 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-01-20T11:07:08.574 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA3qatljiNoDRAAF01GIgXhTP8Xw3tCJz4r9w== 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA8qatlmprLFhAA8txfY4VYIHGeFSq4MqTKXA== 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA/qatlvx9yLxAAudg/s2BWxTBkX5HFB2XdcA== 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBDqatly0LLCxAAs92m9lgojdlmvSk6BdLbzA== 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBGqatl2IqpIhAAphkrhMKWP3GywFmTNSymdw== 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA2qatleWbxLRAAM9Mru8f0sV5ndjgiwANf4A== 2024-01-20T11:07:08.575 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA3qatln9JhHRAAThi8suQy0WUJaCK80hNdMQ== 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA3qatlO9ZVKxAAlodCLFD0cJVAL5yXVeEqlg== 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBNqatl67EHLhAAU+cN87inhfqC8zSyDhXfwA== 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBRqatljVzrDRAAUPAgVpOxYiDrJyOnvBnUgA== 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBUqatlbmzXFxAApeFOxi8HAIpzM0qO3gxhZA== 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBXqatl+MWELxAArrji0ys1SfJ7v5yIwAifFQ== 2024-01-20T11:07:08.576 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-01-20T11:07:08.577 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA3qatljGIeOBAAZAh1ameerRU000krb9bN6g== 2024-01-20T11:07:08.577 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2024-01-20T11:07:08.577 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA4qatlChY5BxAAkBXYUjzsz/0ZfA/D7ydtsQ== 2024-01-20T11:07:08.577 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-01-20T11:07:08.577 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA4qatl8NRKERAAGAVRlvq6iuXNcwGBrsxjCQ== 2024-01-20T11:07:08.577 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2024-01-20T11:07:08.577 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA4qatle+5OGxAAqVEOXYysmTEwit512OV0Gw== 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA2qatlfFkPIxAAg8+vmZmaSmheq0M0JmG30w== 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA2qatli4LXOBAAyHG4hThQHVzhS2VuxtIShQ== 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA3qatljiNoDRAAF01GIgXhTP8Xw3tCJz4r9w== 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA8qatlmprLFhAA8txfY4VYIHGeFSq4MqTKXA== 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA/qatlvx9yLxAAudg/s2BWxTBkX5HFB2XdcA== 2024-01-20T11:07:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBDqatly0LLCxAAs92m9lgojdlmvSk6BdLbzA== 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBGqatl2IqpIhAAphkrhMKWP3GywFmTNSymdw== 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA2qatleWbxLRAAM9Mru8f0sV5ndjgiwANf4A== 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA3qatln9JhHRAAThi8suQy0WUJaCK80hNdMQ== 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA3qatlO9ZVKxAAlodCLFD0cJVAL5yXVeEqlg== 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBNqatl67EHLhAAU+cN87inhfqC8zSyDhXfwA== 2024-01-20T11:07:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBRqatljVzrDRAAUPAgVpOxYiDrJyOnvBnUgA== 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBUqatlbmzXFxAApeFOxi8HAIpzM0qO3gxhZA== 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBXqatl+MWELxAArrji0ys1SfJ7v5yIwAifFQ== 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA3qatljGIeOBAAZAh1ameerRU000krb9bN6g== 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA4qatlChY5BxAAkBXYUjzsz/0ZfA/D7ydtsQ== 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA4qatl8NRKERAAGAVRlvq6iuXNcwGBrsxjCQ== 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2024-01-20T11:07:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA4qatle+5OGxAAqVEOXYysmTEwit512OV0Gw== 2024-01-20T11:07:08.582 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T11:07:08.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T11:07:08.733 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:08.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:08.886 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:08.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:09.037 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.042 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.182 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.189 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.483 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:09.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T11:07:09.641 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T11:07:09.780 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:09.785 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:09.925 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:09.933 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T11:07:10.079 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.086 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.378 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.526 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.534 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T11:07:10.675 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:10.680 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:10.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:10.834 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:10.980 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:10.987 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:11.127 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:11.133 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T11:07:11.277 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-20T11:07:11.278 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-20T11:07:11.374 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-20T11:07:11.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-20T11:07:11.613 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-20T11:07:11.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-20T11:07:11.861 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-20T11:07:11.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-20T11:07:12.040 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-20T11:07:12.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-20T11:07:12.286 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:07:12.294 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-20T11:07:12.342 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-20T11:07:12.343 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-20T11:07:12.343 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-20T11:07:12.349 INFO:tasks.ceph.mon.a:Started 2024-01-20T11:07:12.349 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-20T11:07:12.349 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-20T11:07:12.354 INFO:tasks.ceph.mon.b:Started 2024-01-20T11:07:12.354 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-20T11:07:12.354 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-20T11:07:12.359 INFO:tasks.ceph.mon.c:Started 2024-01-20T11:07:12.359 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-20T11:07:12.359 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-20T11:07:12.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-20T11:07:12.365 INFO:tasks.ceph.mgr.y:Started 2024-01-20T11:07:12.365 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-20T11:07:12.365 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-20T11:07:12.370 INFO:tasks.ceph.mgr.x:Started 2024-01-20T11:07:12.370 INFO:tasks.ceph:Setting crush tunables to default 2024-01-20T11:07:12.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd crush tunables default 2024-01-20T11:07:12.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.546+0000 7f8ba1c00640 1 Processor -- start 2024-01-20T11:07:12.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.546+0000 7f8ba1c00640 1 -- start start 2024-01-20T11:07:12.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8ba1c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 0x7f8b9c0b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8ba1c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b9c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8ba1c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c0d2730 con 0x7f8b9c0d0400 2024-01-20T11:07:12.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8ba1c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c0d2a10 con 0x7f8b9c15d5a0 2024-01-20T11:07:12.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8ba1c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0d2cf0 con 0x7f8b9c0d2250 2024-01-20T11:07:12.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8b9aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 0x7f8b9c0b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8b9b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8b9c0d0400 0x7f8b9c0d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33376/0 (socket says 172.21.15.162:33376) 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8b9b400640 1 -- 172.21.15.162:0/4054519599 learned_addr learned my addr 172.21.15.162:0/4054519599 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.547+0000 7f8b9a000640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b9c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9aa00640 1 -- 172.21.15.162:0/4054519599 >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 msgr2=0x7f8b9c0b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9aa00640 1 -- 172.21.15.162:0/4054519599 >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 msgr2=0x7f8b9c0b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9aa00640 1 --2- 172.21.15.162:0/4054519599 >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 0x7f8b9c0b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9aa00640 1 --2- 172.21.15.162:0/4054519599 >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 0x7f8b9c0b6650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9a000640 1 -- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 msgr2=0x7f8b9c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9a000640 1 -- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 msgr2=0x7f8b9c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9a000640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b9c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-20T11:07:12.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.548+0000 7f8b9a000640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b9c0ce580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-20T11:07:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.565+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448281823 0 0) 0x7f8b9c0d2730 con 0x7f8b9c0d0400 2024-01-20T11:07:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.565+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b7c003520 con 0x7f8b9c0d0400 2024-01-20T11:07:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3513612216 0 0) 0x7f8b7c003520 con 0x7f8b9c0d0400 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 msgr2=0x7f8b9c0ce580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b9c0ce580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 msgr2=0x7f8b9c0b6650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 --2- 172.21.15.162:0/4054519599 >> v2:172.21.15.162:3300/0 conn(0x7f8b9c15d5a0 0x7f8b9c0b6650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0d2fd0 con 0x7f8b9c0d0400 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f8b940019f0 con 0x7f8b9c0d0400 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 >> v1:172.21.15.162:6789/0 conn(0x7f8b9c0d0400 legacy=0x7f8b9c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b7c003970 0x7f8b7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7c004d00 0x7f8b7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0d2a10 con 0x7f8b7c003970 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0d2cf0 con 0x7f8b7c004d00 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c00bae0 con 0x7f8b9c0d2250 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b9aa00640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b7c003970 0x7f8b7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.566+0000 7f8b9a000640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.567+0000 7f8b9b400640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7c004d00 0x7f8b7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.567+0000 7f8b9aa00640 1 -- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 msgr2=0x7f8b7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:12.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.567+0000 7f8b9aa00640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b9c0d2250 0x7f8b7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.567+0000 7f8b9aa00640 1 -- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7c004d00 msgr2=0x7f8b7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:12.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.567+0000 7f8b9aa00640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7c004d00 0x7f8b7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.567+0000 7f8b9aa00640 1 -- 172.21.15.162:0/4054519599 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c003520 con 0x7f8b7c003970 2024-01-20T11:07:12.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.568+0000 7f8b9aa00640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b7c003970 0x7f8b7c003d90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b9e0 tx=0x7f8b7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b769114ec83d3729 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:12.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.568+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c032630 con 0x7f8b7c003970 2024-01-20T11:07:12.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.568+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c032790 con 0x7f8b7c003970 2024-01-20T11:07:12.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.568+0000 7f8b99600640 1 -- 172.21.15.162:0/4054519599 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c032b40 con 0x7f8b7c003970 2024-01-20T11:07:12.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.569+0000 7f8ba1c00640 1 -- 172.21.15.162:0/4054519599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b7c003970 msgr2=0x7f8b7c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:12.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.569+0000 7f8ba1c00640 1 --2- 172.21.15.162:0/4054519599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b7c003970 0x7f8b7c003d90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b9e0 tx=0x7f8b7c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.569+0000 7f8b9b400640 1 -- 172.21.15.162:0/4054519599 reap_dead start 2024-01-20T11:07:12.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.569+0000 7f8ba1c00640 1 -- 172.21.15.162:0/4054519599 shutdown_connections 2024-01-20T11:07:12.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.569+0000 7f8ba1c00640 1 -- 172.21.15.162:0/4054519599 >> 172.21.15.162:0/4054519599 conn(0x7f8b9c066760 msgr2=0x7f8b9c066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:12.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.569+0000 7f8ba1c00640 1 -- 172.21.15.162:0/4054519599 shutdown_connections 2024-01-20T11:07:12.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.569+0000 7f8ba1c00640 1 -- 172.21.15.162:0/4054519599 wait complete. 2024-01-20T11:07:12.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.572+0000 7f8ba1c00640 1 Processor -- start 2024-01-20T11:07:12.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.572+0000 7f8ba1c00640 1 -- start start 2024-01-20T11:07:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.573+0000 7f8ba1c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7c003970 0x7f8b9c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.573+0000 7f8ba1c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b9c0ca5f0 0x7f8b9c0c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.573+0000 7f8ba1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c0cbd80 0x7f8b9c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.573+0000 7f8ba1c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0c8490 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.573+0000 7f8ba1c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0cc740 con 0x7f8b9c0ca5f0 2024-01-20T11:07:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.573+0000 7f8ba1c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0c7810 con 0x7f8b7c003970 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c0cbd80 0x7f8b9c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c0cbd80 0x7f8b9c0cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:50886/0 (socket says 172.21.15.162:50886) 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 -- 172.21.15.162:0/3466880615 learned_addr learned my addr 172.21.15.162:0/3466880615 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9a000640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b9c0ca5f0 0x7f8b9c0c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9aa00640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7c003970 0x7f8b9c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 -- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7c003970 msgr2=0x7f8b9c14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7c003970 0x7f8b9c14f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 -- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b9c0ca5f0 msgr2=0x7f8b9c0c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b9c0ca5f0 0x7f8b9c0c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.574+0000 7f8b9b400640 1 -- 172.21.15.162:0/3466880615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0c7af0 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8b9b400640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c0cbd80 0x7f8b9c0cc200 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0b5a30 tx=0x7f8b9400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8b92a00640 1 -- 172.21.15.162:0/3466880615 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400ec10 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8b92a00640 1 -- 172.21.15.162:0/3466880615 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9400ed90 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8b92a00640 1 -- 172.21.15.162:0/3466880615 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94013660 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c0c7dd0 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c14ff30 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8b92a00640 1 -- 172.21.15.162:0/3466880615 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f8b94013b40 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.575+0000 7f8b92a00640 1 -- 172.21.15.162:0/3466880615 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8b9401dd70 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.576+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c0c85d0 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.580+0000 7f8b92a00640 1 -- 172.21.15.162:0/3466880615 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f8b9c0c85d0 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.651+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8b9c04e970 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.654+0000 7f8b92a00640 1 -- 172.21.15.162:0/3466880615 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8b9401d460 con 0x7f8b9c0cbd80 2024-01-20T11:07:12.656 INFO:teuthology.orchestra.run.smithi162.stderr:adjusted tunables profile to default 2024-01-20T11:07:12.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.655+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c0cbd80 msgr2=0x7f8b9c0cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:12.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.655+0000 7f8ba1c00640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c0cbd80 0x7f8b9c0cc200 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0b5a30 tx=0x7f8b9400e530 comp rx=0 tx=0).stop 2024-01-20T11:07:12.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.656+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 shutdown_connections 2024-01-20T11:07:12.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.656+0000 7f8ba1c00640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c0cbd80 0x7f8b9c0cc200 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.656+0000 7f8ba1c00640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b9c0ca5f0 0x7f8b9c0c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.656+0000 7f8ba1c00640 1 --2- 172.21.15.162:0/3466880615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7c003970 0x7f8b9c14f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:12.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.656+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 >> 172.21.15.162:0/3466880615 conn(0x7f8b9c066760 msgr2=0x7f8b9c0d3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:12.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.656+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 shutdown_connections 2024-01-20T11:07:12.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:12.656+0000 7f8ba1c00640 1 -- 172.21.15.162:0/3466880615 wait complete. 2024-01-20T11:07:12.675 INFO:tasks.ceph:check_enable_crimson: False 2024-01-20T11:07:12.675 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-20T11:07:12.675 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:12.675 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-20T11:07:12.752 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:12.752 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-20T11:07:12.871 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:12.871 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-20T11:07:13.004 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:13.004 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-20T11:07:13.089 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:13.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-20T11:07:13.175 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:13.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-20T11:07:13.297 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:13.295+0000 7f5a65a2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-20T11:07:13.298 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:13.297+0000 7f53cf83c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-20T11:07:13.300 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:13.300 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-20T11:07:13.356 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:13.355+0000 7f5a65a2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-20T11:07:13.361 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:13.360+0000 7f53cf83c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-20T11:07:13.423 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:13.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-20T11:07:13.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 3b83ea49-f8a9-4680-a5e0-987cf35cd6cd 0 2024-01-20T11:07:13.782 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.781+0000 7f128b000640 1 Processor -- start 2024-01-20T11:07:13.783 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.781+0000 7f128b000640 1 -- start start 2024-01-20T11:07:13.784 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f128b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f128415d610 0x7f12840ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:13.784 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f128b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f12840d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:13.784 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f128b000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128415d9f0 con 0x7f12840d1870 2024-01-20T11:07:13.784 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f128b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12840cea90 con 0x7f128415d610 2024-01-20T11:07:13.784 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f128b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12840ce0f0 con 0x7f12840d3e90 2024-01-20T11:07:13.784 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f128a600640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f12840d1870 0x7f12840c6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:33496/0 (socket says 172.21.15.179:33496) 2024-01-20T11:07:13.784 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f1289200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f12840d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:13.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f128a600640 1 -- 172.21.15.179:0/1262510035 learned_addr learned my addr 172.21.15.179:0/1262510035 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-01-20T11:07:13.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.783+0000 7f1289c00640 1 --2- 172.21.15.179:0/1262510035 >> v2:172.21.15.162:3300/0 conn(0x7f128415d610 0x7f12840ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:13.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.784+0000 7f1289200640 1 -- 172.21.15.179:0/1262510035 >> v2:172.21.15.162:3300/0 conn(0x7f128415d610 msgr2=0x7f12840ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:13.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.784+0000 7f1289200640 1 --2- 172.21.15.179:0/1262510035 >> v2:172.21.15.162:3300/0 conn(0x7f128415d610 0x7f12840ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.784+0000 7f1289200640 1 -- 172.21.15.179:0/1262510035 >> v1:172.21.15.179:6789/0 conn(0x7f12840d1870 legacy=0x7f12840c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:13.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.784+0000 7f1283e00640 1 -- 172.21.15.179:0/1262510035 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320157130 0 0) 0x7f128415d9f0 con 0x7f12840d1870 2024-01-20T11:07:13.785 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.784+0000 7f1289200640 1 -- 172.21.15.179:0/1262510035 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840ce3d0 con 0x7f12840d3e90 2024-01-20T11:07:13.786 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.785+0000 7f1289200640 1 --2- 172.21.15.179:0/1262510035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f12840d0e60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097a0 tx=0x7f126c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f34060f6423df668 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:13.786 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.785+0000 7f1283e00640 1 -- 172.21.15.179:0/1262510035 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c02f050 con 0x7f12840d3e90 2024-01-20T11:07:13.786 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.785+0000 7f1283e00640 1 -- 172.21.15.179:0/1262510035 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c031700 con 0x7f12840d3e90 2024-01-20T11:07:13.786 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.785+0000 7f1283e00640 1 -- 172.21.15.179:0/1262510035 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c031a90 con 0x7f12840d3e90 2024-01-20T11:07:13.787 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 -- 172.21.15.179:0/1262510035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 msgr2=0x7f12840d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:13.787 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 --2- 172.21.15.179:0/1262510035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f12840d0e60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097a0 tx=0x7f126c02b7a0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.787 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 -- 172.21.15.179:0/1262510035 shutdown_connections 2024-01-20T11:07:13.787 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 --2- 172.21.15.179:0/1262510035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f12840d0e60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 --2- 172.21.15.179:0/1262510035 >> v2:172.21.15.162:3300/0 conn(0x7f128415d610 0x7f12840ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 -- 172.21.15.179:0/1262510035 >> 172.21.15.179:0/1262510035 conn(0x7f128409c5d0 msgr2=0x7f12840d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:13.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 -- 172.21.15.179:0/1262510035 shutdown_connections 2024-01-20T11:07:13.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.786+0000 7f128b000640 1 -- 172.21.15.179:0/1262510035 wait complete. 2024-01-20T11:07:13.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.788+0000 7f128b000640 1 Processor -- start 2024-01-20T11:07:13.788 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.788+0000 7f128b000640 1 -- start start 2024-01-20T11:07:13.790 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f128b000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12840d1870 0x7f1284151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:13.790 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f128b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f1284154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:13.790 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f128b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128415d610 0x7f128406c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:13.790 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f128b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284152430 con 0x7f128415d610 2024-01-20T11:07:13.790 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f128b000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12841557c0 con 0x7f12840d1870 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f128b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1284155aa0 con 0x7f12840d3e90 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f1284154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12840d1870 0x7f1284151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f1284154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:53910/0 (socket says 172.21.15.179:53910) 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 -- 172.21.15.179:0/3181283190 learned_addr learned my addr 172.21.15.179:0/3181283190 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f128a600640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128415d610 0x7f128406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 -- 172.21.15.179:0/3181283190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12840d1870 msgr2=0x7f1284151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12840d1870 0x7f1284151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 -- 172.21.15.179:0/3181283190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128415d610 msgr2=0x7f128406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128415d610 0x7f128406c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.791 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.789+0000 7f1289200640 1 -- 172.21.15.179:0/3181283190 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c009400 con 0x7f12840d3e90 2024-01-20T11:07:13.792 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f1289200640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f1284154f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f126c036040 tx=0x7f126c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:13.792 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f1281600640 1 -- 172.21.15.179:0/3181283190 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c033a30 con 0x7f12840d3e90 2024-01-20T11:07:13.793 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f1281600640 1 -- 172.21.15.179:0/3181283190 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c033bb0 con 0x7f12840d3e90 2024-01-20T11:07:13.793 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f1281600640 1 -- 172.21.15.179:0/3181283190 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c03c400 con 0x7f12840d3e90 2024-01-20T11:07:13.793 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1284155d80 con 0x7f12840d3e90 2024-01-20T11:07:13.793 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1284156880 con 0x7f12840d3e90 2024-01-20T11:07:13.793 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f1281600640 1 -- 172.21.15.179:0/3181283190 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f126c03a040 con 0x7f12840d3e90 2024-01-20T11:07:13.793 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.790+0000 7f1281600640 1 -- 172.21.15.179:0/3181283190 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f126c048ac0 con 0x7f12840d3e90 2024-01-20T11:07:13.793 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.791+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1284074a30 con 0x7f12840d3e90 2024-01-20T11:07:13.795 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.794+0000 7f1281600640 1 -- 172.21.15.179:0/3181283190 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f126c043030 con 0x7f12840d3e90 2024-01-20T11:07:13.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.873+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3b83ea49-f8a9-4680-a5e0-987cf35cd6cd", "id": 0} v 0) v1 -- 0x7f12840cd650 con 0x7f12840d3e90 2024-01-20T11:07:13.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.879+0000 7f1281600640 1 -- 172.21.15.179:0/3181283190 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b83ea49-f8a9-4680-a5e0-987cf35cd6cd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f126c038070 con 0x7f12840d3e90 2024-01-20T11:07:13.880 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.880+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 msgr2=0x7f1284154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.880+0000 7f128b000640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f1284154f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f126c036040 tx=0x7f126c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.881+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 shutdown_connections 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.881+0000 7f128b000640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128415d610 0x7f128406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.881+0000 7f128b000640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12840d3e90 0x7f1284154f30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.881+0000 7f128b000640 1 --2- 172.21.15.179:0/3181283190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12840d1870 0x7f1284151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.881+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 >> 172.21.15.179:0/3181283190 conn(0x7f128409c5d0 msgr2=0x7f128415d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.881+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 shutdown_connections 2024-01-20T11:07:13.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:13.881+0000 7f128b000640 1 -- 172.21.15.179:0/3181283190 wait complete. 2024-01-20T11:07:13.897 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new d8a0c454-5468-4fc5-aa84-3021187ba1a4 1 2024-01-20T11:07:13.965 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:13.963+0000 7f5a65a2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-20T11:07:13.978 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:13.977+0000 7f53cf83c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-20T11:07:14.026 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.024+0000 7f5a65a2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-20T11:07:14.043 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.042+0000 7f53cf83c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-20T11:07:14.076 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.074+0000 7f5a65a2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-20T11:07:14.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.082+0000 7f8128a00640 1 Processor -- start 2024-01-20T11:07:14.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.082+0000 7f8128a00640 1 -- start start 2024-01-20T11:07:14.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8128a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f812006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8128a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f81200cf510 0x7f81200b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8128a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f812006d180 0x7f81200b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8128a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81201610c0 con 0x7f81200cf510 2024-01-20T11:07:14.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8128a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812006a600 con 0x7f812006d180 2024-01-20T11:07:14.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8128a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812006a8e0 con 0x7f8120160ce0 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8126000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f812006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8126000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f812006b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:53922/0 (socket says 172.21.15.179:53922) 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8126a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f812006d180 0x7f81200b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.084+0000 7f8126000640 1 -- 172.21.15.179:0/983895400 learned_addr learned my addr 172.21.15.179:0/983895400 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.085+0000 7f8125600640 1 --2- 172.21.15.179:0/983895400 >> v2:172.21.15.162:3300/0 conn(0x7f81200cf510 0x7f81200b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.085+0000 7f8126000640 1 -- 172.21.15.179:0/983895400 >> v2:172.21.15.179:3300/0 conn(0x7f812006d180 msgr2=0x7f81200b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.085+0000 7f8126000640 1 --2- 172.21.15.179:0/983895400 >> v2:172.21.15.179:3300/0 conn(0x7f812006d180 0x7f81200b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.085+0000 7f8126000640 1 -- 172.21.15.179:0/983895400 >> v2:172.21.15.162:3300/0 conn(0x7f81200cf510 msgr2=0x7f81200b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.085+0000 7f8126000640 1 --2- 172.21.15.179:0/983895400 >> v2:172.21.15.162:3300/0 conn(0x7f81200cf510 0x7f81200b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.085+0000 7f8126000640 1 -- 172.21.15.179:0/983895400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812006abc0 con 0x7f8120160ce0 2024-01-20T11:07:14.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.085+0000 7f8126a00640 1 --2- 172.21.15.179:0/983895400 >> v2:172.21.15.179:3300/0 conn(0x7f812006d180 0x7f81200b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.086+0000 7f8126000640 1 --2- 172.21.15.179:0/983895400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f812006b980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81200d0a40 tx=0x7f811002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca7f2b7c1c06660b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.086+0000 7f8124c00640 1 -- 172.21.15.179:0/983895400 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811002cb00 con 0x7f8120160ce0 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.086+0000 7f8124c00640 1 -- 172.21.15.179:0/983895400 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811002cc60 con 0x7f8120160ce0 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.086+0000 7f8124c00640 1 -- 172.21.15.179:0/983895400 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100343f0 con 0x7f8120160ce0 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 -- 172.21.15.179:0/983895400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 msgr2=0x7f812006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 --2- 172.21.15.179:0/983895400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f812006b980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81200d0a40 tx=0x7f811002bf60 comp rx=0 tx=0).stop 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 -- 172.21.15.179:0/983895400 shutdown_connections 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 --2- 172.21.15.179:0/983895400 >> v2:172.21.15.179:3300/0 conn(0x7f812006d180 0x7f81200b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 --2- 172.21.15.179:0/983895400 >> v2:172.21.15.162:3300/0 conn(0x7f81200cf510 0x7f81200b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 --2- 172.21.15.179:0/983895400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f812006b980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 -- 172.21.15.179:0/983895400 >> 172.21.15.179:0/983895400 conn(0x7f81200cf940 msgr2=0x7f81200cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:14.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 -- 172.21.15.179:0/983895400 shutdown_connections 2024-01-20T11:07:14.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.087+0000 7f8128a00640 1 -- 172.21.15.179:0/983895400 wait complete. 2024-01-20T11:07:14.091 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.090+0000 7f8128a00640 1 Processor -- start 2024-01-20T11:07:14.091 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.090+0000 7f8128a00640 1 -- start start 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.091+0000 7f8128a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812006d180 0x7f8120152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8128a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81200cf510 0x7f812006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8128a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f81200cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8128a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120152970 con 0x7f81200cf510 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8128a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200ce4e0 con 0x7f812006d180 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8128a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8120152320 con 0x7f8120160ce0 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812006d180 0x7f8120152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f81200cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f81200cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:53930/0 (socket says 172.21.15.179:53930) 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 -- 172.21.15.179:0/2506452462 learned_addr learned my addr 172.21.15.179:0/2506452462 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8125600640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81200cf510 0x7f812006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 -- 172.21.15.179:0/2506452462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812006d180 msgr2=0x7f8120152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812006d180 0x7f8120152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 -- 172.21.15.179:0/2506452462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81200cf510 msgr2=0x7f812006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81200cf510 0x7f812006d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.092+0000 7f8126a00640 1 -- 172.21.15.179:0/2506452462 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118009400 con 0x7f8120160ce0 2024-01-20T11:07:14.095 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f8126a00640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f81200cda90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f811800e930 tx=0x7f811800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:14.095 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f811e000640 1 -- 172.21.15.179:0/2506452462 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118009700 con 0x7f8120160ce0 2024-01-20T11:07:14.095 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f811e000640 1 -- 172.21.15.179:0/2506452462 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800ca00 con 0x7f8120160ce0 2024-01-20T11:07:14.095 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f811e000640 1 -- 172.21.15.179:0/2506452462 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800cd90 con 0x7f8120160ce0 2024-01-20T11:07:14.095 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8110009b30 con 0x7f8120160ce0 2024-01-20T11:07:14.096 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8120153340 con 0x7f8120160ce0 2024-01-20T11:07:14.096 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f811e000640 1 -- 172.21.15.179:0/2506452462 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f8118004020 con 0x7f8120160ce0 2024-01-20T11:07:14.096 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.093+0000 7f811e000640 1 -- 172.21.15.179:0/2506452462 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8118005e00 con 0x7f8120160ce0 2024-01-20T11:07:14.096 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.094+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8120152ae0 con 0x7f8120160ce0 2024-01-20T11:07:14.097 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.096+0000 7f811e000640 1 -- 172.21.15.179:0/2506452462 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f811803acf0 con 0x7f8120160ce0 2024-01-20T11:07:14.099 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.098+0000 7f53cf83c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-20T11:07:14.139 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.137+0000 7f5a65a2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-20T11:07:14.163 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.162+0000 7f53cf83c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-20T11:07:14.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.175+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d8a0c454-5468-4fc5-aa84-3021187ba1a4", "id": 1} v 0) v1 -- 0x7f812004e970 con 0x7f8120160ce0 2024-01-20T11:07:14.182 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.181+0000 7f811e000640 1 -- 172.21.15.179:0/2506452462 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8a0c454-5468-4fc5-aa84-3021187ba1a4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8118029070 con 0x7f8120160ce0 2024-01-20T11:07:14.182 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-01-20T11:07:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 msgr2=0x7f81200cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f81200cda90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f811800e930 tx=0x7f811800edf0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 shutdown_connections 2024-01-20T11:07:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8120160ce0 0x7f81200cda90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81200cf510 0x7f812006d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 --2- 172.21.15.179:0/2506452462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812006d180 0x7f8120152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 >> 172.21.15.179:0/2506452462 conn(0x7f81200cf940 msgr2=0x7f81200af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:14.185 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 shutdown_connections 2024-01-20T11:07:14.185 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.183+0000 7f8128a00640 1 -- 172.21.15.179:0/2506452462 wait complete. 2024-01-20T11:07:14.189 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.188+0000 7f5a65a2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-20T11:07:14.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 1313e521-b516-4b4f-a4fc-bafe7fd242a0 2 2024-01-20T11:07:14.216 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.215+0000 7f53cf83c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-20T11:07:14.301 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.300+0000 7f5a65a2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-20T11:07:14.336 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.335+0000 7f53cf83c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-20T11:07:14.377 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.376+0000 7f4518200640 1 Processor -- start 2024-01-20T11:07:14.378 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.376+0000 7f4518200640 1 -- start start 2024-01-20T11:07:14.379 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4518200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.379 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4518200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45100d0400 0x7f45100d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.379 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4518200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45100d0d60 con 0x7f451015d5a0 2024-01-20T11:07:14.379 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4518200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100b6d60 con 0x7f45100d0400 2024-01-20T11:07:14.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4518200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100d2730 con 0x7f45100d2250 2024-01-20T11:07:14.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4514e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4516200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45100d0400 0x7f45100d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4515800640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f451015d5a0 0x7f45100b6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:33498/0 (socket says 172.21.15.179:33498) 2024-01-20T11:07:14.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.378+0000 7f4515800640 1 -- 172.21.15.179:0/3786526009 learned_addr learned my addr 172.21.15.179:0/3786526009 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-01-20T11:07:14.382 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.378+0000 7f5a65a2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.379+0000 7f4516200640 1 -- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 msgr2=0x7f45100ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.379+0000 7f4516200640 1 --2- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.379+0000 7f4516200640 1 -- 172.21.15.179:0/3786526009 >> v1:172.21.15.179:6789/0 conn(0x7f451015d5a0 legacy=0x7f45100b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.379+0000 7f4516200640 1 -- 172.21.15.179:0/3786526009 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100d2a10 con 0x7f45100d0400 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.379+0000 7f4514e00640 1 --2- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.379+0000 7f450fe00640 1 -- 172.21.15.179:0/3786526009 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873211746 0 0) 0x7f45100d0d60 con 0x7f451015d5a0 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.380+0000 7f4516200640 1 --2- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f45100d0820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4508009d90 tx=0x7f450802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01322ae904a0354 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.380+0000 7f450fe00640 1 -- 172.21.15.179:0/3786526009 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450802cc60 con 0x7f45100d0400 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.380+0000 7f450fe00640 1 -- 172.21.15.179:0/3786526009 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450802cdc0 con 0x7f45100d0400 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.380+0000 7f450fe00640 1 -- 172.21.15.179:0/3786526009 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508034660 con 0x7f45100d0400 2024-01-20T11:07:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 -- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 msgr2=0x7f45100d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 --2- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f45100d0820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4508009d90 tx=0x7f450802beb0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 -- 172.21.15.179:0/3786526009 shutdown_connections 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 --2- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f45100d0820 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 --2- 172.21.15.179:0/3786526009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 -- 172.21.15.179:0/3786526009 >> 172.21.15.179:0/3786526009 conn(0x7f4510066760 msgr2=0x7f4510066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 -- 172.21.15.179:0/3786526009 shutdown_connections 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.381+0000 7f4518200640 1 -- 172.21.15.179:0/3786526009 wait complete. 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.383+0000 7f4518200640 1 Processor -- start 2024-01-20T11:07:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.383+0000 7f4518200640 1 -- start start 2024-01-20T11:07:14.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4518200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f451014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4518200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4518200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f451015d5a0 0x7f451015be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4518200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100ca5f0 con 0x7f451015d5a0 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4518200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c8530 con 0x7f45100d0400 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4518200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c8810 con 0x7f45100d2250 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4515800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f451014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4514e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4515800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f451014c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:57036/0 (socket says 172.21.15.179:57036) 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4515800640 1 -- 172.21.15.179:0/1543310044 learned_addr learned my addr 172.21.15.179:0/1543310044 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4516200640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f451015d5a0 0x7f451015be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4514e00640 1 -- 172.21.15.179:0/1543310044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 msgr2=0x7f451014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4514e00640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f451014c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4514e00640 1 -- 172.21.15.179:0/1543310044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f451015d5a0 msgr2=0x7f451015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4514e00640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f451015d5a0 0x7f451015be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.384+0000 7f4514e00640 1 -- 172.21.15.179:0/1543310044 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8009400 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f4514e00640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100c9880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e900 tx=0x7f44f800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f450d600640 1 -- 172.21.15.179:0/1543310044 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800ca00 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f450d600640 1 -- 172.21.15.179:0/1543310044 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800cb60 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f450d600640 1 -- 172.21.15.179:0/1543310044 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8013470 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4508009a70 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45100c8dd0 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f450d600640 1 -- 172.21.15.179:0/1543310044 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f44f8005990 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.385+0000 7f450d600640 1 -- 172.21.15.179:0/1543310044 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f44f8013e40 con 0x7f45100d2250 2024-01-20T11:07:14.389 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.386+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100ca730 con 0x7f45100d2250 2024-01-20T11:07:14.390 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.389+0000 7f450d600640 1 -- 172.21.15.179:0/1543310044 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f45100ca730 con 0x7f45100d2250 2024-01-20T11:07:14.421 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.420+0000 7f53cf83c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-20T11:07:14.433 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.431+0000 7f5a65a2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-20T11:07:14.468 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.467+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1313e521-b516-4b4f-a4fc-bafe7fd242a0", "id": 2} v 0) v1 -- 0x7f451004e970 con 0x7f45100d2250 2024-01-20T11:07:14.475 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.474+0000 7f450d600640 1 -- 172.21.15.179:0/1543310044 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1313e521-b516-4b4f-a4fc-bafe7fd242a0", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f44f8029020 con 0x7f45100d2250 2024-01-20T11:07:14.476 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-01-20T11:07:14.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 msgr2=0x7f45100c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100c9880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e900 tx=0x7f44f800edc0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 shutdown_connections 2024-01-20T11:07:14.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f451015d5a0 0x7f451015be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45100d2250 0x7f45100c9880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 --2- 172.21.15.179:0/1543310044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45100d0400 0x7f451014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 >> 172.21.15.179:0/1543310044 conn(0x7f4510066760 msgr2=0x7f4510160ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:14.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 shutdown_connections 2024-01-20T11:07:14.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.476+0000 7f4518200640 1 -- 172.21.15.179:0/1543310044 wait complete. 2024-01-20T11:07:14.478 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.477+0000 7f53cf83c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-20T11:07:14.492 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.491+0000 7f5a65a2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-20T11:07:14.493 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new cae2210e-7938-4e34-a453-5ee2645537eb 3 2024-01-20T11:07:14.541 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.539+0000 7f53cf83c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-20T11:07:14.547 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.545+0000 7f5a65a2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-20T11:07:14.600 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:14.599+0000 7f53cf83c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-20T11:07:14.731 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.730+0000 7fd1f4c00640 1 Processor -- start 2024-01-20T11:07:14.731 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.730+0000 7fd1f4c00640 1 -- start start 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.731+0000 7fd1f4c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd1f015d5a0 0x7fd1f00b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.731+0000 7fd1f4c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1f00d2250 0x7fd1f00ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.731+0000 7fd1f4c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f00d2730 con 0x7fd1f00d0400 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.731+0000 7fd1f4c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f00d2a10 con 0x7fd1f015d5a0 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.731+0000 7fd1f4c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f00d2cf0 con 0x7fd1f00d2250 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.731+0000 7fd1ed400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1f00d2250 0x7fd1f00ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.732+0000 7fd1ed400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1f00d2250 0x7fd1f00ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:42364/0 (socket says 172.21.15.179:42364) 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.732+0000 7fd1ed400640 1 -- 172.21.15.179:0/1768964346 learned_addr learned my addr 172.21.15.179:0/1768964346 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.732+0000 7fd1ee800640 1 --1- 172.21.15.179:0/1768964346 >> v1:172.21.15.179:6789/0 conn(0x7fd1f00d0400 0x7fd1f00d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41106/0 (socket says 172.21.15.179:41106) 2024-01-20T11:07:14.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.732+0000 7fd1ed400640 1 -- 172.21.15.179:0/1768964346 >> v2:172.21.15.162:3300/0 conn(0x7fd1f015d5a0 msgr2=0x7fd1f00b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:14.734 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.732+0000 7fd1ed400640 1 --2- 172.21.15.179:0/1768964346 >> v2:172.21.15.162:3300/0 conn(0x7fd1f015d5a0 0x7fd1f00b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.734 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.732+0000 7fd1ed400640 1 -- 172.21.15.179:0/1768964346 >> v1:172.21.15.179:6789/0 conn(0x7fd1f00d0400 legacy=0x7fd1f00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.734 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.732+0000 7fd1ed400640 1 -- 172.21.15.179:0/1768964346 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00d2fd0 con 0x7fd1f00d2250 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.733+0000 7fd1ed400640 1 --2- 172.21.15.179:0/1768964346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f00ce580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00b50b0 tx=0x7fd1d802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7370bd3e8f6f6e39 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.733+0000 7fd1eca00640 1 -- 172.21.15.179:0/1768964346 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8030860 con 0x7fd1f00d2250 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.733+0000 7fd1eca00640 1 -- 172.21.15.179:0/1768964346 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d80309c0 con 0x7fd1f00d2250 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.733+0000 7fd1eca00640 1 -- 172.21.15.179:0/1768964346 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8030d50 con 0x7fd1f00d2250 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 -- 172.21.15.179:0/1768964346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 msgr2=0x7fd1f00ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 --2- 172.21.15.179:0/1768964346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f00ce580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00b50b0 tx=0x7fd1d802b9a0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 -- 172.21.15.179:0/1768964346 shutdown_connections 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 --2- 172.21.15.179:0/1768964346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f00ce580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 --2- 172.21.15.179:0/1768964346 >> v2:172.21.15.162:3300/0 conn(0x7fd1f015d5a0 0x7fd1f00b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 -- 172.21.15.179:0/1768964346 >> 172.21.15.179:0/1768964346 conn(0x7fd1f0066760 msgr2=0x7fd1f0066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:14.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 -- 172.21.15.179:0/1768964346 shutdown_connections 2024-01-20T11:07:14.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.734+0000 7fd1f4c00640 1 -- 172.21.15.179:0/1768964346 wait complete. 2024-01-20T11:07:14.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.736+0000 7fd1f4c00640 1 Processor -- start 2024-01-20T11:07:14.737 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.736+0000 7fd1f4c00640 1 -- start start 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1f4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f00d0400 0x7fd1f00b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1f4c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f01e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1f4c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1f015d5a0 0x7fd1f01e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1f4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01e88a0 con 0x7fd1f00d0400 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1f4c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01e7c90 con 0x7fd1f00d2250 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1f4c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01e7f70 con 0x7fd1f015d5a0 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1ed400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f01e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1ee800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1f015d5a0 0x7fd1f01e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.740 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1ed400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f01e71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:42370/0 (socket says 172.21.15.179:42370) 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1ed400640 1 -- 172.21.15.179:0/3507936420 learned_addr learned my addr 172.21.15.179:0/3507936420 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.737+0000 7fd1ede00640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f00d0400 0x7fd1f00b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1ed400640 1 -- 172.21.15.179:0/3507936420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1f015d5a0 msgr2=0x7fd1f01e8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1ed400640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1f015d5a0 0x7fd1f01e8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1ed400640 1 -- 172.21.15.179:0/3507936420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f00d0400 msgr2=0x7fd1f00b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1ed400640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f00d0400 0x7fd1f00b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1ed400640 1 -- 172.21.15.179:0/3507936420 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d80094d0 con 0x7fd1f00d2250 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1ede00640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f00d0400 0x7fd1f00b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1ed400640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f01e71d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8000c00 tx=0x7fd1d8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1e6000640 1 -- 172.21.15.179:0/3507936420 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8030830 con 0x7fd1f00d2250 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1e6000640 1 -- 172.21.15.179:0/3507936420 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8043400 con 0x7fd1f00d2250 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f01e8250 con 0x7fd1f00d2250 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1e6000640 1 -- 172.21.15.179:0/3507936420 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80437b0 con 0x7fd1f00d2250 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.738+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f00b1c10 con 0x7fd1f00d2250 2024-01-20T11:07:14.741 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.739+0000 7fd1e6000640 1 -- 172.21.15.179:0/3507936420 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fd1d8043c90 con 0x7fd1f00d2250 2024-01-20T11:07:14.742 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.739+0000 7fd1e6000640 1 -- 172.21.15.179:0/3507936420 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fd1d803e070 con 0x7fd1f00d2250 2024-01-20T11:07:14.742 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.739+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f01e8a10 con 0x7fd1f00d2250 2024-01-20T11:07:14.743 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.742+0000 7fd1e6000640 1 -- 172.21.15.179:0/3507936420 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fd1d8034070 con 0x7fd1f00d2250 2024-01-20T11:07:14.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.819+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cae2210e-7938-4e34-a453-5ee2645537eb", "id": 3} v 0) v1 -- 0x7fd1f004e970 con 0x7fd1f00d2250 2024-01-20T11:07:14.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.826+0000 7fd1e6000640 1 -- 172.21.15.179:0/3507936420 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cae2210e-7938-4e34-a453-5ee2645537eb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1d804d530 con 0x7fd1f00d2250 2024-01-20T11:07:14.827 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-01-20T11:07:14.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 msgr2=0x7fd1f01e71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:14.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f01e71d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8000c00 tx=0x7fd1d8004730 comp rx=0 tx=0).stop 2024-01-20T11:07:14.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 shutdown_connections 2024-01-20T11:07:14.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1f015d5a0 0x7fd1f01e8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1f00d2250 0x7fd1f01e71d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 --2- 172.21.15.179:0/3507936420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f00d0400 0x7fd1f00b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:14.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 >> 172.21.15.179:0/3507936420 conn(0x7fd1f0066760 msgr2=0x7fd1f015dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:14.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 shutdown_connections 2024-01-20T11:07:14.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:14.827+0000 7fd1f4c00640 1 -- 172.21.15.179:0/3507936420 wait complete. 2024-01-20T11:07:14.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 77b3aa4d-2013-4d10-b8ed-591a88d2666d 4 2024-01-20T11:07:14.992 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:14.991+0000 7f5a65a2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-20T11:07:15.021 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.020+0000 7f258ec00640 1 Processor -- start 2024-01-20T11:07:15.021 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.020+0000 7f258ec00640 1 -- start start 2024-01-20T11:07:15.023 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258ec00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f258806a600 0x7f258806a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.023 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258ec00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2588161730 0x7f25880ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.023 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258ec00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258806f360 con 0x7f258806f7f0 2024-01-20T11:07:15.023 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258ec00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258806eb00 con 0x7f258806a600 2024-01-20T11:07:15.023 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258ec00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258806af20 con 0x7f2588161730 2024-01-20T11:07:15.023 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258ce00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f258806f7f0 0x7f2588161020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41114/0 (socket says 172.21.15.179:41114) 2024-01-20T11:07:15.024 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258ce00640 1 -- 172.21.15.179:0/3622614146 learned_addr learned my addr 172.21.15.179:0/3622614146 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-01-20T11:07:15.024 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258e200640 1 --2- 172.21.15.179:0/3622614146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2588161730 0x7f25880ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.024 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.022+0000 7f258d800640 1 --2- 172.21.15.179:0/3622614146 >> v2:172.21.15.162:3300/0 conn(0x7f258806a600 0x7f258806a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.024 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.023+0000 7f2587e00640 1 -- 172.21.15.179:0/3622614146 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463502057 0 0) 0x7f258806f360 con 0x7f258806f7f0 2024-01-20T11:07:15.024 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.023+0000 7f2587e00640 1 -- 172.21.15.179:0/3622614146 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2568003520 con 0x7f258806f7f0 2024-01-20T11:07:15.024 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.023+0000 7f258e200640 1 -- 172.21.15.179:0/3622614146 >> v2:172.21.15.162:3300/0 conn(0x7f258806a600 msgr2=0x7f258806a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:15.025 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.023+0000 7f258e200640 1 --2- 172.21.15.179:0/3622614146 >> v2:172.21.15.162:3300/0 conn(0x7f258806a600 0x7f258806a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.025 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.023+0000 7f258e200640 1 -- 172.21.15.179:0/3622614146 >> v1:172.21.15.179:6789/0 conn(0x7f258806f7f0 legacy=0x7f2588161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.025 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.023+0000 7f258e200640 1 -- 172.21.15.179:0/3622614146 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588161d10 con 0x7f2588161730 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.024+0000 7f258e200640 1 --2- 172.21.15.179:0/3622614146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2588161730 0x7f25880ad7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2580009d90 tx=0x7f258002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a824813548d3a2b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.024+0000 7f2587e00640 1 -- 172.21.15.179:0/3622614146 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258002cc50 con 0x7f2588161730 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.024+0000 7f2587e00640 1 -- 172.21.15.179:0/3622614146 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258002cdb0 con 0x7f2588161730 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.024+0000 7f2587e00640 1 -- 172.21.15.179:0/3622614146 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580034660 con 0x7f2588161730 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 -- 172.21.15.179:0/3622614146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2588161730 msgr2=0x7f25880ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 --2- 172.21.15.179:0/3622614146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2588161730 0x7f25880ad7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2580009d90 tx=0x7f258002bea0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 -- 172.21.15.179:0/3622614146 shutdown_connections 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 --2- 172.21.15.179:0/3622614146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2588161730 0x7f25880ad7d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.026 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 --2- 172.21.15.179:0/3622614146 >> v2:172.21.15.162:3300/0 conn(0x7f258806a600 0x7f258806a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.027 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 -- 172.21.15.179:0/3622614146 >> 172.21.15.179:0/3622614146 conn(0x7f258806d5a0 msgr2=0x7f258806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:15.027 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 -- 172.21.15.179:0/3622614146 shutdown_connections 2024-01-20T11:07:15.027 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.025+0000 7f258ec00640 1 -- 172.21.15.179:0/3622614146 wait complete. 2024-01-20T11:07:15.027 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.027+0000 7f258ec00640 1 Processor -- start 2024-01-20T11:07:15.027 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.027+0000 7f258ec00640 1 -- start start 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258ec00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258806a600 0x7f2588147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258ec00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258806f7f0 0x7f2588143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2588161730 0x7f258815f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25881f72a0 con 0x7f2588161730 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258ec00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2588144430 con 0x7f258806f7f0 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258ec00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25881f6620 con 0x7f258806a600 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258806a600 0x7f2588147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.030 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258806a600 0x7f2588147640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45964/0 (socket says 172.21.15.179:45964) 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 -- 172.21.15.179:0/3098782855 learned_addr learned my addr 172.21.15.179:0/3098782855 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258ce00640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258806f7f0 0x7f2588143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258e200640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2588161730 0x7f258815f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 -- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258806f7f0 msgr2=0x7f2588143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258806f7f0 0x7f2588143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 -- 172.21.15.179:0/3098782855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2588161730 msgr2=0x7f258815f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2588161730 0x7f258815f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.028+0000 7f258d800640 1 -- 172.21.15.179:0/3098782855 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580009a70 con 0x7f258806a600 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f258d800640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258806a600 0x7f2588147640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f257800e9b0 tx=0x7f257800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f2585600640 1 -- 172.21.15.179:0/3098782855 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578009670 con 0x7f258806a600 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f2585600640 1 -- 172.21.15.179:0/3098782855 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257800c9a0 con 0x7f258806a600 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f2585600640 1 -- 172.21.15.179:0/3098782855 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257800cd50 con 0x7f258806a600 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25881f6900 con 0x7f258806a600 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25881f6ec0 con 0x7f258806a600 2024-01-20T11:07:15.031 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f2585600640 1 -- 172.21.15.179:0/3098782855 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f2578005990 con 0x7f258806a600 2024-01-20T11:07:15.032 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.029+0000 7f2585600640 1 -- 172.21.15.179:0/3098782855 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2578006530 con 0x7f258806a600 2024-01-20T11:07:15.032 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.030+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25880b0f20 con 0x7f258806a600 2024-01-20T11:07:15.033 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.032+0000 7f2585600640 1 -- 172.21.15.179:0/3098782855 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f2578021060 con 0x7f258806a600 2024-01-20T11:07:15.078 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.077+0000 7f53cf83c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-20T11:07:15.111 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.110+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "77b3aa4d-2013-4d10-b8ed-591a88d2666d", "id": 4} v 0) v1 -- 0x7f2588074a30 con 0x7f258806a600 2024-01-20T11:07:15.118 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.117+0000 7f2585600640 1 -- 172.21.15.179:0/3098782855 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77b3aa4d-2013-4d10-b8ed-591a88d2666d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2578029020 con 0x7f258806a600 2024-01-20T11:07:15.119 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258806a600 msgr2=0x7f2588147640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258806a600 0x7f2588147640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f257800e9b0 tx=0x7f257800ee70 comp rx=0 tx=0).stop 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 shutdown_connections 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2588161730 0x7f258815f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258806f7f0 0x7f2588143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 --2- 172.21.15.179:0/3098782855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258806a600 0x7f2588147640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 >> 172.21.15.179:0/3098782855 conn(0x7f258806d5a0 msgr2=0x7f25880b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:15.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 shutdown_connections 2024-01-20T11:07:15.121 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.119+0000 7f258ec00640 1 -- 172.21.15.179:0/3098782855 wait complete. 2024-01-20T11:07:15.137 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new d17d29a2-c4be-43ba-81d0-53f275c718ab 5 2024-01-20T11:07:15.153 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.151+0000 7f5a65a2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-20T11:07:15.249 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.248+0000 7f53cf83c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-20T11:07:15.297 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.296+0000 7f5a65a2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-20T11:07:15.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.317+0000 7f45d3000640 1 Processor -- start 2024-01-20T11:07:15.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.317+0000 7f45d3000640 1 -- start start 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.318+0000 7f45d3000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc15d610 0x7f45cc0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.318+0000 7f45d3000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45cc0d3e90 0x7f45cc0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.318+0000 7f45d3000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc15d9f0 con 0x7f45cc0d1870 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d3000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc0cea90 con 0x7f45cc0d3e90 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d3000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0ce0f0 con 0x7f45cc15d610 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc15d610 0x7f45cc0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45cc0d3e90 0x7f45cc0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc15d610 0x7f45cc0ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45974/0 (socket says 172.21.15.179:45974) 2024-01-20T11:07:15.321 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1c00640 1 -- 172.21.15.179:0/3695046876 learned_addr learned my addr 172.21.15.179:0/3695046876 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:15.321 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1c00640 1 -- 172.21.15.179:0/3695046876 >> v2:172.21.15.179:3300/0 conn(0x7f45cc0d3e90 msgr2=0x7f45cc0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:15.321 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1c00640 1 --2- 172.21.15.179:0/3695046876 >> v2:172.21.15.179:3300/0 conn(0x7f45cc0d3e90 0x7f45cc0d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.321 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1c00640 1 -- 172.21.15.179:0/3695046876 >> v1:172.21.15.162:6789/0 conn(0x7f45cc0d1870 legacy=0x7f45cc0c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:15.321 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.319+0000 7f45d1c00640 1 -- 172.21.15.179:0/3695046876 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0ce3d0 con 0x7f45cc15d610 2024-01-20T11:07:15.322 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.320+0000 7f45d1c00640 1 --2- 172.21.15.179:0/3695046876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc15d610 0x7f45cc0ceeb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009870 tx=0x7f45bc02b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d24c834bf166476 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.322 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.320+0000 7f45cbe00640 1 -- 172.21.15.179:0/3695046876 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc031740 con 0x7f45cc15d610 2024-01-20T11:07:15.322 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45cbe00640 1 -- 172.21.15.179:0/3695046876 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc0318a0 con 0x7f45cc15d610 2024-01-20T11:07:15.322 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45cbe00640 1 -- 172.21.15.179:0/3695046876 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc031c30 con 0x7f45cc15d610 2024-01-20T11:07:15.322 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 -- 172.21.15.179:0/3695046876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc15d610 msgr2=0x7f45cc0ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.322 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 --2- 172.21.15.179:0/3695046876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc15d610 0x7f45cc0ceeb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009870 tx=0x7f45bc02b7e0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.322 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 -- 172.21.15.179:0/3695046876 shutdown_connections 2024-01-20T11:07:15.323 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 --2- 172.21.15.179:0/3695046876 >> v2:172.21.15.179:3300/0 conn(0x7f45cc0d3e90 0x7f45cc0d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.323 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 --2- 172.21.15.179:0/3695046876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc15d610 0x7f45cc0ceeb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.323 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 -- 172.21.15.179:0/3695046876 >> 172.21.15.179:0/3695046876 conn(0x7f45cc09c5d0 msgr2=0x7f45cc0d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:15.323 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 -- 172.21.15.179:0/3695046876 shutdown_connections 2024-01-20T11:07:15.323 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.321+0000 7f45d3000640 1 -- 172.21.15.179:0/3695046876 wait complete. 2024-01-20T11:07:15.325 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.324+0000 7f45d3000640 1 Processor -- start 2024-01-20T11:07:15.325 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.324+0000 7f45d3000640 1 -- start start 2024-01-20T11:07:15.328 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.325+0000 7f45d3000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45cc0d1870 0x7f45cc157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.328 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d3000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc0d3e90 0x7f45cc1f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.328 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d3000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45cc15d610 0x7f45cc1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.328 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d3000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc157f90 con 0x7f45cc0d1870 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d3000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc156ea0 con 0x7f45cc15d610 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d3000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc158ae0 con 0x7f45cc0d3e90 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d1200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc0d3e90 0x7f45cc1f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d1200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc0d3e90 0x7f45cc1f3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45986/0 (socket says 172.21.15.179:45986) 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d2600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45cc15d610 0x7f45cc1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d1200640 1 -- 172.21.15.179:0/2621837913 learned_addr learned my addr 172.21.15.179:0/2621837913 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d1c00640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45cc0d1870 0x7f45cc157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d2600640 1 -- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc0d3e90 msgr2=0x7f45cc1f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d2600640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc0d3e90 0x7f45cc1f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d2600640 1 -- 172.21.15.179:0/2621837913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45cc0d1870 msgr2=0x7f45cc157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d2600640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45cc0d1870 0x7f45cc157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d2600640 1 -- 172.21.15.179:0/2621837913 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0094d0 con 0x7f45cc15d610 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.326+0000 7f45d1200640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc0d3e90 0x7f45cc1f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45d2600640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45cc15d610 0x7f45cc1f3b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45c400be00 tx=0x7f45c400bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.329 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45c9600640 1 -- 172.21.15.179:0/2621837913 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400ce70 con 0x7f45cc15d610 2024-01-20T11:07:15.330 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45c9600640 1 -- 172.21.15.179:0/2621837913 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c4003970 con 0x7f45cc15d610 2024-01-20T11:07:15.330 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45c9600640 1 -- 172.21.15.179:0/2621837913 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4003d60 con 0x7f45cc15d610 2024-01-20T11:07:15.330 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc158dc0 con 0x7f45cc15d610 2024-01-20T11:07:15.330 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc159380 con 0x7f45cc15d610 2024-01-20T11:07:15.330 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45c9600640 1 -- 172.21.15.179:0/2621837913 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f45c4004260 con 0x7f45cc15d610 2024-01-20T11:07:15.330 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.327+0000 7f45c9600640 1 -- 172.21.15.179:0/2621837913 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f45c4014d00 con 0x7f45cc15d610 2024-01-20T11:07:15.330 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.328+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45cc074a30 con 0x7f45cc15d610 2024-01-20T11:07:15.333 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.332+0000 7f45c9600640 1 -- 172.21.15.179:0/2621837913 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f45c4022060 con 0x7f45cc15d610 2024-01-20T11:07:15.350 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.348+0000 7f5a65a2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-20T11:07:15.389 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.388+0000 7f53cf83c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-20T11:07:15.411 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.410+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d17d29a2-c4be-43ba-81d0-53f275c718ab", "id": 5} v 0) v1 -- 0x7f45cc0d0840 con 0x7f45cc15d610 2024-01-20T11:07:15.418 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.417+0000 7f45c9600640 1 -- 172.21.15.179:0/2621837913 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d17d29a2-c4be-43ba-81d0-53f275c718ab", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f45c40045e0 con 0x7f45cc15d610 2024-01-20T11:07:15.418 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-01-20T11:07:15.418 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45cc15d610 msgr2=0x7f45cc1f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.419 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45cc15d610 0x7f45cc1f3b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45c400be00 tx=0x7f45c400bef0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.419 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 shutdown_connections 2024-01-20T11:07:15.419 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45cc15d610 0x7f45cc1f3b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.419 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45cc0d3e90 0x7f45cc1f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.419 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 --2- 172.21.15.179:0/2621837913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45cc0d1870 0x7f45cc157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.419 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 >> 172.21.15.179:0/2621837913 conn(0x7f45cc09c5d0 msgr2=0x7f45cc0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:15.420 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 shutdown_connections 2024-01-20T11:07:15.420 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.418+0000 7f45d3000640 1 -- 172.21.15.179:0/2621837913 wait complete. 2024-01-20T11:07:15.435 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new a0fc21ba-e59e-4e41-bbf3-e3cf462352e3 6 2024-01-20T11:07:15.445 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.444+0000 7f53cf83c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-20T11:07:15.459 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.457+0000 7f5a65a2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-20T11:07:15.561 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.560+0000 7f53cf83c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-20T11:07:15.568 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.566+0000 7f5a65a2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-20T11:07:15.622 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.621+0000 7f433e600640 1 Processor -- start 2024-01-20T11:07:15.622 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.621+0000 7f433e600640 1 -- start start 2024-01-20T11:07:15.624 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.622+0000 7f433e600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f43381609b0 0x7f433806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.624 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.622+0000 7f433e600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43380d2050 0x7f43380d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.624 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.622+0000 7f433e600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43380cf3b0 con 0x7f43380cfd10 2024-01-20T11:07:15.624 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.622+0000 7f433e600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43380d06c0 con 0x7f43381609b0 2024-01-20T11:07:15.624 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.622+0000 7f433e600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43380cedf0 con 0x7f43380d2050 2024-01-20T11:07:15.624 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f43381609b0 0x7f433806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.624 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f43381609b0 0x7f433806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:42420/0 (socket says 172.21.15.179:42420) 2024-01-20T11:07:15.625 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337400640 1 -- 172.21.15.179:0/1110764183 learned_addr learned my addr 172.21.15.179:0/1110764183 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:15.625 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337e00640 1 --2- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43380d2050 0x7f43380d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.625 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337400640 1 -- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43380d2050 msgr2=0x7f43380d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:15.625 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337400640 1 --2- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43380d2050 0x7f43380d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.625 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337400640 1 -- 172.21.15.179:0/1110764183 >> v1:172.21.15.162:6789/0 conn(0x7f43380cfd10 legacy=0x7f43380d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:15.625 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.623+0000 7f4337400640 1 -- 172.21.15.179:0/1110764183 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380cf0d0 con 0x7f43381609b0 2024-01-20T11:07:15.625 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.625+0000 7f4337400640 1 --2- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43381609b0 0x7f433806b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4328009870 tx=0x7f432802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3931499a40ea1420 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.626 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.625+0000 7f4336a00640 1 -- 172.21.15.179:0/1110764183 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280317c0 con 0x7f43381609b0 2024-01-20T11:07:15.626 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.625+0000 7f4336a00640 1 -- 172.21.15.179:0/1110764183 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328031920 con 0x7f43381609b0 2024-01-20T11:07:15.626 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.625+0000 7f4336a00640 1 -- 172.21.15.179:0/1110764183 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328031cb0 con 0x7f43381609b0 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 -- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43381609b0 msgr2=0x7f433806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 --2- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43381609b0 0x7f433806b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4328009870 tx=0x7f432802b860 comp rx=0 tx=0).stop 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 -- 172.21.15.179:0/1110764183 shutdown_connections 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 --2- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43380d2050 0x7f43380d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 --2- 172.21.15.179:0/1110764183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43381609b0 0x7f433806b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 -- 172.21.15.179:0/1110764183 >> 172.21.15.179:0/1110764183 conn(0x7f433809c7d0 msgr2=0x7f43380d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 -- 172.21.15.179:0/1110764183 shutdown_connections 2024-01-20T11:07:15.627 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.626+0000 7f433e600640 1 -- 172.21.15.179:0/1110764183 wait complete. 2024-01-20T11:07:15.628 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.628+0000 7f433e600640 1 Processor -- start 2024-01-20T11:07:15.628 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.628+0000 7f433e600640 1 -- start start 2024-01-20T11:07:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f433e600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43380cfd10 0x7f43380b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f433e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43380d2050 0x7f43380caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f433e600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43381609b0 0x7f43380cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f433e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c85e0 con 0x7f43380d2050 2024-01-20T11:07:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f433e600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380cb870 con 0x7f43380cfd10 2024-01-20T11:07:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f433e600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c7cb0 con 0x7f43381609b0 2024-01-20T11:07:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43380cfd10 0x7f43380b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43380cfd10 0x7f43380b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:42424/0 (socket says 172.21.15.179:42424) 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 -- 172.21.15.179:0/4009796942 learned_addr learned my addr 172.21.15.179:0/4009796942 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337e00640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43381609b0 0x7f43380cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f432fe00640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43380d2050 0x7f43380caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 -- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43381609b0 msgr2=0x7f43380cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43381609b0 0x7f43380cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 -- 172.21.15.179:0/4009796942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43380d2050 msgr2=0x7f43380caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43380d2050 0x7f43380caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f4337400640 1 -- 172.21.15.179:0/4009796942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280094d0 con 0x7f43380cfd10 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.629+0000 7f432fe00640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43380d2050 0x7f43380caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f4337400640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43380cfd10 0x7f43380b6ea0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4328000c00 tx=0x7f43280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f432f400640 1 -- 172.21.15.179:0/4009796942 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328032860 con 0x7f43380cfd10 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f432f400640 1 -- 172.21.15.179:0/4009796942 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280329e0 con 0x7f43380cfd10 2024-01-20T11:07:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43380c7f90 con 0x7f43380cfd10 2024-01-20T11:07:15.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f432f400640 1 -- 172.21.15.179:0/4009796942 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328032d90 con 0x7f43380cfd10 2024-01-20T11:07:15.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43380b73e0 con 0x7f43380cfd10 2024-01-20T11:07:15.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f432f400640 1 -- 172.21.15.179:0/4009796942 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f432804e450 con 0x7f43380cfd10 2024-01-20T11:07:15.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.630+0000 7f432f400640 1 -- 172.21.15.179:0/4009796942 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4328045b20 con 0x7f43380cfd10 2024-01-20T11:07:15.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.631+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433804e970 con 0x7f43380cfd10 2024-01-20T11:07:15.634 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.633+0000 7f432f400640 1 -- 172.21.15.179:0/4009796942 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f4328045530 con 0x7f43380cfd10 2024-01-20T11:07:15.681 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.680+0000 7f53cf83c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-20T11:07:15.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.712+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a0fc21ba-e59e-4e41-bbf3-e3cf462352e3", "id": 6} v 0) v1 -- 0x7f43380b2c80 con 0x7f43380cfd10 2024-01-20T11:07:15.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.720+0000 7f432f400640 1 -- 172.21.15.179:0/4009796942 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0fc21ba-e59e-4e41-bbf3-e3cf462352e3", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f43280456d0 con 0x7f43380cfd10 2024-01-20T11:07:15.721 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-01-20T11:07:15.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43380cfd10 msgr2=0x7f43380b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43380cfd10 0x7f43380b6ea0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4328000c00 tx=0x7f43280046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 shutdown_connections 2024-01-20T11:07:15.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43381609b0 0x7f43380cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43380d2050 0x7f43380caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 --2- 172.21.15.179:0/4009796942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43380cfd10 0x7f43380b6ea0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 >> 172.21.15.179:0/4009796942 conn(0x7f433809c7d0 msgr2=0x7f43380b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:15.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 shutdown_connections 2024-01-20T11:07:15.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.721+0000 7f433e600640 1 -- 172.21.15.179:0/4009796942 wait complete. 2024-01-20T11:07:15.728 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.726+0000 7f5a65a2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-20T11:07:15.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 20e916ea-78fb-4575-8a9a-b9eeda5f91b4 7 2024-01-20T11:07:15.776 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.775+0000 7f5a65a2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-20T11:07:15.848 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.847+0000 7f53cf83c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-20T11:07:15.901 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:15.900+0000 7f53cf83c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-20T11:07:15.930 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:15.929+0000 7f5a65a2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-20T11:07:15.968 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.967+0000 7f3dece00640 1 Processor -- start 2024-01-20T11:07:15.968 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.967+0000 7f3dece00640 1 -- start start 2024-01-20T11:07:15.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.969+0000 7f3dece00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.969+0000 7f3dece00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3de80cfd10 0x7f3de80d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.969+0000 7f3dece00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80cf3b0 con 0x7f3de80d1940 2024-01-20T11:07:15.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.969+0000 7f3dece00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80d0690 con 0x7f3de80cfd10 2024-01-20T11:07:15.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.969+0000 7f3dece00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80cedf0 con 0x7f3de81609b0 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3ddd200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3de80cfd10 0x7f3de80d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3de5e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3de5e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:46018/0 (socket says 172.21.15.179:46018) 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3de5e00640 1 -- 172.21.15.179:0/1438889945 learned_addr learned my addr 172.21.15.179:0/1438889945 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3de5e00640 1 -- 172.21.15.179:0/1438889945 >> v2:172.21.15.179:3300/0 conn(0x7f3de80cfd10 msgr2=0x7f3de80d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3de5e00640 1 --2- 172.21.15.179:0/1438889945 >> v2:172.21.15.179:3300/0 conn(0x7f3de80cfd10 0x7f3de80d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3de5e00640 1 -- 172.21.15.179:0/1438889945 >> v1:172.21.15.162:6789/0 conn(0x7f3de80d1940 legacy=0x7f3de80d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3de5e00640 1 -- 172.21.15.179:0/1438889945 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80cf0d0 con 0x7f3de81609b0 2024-01-20T11:07:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.970+0000 7f3ddd200640 1 --2- 172.21.15.179:0/1438889945 >> v2:172.21.15.179:3300/0 conn(0x7f3de80cfd10 0x7f3de80d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.971+0000 7f3de5e00640 1 --2- 172.21.15.179:0/1438889945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de806b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009870 tx=0x7f3dd802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2fa341564fd258e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.971+0000 7f3de5400640 1 -- 172.21.15.179:0/1438889945 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80317c0 con 0x7f3de81609b0 2024-01-20T11:07:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3de5400640 1 -- 172.21.15.179:0/1438889945 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd8031920 con 0x7f3de81609b0 2024-01-20T11:07:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3de5400640 1 -- 172.21.15.179:0/1438889945 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8031cb0 con 0x7f3de81609b0 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 -- 172.21.15.179:0/1438889945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 msgr2=0x7f3de806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 --2- 172.21.15.179:0/1438889945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de806b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009870 tx=0x7f3dd802b860 comp rx=0 tx=0).stop 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 -- 172.21.15.179:0/1438889945 shutdown_connections 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 --2- 172.21.15.179:0/1438889945 >> v2:172.21.15.179:3300/0 conn(0x7f3de80cfd10 0x7f3de80d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 --2- 172.21.15.179:0/1438889945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de806b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 -- 172.21.15.179:0/1438889945 >> 172.21.15.179:0/1438889945 conn(0x7f3de809c7d0 msgr2=0x7f3de80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 -- 172.21.15.179:0/1438889945 shutdown_connections 2024-01-20T11:07:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.972+0000 7f3dece00640 1 -- 172.21.15.179:0/1438889945 wait complete. 2024-01-20T11:07:15.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.974+0000 7f3dece00640 1 Processor -- start 2024-01-20T11:07:15.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.974+0000 7f3dece00640 1 -- start start 2024-01-20T11:07:15.977 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3dece00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3de80cfd10 0x7f3de81f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.977 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3dece00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de80d1940 0x7f3de81f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.977 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3dece00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de80cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3dece00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8150eb0 con 0x7f3de80d1940 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3dece00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81f3df0 con 0x7f3de80cfd10 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3dece00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81f4020 con 0x7f3de81609b0 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3de5e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3de80cfd10 0x7f3de81f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3de5e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3de80cfd10 0x7f3de81f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:42446/0 (socket says 172.21.15.179:42446) 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3de5e00640 1 -- 172.21.15.179:0/489846769 learned_addr learned my addr 172.21.15.179:0/489846769 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3de6800640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de80cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.975+0000 7f3ddd200640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de80d1940 0x7f3de81f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3de5e00640 1 -- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 msgr2=0x7f3de80cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3de5e00640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de80cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3de5e00640 1 -- 172.21.15.179:0/489846769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de80d1940 msgr2=0x7f3de81f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3de5e00640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de80d1940 0x7f3de81f38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3de5e00640 1 -- 172.21.15.179:0/489846769 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0009400 con 0x7f3de80cfd10 2024-01-20T11:07:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3de5e00640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3de80cfd10 0x7f3de81f4d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3dd802b8a0 tx=0x7f3dd80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3ddea00640 1 -- 172.21.15.179:0/489846769 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8032860 con 0x7f3de80cfd10 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3ddea00640 1 -- 172.21.15.179:0/489846769 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd8032a00 con 0x7f3de80cfd10 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3ddea00640 1 -- 172.21.15.179:0/489846769 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8032db0 con 0x7f3de80cfd10 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.976+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd80094d0 con 0x7f3de80cfd10 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.977+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de81f45e0 con 0x7f3de80cfd10 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.978+0000 7f3ddea00640 1 -- 172.21.15.179:0/489846769 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f3dd8005990 con 0x7f3de80cfd10 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.978+0000 7f3ddea00640 1 -- 172.21.15.179:0/489846769 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f3dd8006700 con 0x7f3de80cfd10 2024-01-20T11:07:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.978+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de804e970 con 0x7f3de80cfd10 2024-01-20T11:07:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:15.980+0000 7f3ddea00640 1 -- 172.21.15.179:0/489846769 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f3dd8005dd0 con 0x7f3de80cfd10 2024-01-20T11:07:16.058 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.057+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "20e916ea-78fb-4575-8a9a-b9eeda5f91b4", "id": 7} v 0) v1 -- 0x7f3de80b2c80 con 0x7f3de80cfd10 2024-01-20T11:07:16.065 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.064+0000 7f3ddea00640 1 -- 172.21.15.179:0/489846769 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20e916ea-78fb-4575-8a9a-b9eeda5f91b4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3dd8005f70 con 0x7f3de80cfd10 2024-01-20T11:07:16.065 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-01-20T11:07:16.066 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.065+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3de80cfd10 msgr2=0x7f3de81f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.065+0000 7f3dece00640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3de80cfd10 0x7f3de81f4d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3dd802b8a0 tx=0x7f3dd80046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.065+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 shutdown_connections 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.065+0000 7f3dece00640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3de81609b0 0x7f3de80cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.065+0000 7f3dece00640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de80d1940 0x7f3de81f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.065+0000 7f3dece00640 1 --2- 172.21.15.179:0/489846769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3de80cfd10 0x7f3de81f4d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.065+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 >> 172.21.15.179:0/489846769 conn(0x7f3de809c7d0 msgr2=0x7f3de80b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.066+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 shutdown_connections 2024-01-20T11:07:16.067 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-20T11:07:16.066+0000 7f3dece00640 1 -- 172.21.15.179:0/489846769 wait complete. 2024-01-20T11:07:16.069 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:16.068+0000 7f53cf83c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-20T11:07:16.082 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-20T11:07:16.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-20T11:07:16.090 INFO:tasks.ceph.osd.0:Started 2024-01-20T11:07:16.090 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-20T11:07:16.090 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-20T11:07:16.097 INFO:tasks.ceph.osd.1:Started 2024-01-20T11:07:16.097 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-20T11:07:16.097 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-20T11:07:16.102 INFO:tasks.ceph.osd.2:Started 2024-01-20T11:07:16.102 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-20T11:07:16.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-20T11:07:16.108 INFO:tasks.ceph.osd.3:Started 2024-01-20T11:07:16.108 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-20T11:07:16.108 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-20T11:07:16.118 INFO:tasks.ceph.osd.4:Started 2024-01-20T11:07:16.118 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-20T11:07:16.118 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-20T11:07:16.125 INFO:tasks.ceph.osd.5:Started 2024-01-20T11:07:16.125 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-20T11:07:16.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-20T11:07:16.129 INFO:tasks.ceph.osd.6:Started 2024-01-20T11:07:16.130 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-20T11:07:16.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-20T11:07:16.136 INFO:tasks.ceph.osd.7:Started 2024-01-20T11:07:16.137 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:16.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.343+0000 7f7c05a00640 1 Processor -- start 2024-01-20T11:07:16.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.343+0000 7f7c05a00640 1 -- start start 2024-01-20T11:07:16.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7c05a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c000cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:16.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7c05a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c000b55b0 0x7f7c000ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:16.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7c05a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0006ce20 con 0x7f7c0006d040 2024-01-20T11:07:16.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7c05a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0006c210 con 0x7f7c000b55b0 2024-01-20T11:07:16.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7c05a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0006c4f0 con 0x7f7c000b51d0 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7bfe000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c000b55b0 0x7f7c000ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7bfea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c000cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.344+0000 7f7bff400640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7c0006d040 0x7f7c00161770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:56144/0 (socket says 172.21.15.162:56144) 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.345+0000 7f7bff400640 1 -- 172.21.15.162:0/4080597775 learned_addr learned my addr 172.21.15.162:0/4080597775 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.345+0000 7f7bfe000640 1 -- 172.21.15.162:0/4080597775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 msgr2=0x7f7c000cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.345+0000 7f7bfe000640 1 --2- 172.21.15.162:0/4080597775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c000cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.345+0000 7f7bfe000640 1 -- 172.21.15.162:0/4080597775 >> v1:172.21.15.179:6789/0 conn(0x7f7c0006d040 legacy=0x7f7c00161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.345+0000 7f7bfe000640 1 -- 172.21.15.162:0/4080597775 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0006c7d0 con 0x7f7c000b55b0 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.345+0000 7f7bfd600640 1 -- 172.21.15.162:0/4080597775 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869327563 0 0) 0x7f7c0006ce20 con 0x7f7c0006d040 2024-01-20T11:07:16.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.345+0000 7f7bfea00640 1 --2- 172.21.15.162:0/4080597775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c000cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:16.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.346+0000 7f7bfe000640 1 --2- 172.21.15.162:0/4080597775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c000b55b0 0x7f7c000ce3a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097a0 tx=0x7f7be802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceae58b375cce2e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:16.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.346+0000 7f7bfd600640 1 -- 172.21.15.162:0/4080597775 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8031780 con 0x7f7c000b55b0 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.346+0000 7f7bfd600640 1 -- 172.21.15.162:0/4080597775 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80318e0 con 0x7f7c000b55b0 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.346+0000 7f7bfd600640 1 -- 172.21.15.162:0/4080597775 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8031c70 con 0x7f7c000b55b0 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 -- 172.21.15.162:0/4080597775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c000b55b0 msgr2=0x7f7c000ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 --2- 172.21.15.162:0/4080597775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c000b55b0 0x7f7c000ce3a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097a0 tx=0x7f7be802b820 comp rx=0 tx=0).stop 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 -- 172.21.15.162:0/4080597775 shutdown_connections 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 --2- 172.21.15.162:0/4080597775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c000b55b0 0x7f7c000ce3a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 --2- 172.21.15.162:0/4080597775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c000cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 -- 172.21.15.162:0/4080597775 >> 172.21.15.162:0/4080597775 conn(0x7f7c0009c790 msgr2=0x7f7c000d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 -- 172.21.15.162:0/4080597775 shutdown_connections 2024-01-20T11:07:16.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.347+0000 7f7c05a00640 1 -- 172.21.15.162:0/4080597775 wait complete. 2024-01-20T11:07:16.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.349+0000 7f7c05a00640 1 Processor -- start 2024-01-20T11:07:16.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.349+0000 7f7c05a00640 1 -- start start 2024-01-20T11:07:16.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7c05a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0006d040 0x7f7c000b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:16.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7c05a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c001f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:16.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7c05a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c000b55b0 0x7f7c000cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:16.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7c05a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000b7690 con 0x7f7c0006d040 2024-01-20T11:07:16.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7c05a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c001f3d70 con 0x7f7c000b55b0 2024-01-20T11:07:16.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7c05a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00150330 con 0x7f7c000b51d0 2024-01-20T11:07:16.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7bfea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0006d040 0x7f7c000b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7bfea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0006d040 0x7f7c000b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:50960/0 (socket says 172.21.15.162:50960) 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7bfea00640 1 -- 172.21.15.162:0/987728324 learned_addr learned my addr 172.21.15.162:0/987728324 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7bfe000640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c001f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.350+0000 7f7bff400640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c000b55b0 0x7f7c000cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bfea00640 1 -- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 msgr2=0x7f7c001f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bfea00640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c001f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bfea00640 1 -- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c000b55b0 msgr2=0x7f7c000cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bfea00640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c000b55b0 0x7f7c000cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bfea00640 1 -- 172.21.15.162:0/987728324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0009400 con 0x7f7c0006d040 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bfea00640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0006d040 0x7f7c000b7150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000ebe0 tx=0x7f7bf000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bf6a00640 1 -- 172.21.15.162:0/987728324 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0009760 con 0x7f7c0006d040 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bf6a00640 1 -- 172.21.15.162:0/987728324 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf000cc30 con 0x7f7c0006d040 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bf6a00640 1 -- 172.21.15.162:0/987728324 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000eee0 con 0x7f7c0006d040 2024-01-20T11:07:16.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be8009400 con 0x7f7c0006d040 2024-01-20T11:07:16.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c000b7e40 con 0x7f7c0006d040 2024-01-20T11:07:16.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.351+0000 7f7bf6a00640 1 -- 172.21.15.162:0/987728324 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f7bf0013470 con 0x7f7c0006d040 2024-01-20T11:07:16.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.352+0000 7f7bf6a00640 1 -- 172.21.15.162:0/987728324 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7bf0013df0 con 0x7f7c0006d040 2024-01-20T11:07:16.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.352+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0004e970 con 0x7f7c0006d040 2024-01-20T11:07:16.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.355+0000 7f7bf6a00640 1 -- 172.21.15.162:0/987728324 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f7bf0021060 con 0x7f7c0006d040 2024-01-20T11:07:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.419+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c000ce800 con 0x7f7c0006d040 2024-01-20T11:07:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.420+0000 7f7bf6a00640 1 -- 172.21.15.162:0/987728324 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f7bf002a020 con 0x7f7c0006d040 2024-01-20T11:07:16.422 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:16.422 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":10,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:16.060191+0000","last_up_change":"0.000000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.421+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0006d040 msgr2=0x7f7c000b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.421+0000 7f7c05a00640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0006d040 0x7f7c000b7150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000ebe0 tx=0x7f7bf000c520 comp rx=0 tx=0).stop 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.421+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 shutdown_connections 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.421+0000 7f7c05a00640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c000b55b0 0x7f7c000cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.421+0000 7f7c05a00640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c000b51d0 0x7f7c001f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.421+0000 7f7c05a00640 1 --2- 172.21.15.162:0/987728324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0006d040 0x7f7c000b7150 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.421+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 >> 172.21.15.162:0/987728324 conn(0x7f7c0009c790 msgr2=0x7f7c000b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.422+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 shutdown_connections 2024-01-20T11:07:16.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:16.422+0000 7f7c05a00640 1 -- 172.21.15.162:0/987728324 wait complete. 2024-01-20T11:07:16.438 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-20T11:07:16.438 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-20T11:07:16.801 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-01-20T11:07:16.800+0000 7f3560b85640 -1 Falling back to public interface 2024-01-20T11:07:16.802 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-01-20T11:07:16.801+0000 7f72831fd640 -1 Falling back to public interface 2024-01-20T11:07:16.802 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-01-20T11:07:16.801+0000 7f25a3211640 -1 Falling back to public interface 2024-01-20T11:07:16.808 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-01-20T11:07:16.807+0000 7fdb4fa0e640 -1 Falling back to public interface 2024-01-20T11:07:16.811 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-01-20T11:07:16.810+0000 7f25a1600640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6819/0: (98) Address already in use 2024-01-20T11:07:16.812 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-01-20T11:07:16.811+0000 7ff2d7ab3640 -1 Falling back to public interface 2024-01-20T11:07:16.820 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-01-20T11:07:16.819+0000 7f89364a8640 -1 Falling back to public interface 2024-01-20T11:07:16.823 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-01-20T11:07:16.822+0000 7f800ef11640 -1 Falling back to public interface 2024-01-20T11:07:16.847 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-01-20T11:07:16.846+0000 7fd25d037640 -1 Falling back to public interface 2024-01-20T11:07:17.057 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:17.055+0000 7f5a65a2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-20T11:07:17.168 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:17.167+0000 7f53cf83c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-20T11:07:17.244 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:17.368 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:17.366+0000 7f5a65a2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-20T11:07:17.396 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.394+0000 7f8c0b600640 1 Processor -- start 2024-01-20T11:07:17.396 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.395+0000 7f8c0b600640 1 -- start start 2024-01-20T11:07:17.398 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c0b600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c0406de10 0x7f8c040b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:17.398 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c0b600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0415c840 con 0x7f8c040ad900 2024-01-20T11:07:17.398 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c0b600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c04155e90 con 0x7f8c0406d960 2024-01-20T11:07:17.398 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c0b600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0415ba20 con 0x7f8c0406de10 2024-01-20T11:07:17.398 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c08c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8c040ad900 0x7f8c040ac240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:60738/0 (socket says 172.21.15.162:60738) 2024-01-20T11:07:17.398 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c08c00640 1 -- 172.21.15.162:0/3141484480 learned_addr learned my addr 172.21.15.162:0/3141484480 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:17.398 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c09600640 1 --2- 172.21.15.162:0/3141484480 >> v2:172.21.15.179:3300/0 conn(0x7f8c0406de10 0x7f8c040b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:17.399 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c03e00640 1 -- 172.21.15.162:0/3141484480 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395720059 0 0) 0x7f8c0415c840 con 0x7f8c040ad900 2024-01-20T11:07:17.399 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.396+0000 7f8c03e00640 1 -- 172.21.15.162:0/3141484480 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be4003520 con 0x7f8c040ad900 2024-01-20T11:07:17.399 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.397+0000 7f8c03e00640 1 -- 172.21.15.162:0/3141484480 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230492977 0 0) 0x7f8c04155e90 con 0x7f8c0406d960 2024-01-20T11:07:17.399 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.397+0000 7f8c03e00640 1 -- 172.21.15.162:0/3141484480 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c0415c840 con 0x7f8c0406d960 2024-01-20T11:07:17.399 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.397+0000 7f8c09600640 1 -- 172.21.15.162:0/3141484480 >> v1:172.21.15.179:6789/0 conn(0x7f8c0406d960 legacy=0x7f8c040b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:17.399 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.397+0000 7f8c09600640 1 -- 172.21.15.162:0/3141484480 >> v1:172.21.15.162:6789/0 conn(0x7f8c040ad900 legacy=0x7f8c040ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:17.399 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.397+0000 7f8c09600640 1 -- 172.21.15.162:0/3141484480 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040ac950 con 0x7f8c0406de10 2024-01-20T11:07:17.400 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.398+0000 7f8c09600640 1 --2- 172.21.15.162:0/3141484480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c0406de10 0x7f8c040b2b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009d90 tx=0x7f8bfc02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e959b9edde184a4b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:17.400 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.398+0000 7f8c03e00640 1 -- 172.21.15.162:0/3141484480 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc02cd00 con 0x7f8c0406de10 2024-01-20T11:07:17.400 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.398+0000 7f8c03e00640 1 -- 172.21.15.162:0/3141484480 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc02ce60 con 0x7f8c0406de10 2024-01-20T11:07:17.400 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.398+0000 7f8c03e00640 1 -- 172.21.15.162:0/3141484480 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc034660 con 0x7f8c0406de10 2024-01-20T11:07:17.401 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.399+0000 7f8c0b600640 1 -- 172.21.15.162:0/3141484480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c0406de10 msgr2=0x7f8c040b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:17.401 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.399+0000 7f8c0b600640 1 --2- 172.21.15.162:0/3141484480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c0406de10 0x7f8c040b2b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009d90 tx=0x7f8bfc02bf50 comp rx=0 tx=0).stop 2024-01-20T11:07:17.401 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.399+0000 7f8c0b600640 1 -- 172.21.15.162:0/3141484480 shutdown_connections 2024-01-20T11:07:17.401 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.399+0000 7f8c0b600640 1 --2- 172.21.15.162:0/3141484480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c0406de10 0x7f8c040b2b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:17.401 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.399+0000 7f8c0b600640 1 -- 172.21.15.162:0/3141484480 >> 172.21.15.162:0/3141484480 conn(0x7f8c0406a610 msgr2=0x7f8c0406aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:17.401 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.399+0000 7f8c0b600640 1 -- 172.21.15.162:0/3141484480 shutdown_connections 2024-01-20T11:07:17.401 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.399+0000 7f8c0b600640 1 -- 172.21.15.162:0/3141484480 wait complete. 2024-01-20T11:07:17.402 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.400+0000 7f8c0b600640 1 Processor -- start 2024-01-20T11:07:17.402 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.401+0000 7f8c0b600640 1 -- start start 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.401+0000 7f8c0b600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c0406d960 0x7f8c040af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.401+0000 7f8c0b600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c0406de10 0x7f8c04156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.401+0000 7f8c0b600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c040ad900 0x7f8c04156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.401+0000 7f8c0b600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b0780 con 0x7f8c0406d960 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.401+0000 7f8c0b600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b01c0 con 0x7f8c040ad900 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.401+0000 7f8c0b600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b04a0 con 0x7f8c0406de10 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c08c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c0406d960 0x7f8c040af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c08c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c0406d960 0x7f8c040af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46668/0 (socket says 172.21.15.162:46668) 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c08c00640 1 -- 172.21.15.162:0/220378870 learned_addr learned my addr 172.21.15.162:0/220378870 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8bfbe00640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c0406de10 0x7f8c04156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c09600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c040ad900 0x7f8c04156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c09600640 1 -- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c0406de10 msgr2=0x7f8c04156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c09600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c0406de10 0x7f8c04156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:17.404 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c09600640 1 -- 172.21.15.162:0/220378870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c0406d960 msgr2=0x7f8c040af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:17.405 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c09600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c0406d960 0x7f8c040af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:17.405 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c09600640 1 -- 172.21.15.162:0/220378870 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc009a70 con 0x7f8c040ad900 2024-01-20T11:07:17.405 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c08c00640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c0406d960 0x7f8c040af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:17.405 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8bfbe00640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c0406de10 0x7f8c04156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:17.405 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.402+0000 7f8c09600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c040ad900 0x7f8c04156590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc033000 tx=0x7f8bfc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.403+0000 7f8c01600640 1 -- 172.21.15.162:0/220378870 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc03d600 con 0x7f8c040ad900 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.403+0000 7f8c01600640 1 -- 172.21.15.162:0/220378870 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc03d760 con 0x7f8c040ad900 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.403+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c04151880 con 0x7f8c040ad900 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.403+0000 7f8c01600640 1 -- 172.21.15.162:0/220378870 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc03db10 con 0x7f8c040ad900 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.403+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0414db90 con 0x7f8c040ad900 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.403+0000 7f8c01600640 1 -- 172.21.15.162:0/220378870 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f8bfc03b040 con 0x7f8c040ad900 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.403+0000 7f8c01600640 1 -- 172.21.15.162:0/220378870 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8bfc03ca30 con 0x7f8c040ad900 2024-01-20T11:07:17.406 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.404+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c041516e0 con 0x7f8c040ad900 2024-01-20T11:07:17.410 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.408+0000 7f8c01600640 1 -- 172.21.15.162:0/220378870 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f8c041516e0 con 0x7f8c040ad900 2024-01-20T11:07:17.432 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:17.431+0000 7f5a65a2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-20T11:07:17.474 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.472+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c040b05e0 con 0x7f8c040ad900 2024-01-20T11:07:17.475 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.474+0000 7f8c01600640 1 -- 172.21.15.162:0/220378870 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f8c040b05e0 con 0x7f8c040ad900 2024-01-20T11:07:17.475 INFO:teuthology.misc.health.smithi162.stdout: 2024-01-20T11:07:17.476 INFO:teuthology.misc.health.smithi162.stdout:{"epoch":10,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:16.060191+0000","last_up_change":"0.000000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:17.476 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c040ad900 msgr2=0x7f8c04156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c040ad900 0x7f8c04156590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc033000 tx=0x7f8bfc004a40 comp rx=0 tx=0).stop 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 shutdown_connections 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c040ad900 0x7f8c04156590 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c0406de10 0x7f8c04156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 --2- 172.21.15.162:0/220378870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c0406d960 0x7f8c040af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 >> 172.21.15.162:0/220378870 conn(0x7f8c0406a610 msgr2=0x7f8c04154210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 shutdown_connections 2024-01-20T11:07:17.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:17.475+0000 7f8c0b600640 1 -- 172.21.15.162:0/220378870 wait complete. 2024-01-20T11:07:17.478 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:17.477+0000 7f53cf83c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-20T11:07:17.488 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-20T11:07:17.538 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:17.537+0000 7f53cf83c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-20T11:07:17.551 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:17.549+0000 7f5a65a2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-20T11:07:17.664 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-01-20T11:07:17.663+0000 7f53cf83c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-20T11:07:18.607 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:18.606+0000 7f5a06200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-20T11:07:18.614 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-01-20T11:07:18.613+0000 7f5a06200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-20T11:07:20.338 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-01-20T11:07:20.337+0000 7f72831fd640 -1 osd.5 0 log_to_monitors true 2024-01-20T11:07:20.352 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-01-20T11:07:20.352+0000 7fdb4fa0e640 -1 osd.0 0 log_to_monitors true 2024-01-20T11:07:20.376 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-01-20T11:07:20.375+0000 7f3560b85640 -1 osd.6 0 log_to_monitors true 2024-01-20T11:07:20.387 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-01-20T11:07:20.386+0000 7fd25d037640 -1 osd.7 0 log_to_monitors true 2024-01-20T11:07:20.395 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-01-20T11:07:20.395+0000 7ff2d7ab3640 -1 osd.3 0 log_to_monitors true 2024-01-20T11:07:20.632 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-01-20T11:07:20.631+0000 7f25a3211640 -1 osd.4 0 log_to_monitors true 2024-01-20T11:07:20.648 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-01-20T11:07:20.648+0000 7f89364a8640 -1 osd.1 0 log_to_monitors true 2024-01-20T11:07:20.663 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-01-20T11:07:20.662+0000 7f800ef11640 -1 osd.2 0 log_to_monitors true 2024-01-20T11:07:23.341 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-01-20T11:07:23.341+0000 7fdb49800640 -1 osd.0 0 waiting for initial osdmap 2024-01-20T11:07:23.346 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-01-20T11:07:23.345+0000 7ff2d3e00640 -1 osd.3 0 waiting for initial osdmap 2024-01-20T11:07:23.360 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-01-20T11:07:23.359+0000 7fdb40200640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:23.361 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-01-20T11:07:23.360+0000 7ff2c8a00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:23.656 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-01-20T11:07:23.655+0000 7fd259200640 -1 osd.7 0 waiting for initial osdmap 2024-01-20T11:07:23.666 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-01-20T11:07:23.665+0000 7fd24de00640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:23.666 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-01-20T11:07:23.666+0000 7f727d600640 -1 osd.5 0 waiting for initial osdmap 2024-01-20T11:07:23.676 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-01-20T11:07:23.675+0000 7f7274000640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:23.707 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-01-20T11:07:23.707+0000 7f355b000640 -1 osd.6 0 waiting for initial osdmap 2024-01-20T11:07:23.723 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-01-20T11:07:23.721+0000 7f3551a00640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:24.121 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-01-20T11:07:24.120+0000 7f259d000640 -1 osd.4 0 waiting for initial osdmap 2024-01-20T11:07:24.129 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-01-20T11:07:24.128+0000 7f2593a00640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:24.232 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-01-20T11:07:24.232+0000 7f8009400640 -1 osd.2 0 waiting for initial osdmap 2024-01-20T11:07:24.240 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-01-20T11:07:24.239+0000 7f7fffe00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:24.243 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-01-20T11:07:24.243+0000 7f8932800640 -1 osd.1 0 waiting for initial osdmap 2024-01-20T11:07:24.263 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-01-20T11:07:24.263+0000 7f8927400640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T11:07:24.296 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:24.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.477+0000 7f91cfc00640 1 Processor -- start 2024-01-20T11:07:24.477 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.477+0000 7f91cfc00640 1 -- start start 2024-01-20T11:07:24.480 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.478+0000 7f91cfc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c80ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.480 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.478+0000 7f91cfc00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91c80ad340 0x7f91c806d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.480 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.478+0000 7f91cfc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f91c8071480 0x7f91c806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.480 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.478+0000 7f91cfc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80ae480 con 0x7f91c8071480 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.478+0000 7f91cfc00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80ad800 con 0x7f91c80ad340 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.478+0000 7f91cfc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80adae0 con 0x7f91c815d5d0 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f91c8071480 0x7f91c806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f91c8071480 0x7f91c806dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46768/0 (socket says 172.21.15.162:46768) 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 -- 172.21.15.162:0/341668525 learned_addr learned my addr 172.21.15.162:0/341668525 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91bfe00640 1 --2- 172.21.15.162:0/341668525 >> v2:172.21.15.179:3300/0 conn(0x7f91c80ad340 0x7f91c806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cd200640 1 --2- 172.21.15.162:0/341668525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c80ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 -- 172.21.15.162:0/341668525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 msgr2=0x7f91c80ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 --2- 172.21.15.162:0/341668525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c80ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 -- 172.21.15.162:0/341668525 >> v2:172.21.15.179:3300/0 conn(0x7f91c80ad340 msgr2=0x7f91c806d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 --2- 172.21.15.162:0/341668525 >> v2:172.21.15.179:3300/0 conn(0x7f91c80ad340 0x7f91c806d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.481 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91cdc00640 1 -- 172.21.15.162:0/341668525 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80addc0 con 0x7f91c8071480 2024-01-20T11:07:24.482 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.479+0000 7f91bfe00640 1 --2- 172.21.15.162:0/341668525 >> v2:172.21.15.179:3300/0 conn(0x7f91c80ad340 0x7f91c806d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:24.483 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.480+0000 7f91cdc00640 1 --2- 172.21.15.162:0/341668525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c806dea0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91c806c8a0 tx=0x7f91c002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d44dd50932980a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:24.483 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91c7e00640 1 -- 172.21.15.162:0/341668525 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c002ca80 con 0x7f91c8071480 2024-01-20T11:07:24.483 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91c7e00640 1 -- 172.21.15.162:0/341668525 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c002cbe0 con 0x7f91c8071480 2024-01-20T11:07:24.483 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91c7e00640 1 -- 172.21.15.162:0/341668525 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00343f0 con 0x7f91c8071480 2024-01-20T11:07:24.483 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 -- 172.21.15.162:0/341668525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 msgr2=0x7f91c806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 --2- 172.21.15.162:0/341668525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c806dea0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91c806c8a0 tx=0x7f91c002bee0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 -- 172.21.15.162:0/341668525 shutdown_connections 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 --2- 172.21.15.162:0/341668525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c806dea0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 --2- 172.21.15.162:0/341668525 >> v2:172.21.15.179:3300/0 conn(0x7f91c80ad340 0x7f91c806d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 --2- 172.21.15.162:0/341668525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c80ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 -- 172.21.15.162:0/341668525 >> 172.21.15.162:0/341668525 conn(0x7f91c806a610 msgr2=0x7f91c806aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 -- 172.21.15.162:0/341668525 shutdown_connections 2024-01-20T11:07:24.484 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.481+0000 7f91cfc00640 1 -- 172.21.15.162:0/341668525 wait complete. 2024-01-20T11:07:24.486 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.483+0000 7f91cfc00640 1 Processor -- start 2024-01-20T11:07:24.486 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.483+0000 7f91cfc00640 1 -- start start 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cfc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cfc00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c80ad340 0x7f91c814a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cfc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c81f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cfc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c814d910 con 0x7f91c8071480 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cfc00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c814ce00 con 0x7f91c80ad340 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cfc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c814add0 con 0x7f91c815d5d0 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cd200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cd200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c814c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46776/0 (socket says 172.21.15.162:46776) 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.484+0000 7f91cd200640 1 -- 172.21.15.162:0/822260392 learned_addr learned my addr 172.21.15.162:0/822260392 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91bfe00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c80ad340 0x7f91c814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.487 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cdc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c81f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cd200640 1 -- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 msgr2=0x7f91c81f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cd200640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c81f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cd200640 1 -- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c80ad340 msgr2=0x7f91c814a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cd200640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c80ad340 0x7f91c814a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cd200640 1 -- 172.21.15.162:0/822260392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009b30 con 0x7f91c8071480 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cdc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c81f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91bfe00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c80ad340 0x7f91c814a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cd200640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c814c8c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c850 tx=0x7f91b800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91c5600640 1 -- 172.21.15.162:0/822260392 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8004020 con 0x7f91c8071480 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91c5600640 1 -- 172.21.15.162:0/822260392 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b8004180 con 0x7f91c8071480 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91c5600640 1 -- 172.21.15.162:0/822260392 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8007830 con 0x7f91c8071480 2024-01-20T11:07:24.488 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.485+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c814d070 con 0x7f91c8071480 2024-01-20T11:07:24.489 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.486+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c814d630 con 0x7f91c8071480 2024-01-20T11:07:24.490 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.487+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c804e970 con 0x7f91c8071480 2024-01-20T11:07:24.490 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.487+0000 7f91c5600640 1 -- 172.21.15.162:0/822260392 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f91b8007990 con 0x7f91c8071480 2024-01-20T11:07:24.490 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.488+0000 7f91c5600640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f91a006ae40 0x7f91a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.490 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.488+0000 7f91c5600640 1 -- 172.21.15.162:0/822260392 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f91b8088d10 con 0x7f91c8071480 2024-01-20T11:07:24.490 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.488+0000 7f91bfe00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f91a006ae40 0x7f91a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.490 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.489+0000 7f91bfe00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f91a006ae40 0x7f91a006d300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91c806cb70 tx=0x7f91b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:24.494 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.494+0000 7f91c5600640 1 -- 172.21.15.162:0/822260392 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f91b808f080 con 0x7f91c8071480 2024-01-20T11:07:24.678 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.677+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91c8160a40 con 0x7f91c8071480 2024-01-20T11:07:24.679 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.679+0000 7f91c5600640 1 -- 172.21.15.162:0/822260392 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10933 (secure 0 0 0) 0x7f91b801e090 con 0x7f91c8071480 2024-01-20T11:07:24.679 INFO:teuthology.misc.health.smithi162.stdout: 2024-01-20T11:07:24.680 INFO:teuthology.misc.health.smithi162.stdout:{"epoch":14,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:24.360601+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:24.682 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f91a006ae40 msgr2=0x7f91a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.682 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f91a006ae40 0x7f91a006d300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91c806cb70 tx=0x7f91b0008040 comp rx=0 tx=0).stop 2024-01-20T11:07:24.682 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 msgr2=0x7f91c814c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c814c8c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c850 tx=0x7f91b800cd10 comp rx=0 tx=0).stop 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 shutdown_connections 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c815d5d0 0x7f91c81f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f91a006ae40 0x7f91a006d300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c80ad340 0x7f91c814a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 --2- 172.21.15.162:0/822260392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91c8071480 0x7f91c814c8c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.681+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 >> 172.21.15.162:0/822260392 conn(0x7f91c806a610 msgr2=0x7f91c806d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.682+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 shutdown_connections 2024-01-20T11:07:24.683 INFO:teuthology.misc.health.smithi162.stderr:2024-01-20T11:07:24.682+0000 7f91cfc00640 1 -- 172.21.15.162:0/822260392 wait complete. 2024-01-20T11:07:24.696 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-20T11:07:24.696 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-20T11:07:24.696 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-20T11:07:24.696 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-20T11:07:24.703 INFO:tasks.ceph.mds.a:Started 2024-01-20T11:07:24.703 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-20T11:07:24.704 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-20T11:07:24.711 INFO:tasks.ceph.mds.c:Started 2024-01-20T11:07:24.711 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-20T11:07:24.711 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-20T11:07:24.719 INFO:tasks.ceph.mds.b:Started 2024-01-20T11:07:24.719 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-20T11:07:24.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-20T11:07:24.727 INFO:tasks.ceph.mds.d:Started 2024-01-20T11:07:24.727 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-20T11:07:24.728 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:24.850 INFO:tasks.ceph.mds.a.smithi162.stdout:starting mds.a at 2024-01-20T11:07:24.852 INFO:tasks.ceph.mds.c.smithi162.stdout:starting mds.c at 2024-01-20T11:07:24.881 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-01-20T11:07:24.881 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-01-20T11:07:24.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.902+0000 7f65e7e00640 1 Processor -- start 2024-01-20T11:07:24.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.902+0000 7f65e7e00640 1 -- start start 2024-01-20T11:07:24.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65e7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f65e80cfa80 0x7f65e80cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65e7e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f65e80cd9c0 0x7f65e80cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65e7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e815b910 con 0x7f65e813e040 2024-01-20T11:07:24.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65e7e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e815fe00 con 0x7f65e80cfa80 2024-01-20T11:07:24.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65e7e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e815bbf0 con 0x7f65e80cd9c0 2024-01-20T11:07:24.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65e6a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f65e813e040 0x7f65e80cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:60748/0 (socket says 172.21.15.162:60748) 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65dfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f65e80cfa80 0x7f65e80cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.903+0000 7f65e6a00640 1 -- 172.21.15.162:0/708115770 learned_addr learned my addr 172.21.15.162:0/708115770 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.904+0000 7f65e7400640 1 --2- 172.21.15.162:0/708115770 >> v2:172.21.15.179:3300/0 conn(0x7f65e80cd9c0 0x7f65e80cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.904+0000 7f65dfe00640 1 -- 172.21.15.162:0/708115770 >> v2:172.21.15.179:3300/0 conn(0x7f65e80cd9c0 msgr2=0x7f65e80cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.904+0000 7f65dfe00640 1 --2- 172.21.15.162:0/708115770 >> v2:172.21.15.179:3300/0 conn(0x7f65e80cd9c0 0x7f65e80cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.904+0000 7f65dfe00640 1 -- 172.21.15.162:0/708115770 >> v1:172.21.15.162:6789/0 conn(0x7f65e813e040 legacy=0x7f65e80cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.904+0000 7f65dfe00640 1 -- 172.21.15.162:0/708115770 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e815bed0 con 0x7f65e80cfa80 2024-01-20T11:07:24.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.904+0000 7f65e6000640 1 -- 172.21.15.162:0/708115770 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558729821 0 0) 0x7f65e815b910 con 0x7f65e813e040 2024-01-20T11:07:24.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.905+0000 7f65dfe00640 1 --2- 172.21.15.162:0/708115770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e80cfa80 0x7f65e80cb9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65e80aeb50 tx=0x7f65d002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b966d84e386d7d8f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:24.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.905+0000 7f65e6000640 1 -- 172.21.15.162:0/708115770 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d002e070 con 0x7f65e80cfa80 2024-01-20T11:07:24.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.905+0000 7f65e6000640 1 -- 172.21.15.162:0/708115770 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d00315a0 con 0x7f65e80cfa80 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.905+0000 7f65e6000640 1 -- 172.21.15.162:0/708115770 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0031930 con 0x7f65e80cfa80 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.905+0000 7f65e7e00640 1 -- 172.21.15.162:0/708115770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e80cfa80 msgr2=0x7f65e80cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.905+0000 7f65e7e00640 1 --2- 172.21.15.162:0/708115770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e80cfa80 0x7f65e80cb9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65e80aeb50 tx=0x7f65d002b840 comp rx=0 tx=0).stop 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.906+0000 7f65e7e00640 1 -- 172.21.15.162:0/708115770 shutdown_connections 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.906+0000 7f65e7e00640 1 --2- 172.21.15.162:0/708115770 >> v2:172.21.15.179:3300/0 conn(0x7f65e80cd9c0 0x7f65e80cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.906+0000 7f65e7e00640 1 --2- 172.21.15.162:0/708115770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e80cfa80 0x7f65e80cb9d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.906+0000 7f65e7e00640 1 -- 172.21.15.162:0/708115770 >> 172.21.15.162:0/708115770 conn(0x7f65e806aa20 msgr2=0x7f65e806ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.906+0000 7f65e7e00640 1 -- 172.21.15.162:0/708115770 shutdown_connections 2024-01-20T11:07:24.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.906+0000 7f65e7e00640 1 -- 172.21.15.162:0/708115770 wait complete. 2024-01-20T11:07:24.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.907+0000 7f65e7e00640 1 Processor -- start 2024-01-20T11:07:24.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.908+0000 7f65e7e00640 1 -- start start 2024-01-20T11:07:24.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.908+0000 7f65e7e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80cd9c0 0x7f65e813a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.908+0000 7f65e7e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80cfa80 0x7f65e813f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.908+0000 7f65e7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e813e040 0x7f65e813c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.908+0000 7f65e7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8142240 con 0x7f65e813e040 2024-01-20T11:07:24.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.908+0000 7f65e7e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8140050 con 0x7f65e80cfa80 2024-01-20T11:07:24.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e813fd70 con 0x7f65e80cd9c0 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e813e040 0x7f65e813c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e813e040 0x7f65e813c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46824/0 (socket says 172.21.15.162:46824) 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 -- 172.21.15.162:0/3788606620 learned_addr learned my addr 172.21.15.162:0/3788606620 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e6a00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80cd9c0 0x7f65e813a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65dfe00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80cfa80 0x7f65e813f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 -- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80cd9c0 msgr2=0x7f65e813a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80cd9c0 0x7f65e813a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 -- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80cfa80 msgr2=0x7f65e813f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80cfa80 0x7f65e813f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 -- 172.21.15.162:0/3788606620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0009400 con 0x7f65e813e040 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65dfe00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80cfa80 0x7f65e813f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.909+0000 7f65e7400640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e813e040 0x7f65e813c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007e60 tx=0x7f65e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.910+0000 7f65df400640 1 -- 172.21.15.162:0/3788606620 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0014420 con 0x7f65e813e040 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.910+0000 7f65df400640 1 -- 172.21.15.162:0/3788606620 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00145a0 con 0x7f65e813e040 2024-01-20T11:07:24.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.910+0000 7f65df400640 1 -- 172.21.15.162:0/3788606620 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0014950 con 0x7f65e813e040 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.910+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e8141bf0 con 0x7f65e813e040 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.910+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e81f72b0 con 0x7f65e813e040 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.911+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e8141a50 con 0x7f65e813e040 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.912+0000 7f65df400640 1 -- 172.21.15.162:0/3788606620 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f65e0014ab0 con 0x7f65e813e040 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.913+0000 7f65df400640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f65c006ae40 0x7f65c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.913+0000 7f65df400640 1 -- 172.21.15.162:0/3788606620 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f65e0089a20 con 0x7f65e813e040 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.913+0000 7f65e6a00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f65c006ae40 0x7f65c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:24.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.914+0000 7f65e6a00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f65c006ae40 0x7f65c006d300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f60 tx=0x7f65d8007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:24.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:24.917+0000 7f65df400640 1 -- 172.21.15.162:0/3788606620 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f65e8141a50 con 0x7f65e813e040 2024-01-20T11:07:25.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.109+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65e8141a50 con 0x7f65e813e040 2024-01-20T11:07:25.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.110+0000 7f65df400640 1 -- 172.21.15.162:0/3788606620 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10933 (secure 0 0 0) 0x7f65e8141a50 con 0x7f65e813e040 2024-01-20T11:07:25.111 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:25.111 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":14,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:24.360601+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.112+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f65c006ae40 msgr2=0x7f65c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f65c006ae40 0x7f65c006d300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f60 tx=0x7f65d8007b50 comp rx=0 tx=0).stop 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e813e040 msgr2=0x7f65e813c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e813e040 0x7f65e813c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007e60 tx=0x7f65e000e4b0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 shutdown_connections 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e813e040 0x7f65e813c680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f65c006ae40 0x7f65c006d300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80cfa80 0x7f65e813f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 --2- 172.21.15.162:0/3788606620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80cd9c0 0x7f65e813a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 >> 172.21.15.162:0/3788606620 conn(0x7f65e806aa20 msgr2=0x7f65e8070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:25.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 shutdown_connections 2024-01-20T11:07:25.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.113+0000 7f65e7e00640 1 -- 172.21.15.162:0/3788606620 wait complete. 2024-01-20T11:07:25.131 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-01-20T11:07:25.131 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:07:25.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.331+0000 7fad57e00640 1 Processor -- start 2024-01-20T11:07:25.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.332+0000 7fad57e00640 1 -- start start 2024-01-20T11:07:25.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.333+0000 7fad57e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 0x7fad580cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.333+0000 7fad57e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5815b910 con 0x7fad5813e040 2024-01-20T11:07:25.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.333+0000 7fad57e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5815bbf0 con 0x7fad580cd9c0 2024-01-20T11:07:25.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.333+0000 7fad57e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815fe00 con 0x7fad580cfa80 2024-01-20T11:07:25.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.333+0000 7fad56a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fad5813e040 0x7fad580cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:60756/0 (socket says 172.21.15.162:60756) 2024-01-20T11:07:25.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.333+0000 7fad56a00640 1 -- 172.21.15.162:0/1010036215 learned_addr learned my addr 172.21.15.162:0/1010036215 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:25.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003162456 0 0) 0x7fad5815b910 con 0x7fad5813e040 2024-01-20T11:07:25.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad4de00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 0x7fad580cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad38003520 con 0x7fad5813e040 2024-01-20T11:07:25.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747719 0 0) 0x7fad38003520 con 0x7fad5813e040 2024-01-20T11:07:25.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 msgr2=0x7fad580cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:25.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 0x7fad580cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 >> v1:172.21.15.179:6789/0 conn(0x7fad580cd9c0 legacy=0x7fad580cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5815bed0 con 0x7fad5813e040 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fad480019f0 con 0x7fad5813e040 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 >> v1:172.21.15.162:6789/0 conn(0x7fad5813e040 legacy=0x7fad580cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad380039a0 0x7fad38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 0x7fad380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad38004d00 0x7fad38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815fe00 con 0x7fad380039a0 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3800bc00 con 0x7fad38004d00 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.334+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3800bdc0 con 0x7fad580cfa80 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad56a00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad380039a0 0x7fad38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad4de00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 0x7fad380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad56a00640 1 -- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 msgr2=0x7fad380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:25.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad56a00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 0x7fad380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad56a00640 1 -- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad38004d00 msgr2=0x7fad38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:25.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad57400640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad38004d00 0x7fad38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad56a00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad38004d00 0x7fad38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad56a00640 1 -- 172.21.15.162:0/1010036215 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38003520 con 0x7fad380039a0 2024-01-20T11:07:25.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad4de00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad580cfa80 0x7fad380047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:25.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.335+0000 7fad57400640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad38004d00 0x7fad38005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.336+0000 7fad56a00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad380039a0 0x7fad38003dc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad4800a750 tx=0x7fad380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653f7bee40c64ce5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.336+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48034630 con 0x7fad380039a0 2024-01-20T11:07:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.336+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4802f070 con 0x7fad380039a0 2024-01-20T11:07:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad56000640 1 -- 172.21.15.162:0/1010036215 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad480349d0 con 0x7fad380039a0 2024-01-20T11:07:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad57e00640 1 -- 172.21.15.162:0/1010036215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad380039a0 msgr2=0x7fad38003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad57e00640 1 --2- 172.21.15.162:0/1010036215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad380039a0 0x7fad38003dc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad4800a750 tx=0x7fad380057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad57400640 1 -- 172.21.15.162:0/1010036215 reap_dead start 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad57e00640 1 -- 172.21.15.162:0/1010036215 shutdown_connections 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad57e00640 1 -- 172.21.15.162:0/1010036215 >> 172.21.15.162:0/1010036215 conn(0x7fad5806aa20 msgr2=0x7fad5806ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad57e00640 1 -- 172.21.15.162:0/1010036215 shutdown_connections 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.337+0000 7fad57e00640 1 -- 172.21.15.162:0/1010036215 wait complete. 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.339+0000 7fad57e00640 1 Processor -- start 2024-01-20T11:07:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.339+0000 7fad57e00640 1 -- start start 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad380039a0 0x7fad58071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad581e4c50 0x7fad58071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad581e6540 0x7fad5813ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad581e60b0 con 0x7fad581e6540 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad581e54a0 con 0x7fad380039a0 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad581e5780 con 0x7fad581e4c50 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad581e6540 0x7fad5813ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad581e6540 0x7fad5813ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46838/0 (socket says 172.21.15.162:46838) 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.340+0000 7fad57400640 1 -- 172.21.15.162:0/1340290549 learned_addr learned my addr 172.21.15.162:0/1340290549 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad56a00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad380039a0 0x7fad58071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad4de00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad581e4c50 0x7fad58071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad57400640 1 -- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad581e4c50 msgr2=0x7fad58071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad57400640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad581e4c50 0x7fad58071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad57400640 1 -- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad380039a0 msgr2=0x7fad58071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad57400640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad380039a0 0x7fad58071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad57400640 1 -- 172.21.15.162:0/1340290549 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad581e5a60 con 0x7fad581e6540 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad57400640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad581e6540 0x7fad5813ecc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad580ceeb0 tx=0x7fad5000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad4f400640 1 -- 172.21.15.162:0/1340290549 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000b070 con 0x7fad581e6540 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad4f400640 1 -- 172.21.15.162:0/1340290549 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50007030 con 0x7fad581e6540 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad4f400640 1 -- 172.21.15.162:0/1340290549 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500073e0 con 0x7fad581e6540 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.341+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad581e5d40 con 0x7fad581e6540 2024-01-20T11:07:25.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.342+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad580718a0 con 0x7fad581e6540 2024-01-20T11:07:25.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.343+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58074a30 con 0x7fad581e6540 2024-01-20T11:07:25.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.343+0000 7fad4f400640 1 -- 172.21.15.162:0/1340290549 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7fad50007540 con 0x7fad581e6540 2024-01-20T11:07:25.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.344+0000 7fad4f400640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad3006aec0 0x7fad3006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:25.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.344+0000 7fad4f400640 1 -- 172.21.15.162:0/1340290549 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fad50088a40 con 0x7fad581e6540 2024-01-20T11:07:25.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.344+0000 7fad56a00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad3006aec0 0x7fad3006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:25.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.345+0000 7fad56a00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad3006aec0 0x7fad3006d380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad48034000 tx=0x7fad4802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:25.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.349+0000 7fad4f400640 1 -- 172.21.15.162:0/1340290549 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fad50053f30 con 0x7fad581e6540 2024-01-20T11:07:25.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.580+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad581e61f0 con 0x7fad581e6540 2024-01-20T11:07:25.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.581+0000 7fad4f400640 1 -- 172.21.15.162:0/1340290549 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fad50057550 con 0x7fad581e6540 2024-01-20T11:07:25.582 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:25.582 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-20T11:07:25.582 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 2 2024-01-20T11:07:25.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad3006aec0 msgr2=0x7fad3006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad3006aec0 0x7fad3006d380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad48034000 tx=0x7fad4802f000 comp rx=0 tx=0).stop 2024-01-20T11:07:25.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad581e6540 msgr2=0x7fad5813ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad581e6540 0x7fad5813ecc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad580ceeb0 tx=0x7fad5000d890 comp rx=0 tx=0).stop 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 shutdown_connections 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad581e6540 0x7fad5813ecc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad581e4c50 0x7fad58071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad3006aec0 0x7fad3006d380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 --2- 172.21.15.162:0/1340290549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad380039a0 0x7fad58071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 >> 172.21.15.162:0/1340290549 conn(0x7fad5806aa20 msgr2=0x7fad5815e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 shutdown_connections 2024-01-20T11:07:25.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:25.584+0000 7fad57e00640 1 -- 172.21.15.162:0/1340290549 wait complete. 2024-01-20T11:07:27.028 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:07:27.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:07:27.602 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:07:27.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.808+0000 7fdfd5e00640 1 Processor -- start 2024-01-20T11:07:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.808+0000 7fdfd5e00640 1 -- start start 2024-01-20T11:07:27.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.809+0000 7fdfd5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdfd0155a30 0x7fdfd00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.809+0000 7fdfd5e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd0070b60 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.809+0000 7fdfd5e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd015bc00 con 0x7fdfd0070630 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.809+0000 7fdfd5e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd015ba10 con 0x7fdfd0155a30 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdfd0155a30 0x7fdfd00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdfd0155a30 0x7fdfd00ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54382/0 (socket says 172.21.15.162:54382) 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcea00640 1 -- 172.21.15.162:0/2090956322 learned_addr learned my addr 172.21.15.162:0/2090956322 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcf400640 1 --1- 172.21.15.162:0/2090956322 >> v1:172.21.15.162:6789/0 conn(0x7fdfd00ae6b0 0x7fdfd006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44518/0 (socket says 172.21.15.162:44518) 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcea00640 1 -- 172.21.15.162:0/2090956322 >> v1:172.21.15.179:6789/0 conn(0x7fdfd0070630 legacy=0x7fdfd00adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcea00640 1 -- 172.21.15.162:0/2090956322 >> v1:172.21.15.162:6789/0 conn(0x7fdfd00ae6b0 legacy=0x7fdfd006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcea00640 1 -- 172.21.15.162:0/2090956322 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd015bee0 con 0x7fdfd0155a30 2024-01-20T11:07:27.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.810+0000 7fdfcd600640 1 -- 172.21.15.162:0/2090956322 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055926285 0 0) 0x7fdfd0070b60 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.811+0000 7fdfcea00640 1 --2- 172.21.15.162:0/2090956322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd0155a30 0x7fdfd00ce800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009870 tx=0x7fdfc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59778ef30ab70d9c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:27.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfcd600640 1 -- 172.21.15.162:0/2090956322 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0031870 con 0x7fdfd0155a30 2024-01-20T11:07:27.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfcd600640 1 -- 172.21.15.162:0/2090956322 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc00319d0 con 0x7fdfd0155a30 2024-01-20T11:07:27.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfcd600640 1 -- 172.21.15.162:0/2090956322 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0031d60 con 0x7fdfd0155a30 2024-01-20T11:07:27.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfd5e00640 1 -- 172.21.15.162:0/2090956322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd0155a30 msgr2=0x7fdfd00ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:27.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/2090956322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd0155a30 0x7fdfd00ce800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009870 tx=0x7fdfc002b910 comp rx=0 tx=0).stop 2024-01-20T11:07:27.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfd5e00640 1 -- 172.21.15.162:0/2090956322 shutdown_connections 2024-01-20T11:07:27.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/2090956322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd0155a30 0x7fdfd00ce800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:27.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfd5e00640 1 -- 172.21.15.162:0/2090956322 >> 172.21.15.162:0/2090956322 conn(0x7fdfd00b0cd0 msgr2=0x7fdfd00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:27.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfd5e00640 1 -- 172.21.15.162:0/2090956322 shutdown_connections 2024-01-20T11:07:27.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.812+0000 7fdfd5e00640 1 -- 172.21.15.162:0/2090956322 wait complete. 2024-01-20T11:07:27.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.814+0000 7fdfd5e00640 1 Processor -- start 2024-01-20T11:07:27.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.814+0000 7fdfd5e00640 1 -- start start 2024-01-20T11:07:27.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.815+0000 7fdfd5e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfd0070630 0x7fdfd0147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:27.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.815+0000 7fdfd5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd00ae6b0 0x7fdfd00cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:27.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.815+0000 7fdfd5e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfd0155a30 0x7fdfd01443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:27.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.815+0000 7fdfd5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0144cb0 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.815+0000 7fdfd5e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00cb640 con 0x7fdfd0155a30 2024-01-20T11:07:27.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.815+0000 7fdfd5e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00cb360 con 0x7fdfd0070630 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.815+0000 7fdfce000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd00ae6b0 0x7fdfd00cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd00ae6b0 0x7fdfd00cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54390/0 (socket says 172.21.15.162:54390) 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 -- 172.21.15.162:0/196096168 learned_addr learned my addr 172.21.15.162:0/196096168 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfcea00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfd0070630 0x7fdfd0147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfcf400640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfd0155a30 0x7fdfd01443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 -- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfd0070630 msgr2=0x7fdfd0147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfd0070630 0x7fdfd0147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 -- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfd0155a30 msgr2=0x7fdfd01443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfd0155a30 0x7fdfd01443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 -- 172.21.15.162:0/196096168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00094d0 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.816+0000 7fdfce000640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd00ae6b0 0x7fdfd00cab30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c430 tx=0x7fdfb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.817+0000 7fdfc7400640 1 -- 172.21.15.162:0/196096168 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8011790 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.817+0000 7fdfc7400640 1 -- 172.21.15.162:0/196096168 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80118f0 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.817+0000 7fdfc7400640 1 -- 172.21.15.162:0/196096168 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8011ce0 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.817+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd00b1ef0 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.817+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd00b24b0 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.818+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd004e970 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.819+0000 7fdfc7400640 1 -- 172.21.15.162:0/196096168 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7fdfb801c460 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.820+0000 7fdfc7400640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdfa806ae70 0x7fdfa806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:27.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.820+0000 7fdfc7400640 1 -- 172.21.15.162:0/196096168 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdfb80890f0 con 0x7fdfd00ae6b0 2024-01-20T11:07:27.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.820+0000 7fdfcea00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdfa806ae70 0x7fdfa806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:27.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.821+0000 7fdfcea00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdfa806ae70 0x7fdfa806d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0036000 tx=0x7fdfc003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:27.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:27.826+0000 7fdfc7400640 1 -- 172.21.15.162:0/196096168 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdfb80543e0 con 0x7fdfd00ae6b0 2024-01-20T11:07:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.062+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfd006db40 con 0x7fdfd00ae6b0 2024-01-20T11:07:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.063+0000 7fdfc7400640 1 -- 172.21.15.162:0/196096168 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7fdfb8057a00 con 0x7fdfd00ae6b0 2024-01-20T11:07:28.064 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:28.064 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-20T11:07:28.064 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 3 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdfa806ae70 msgr2=0x7fdfa806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdfa806ae70 0x7fdfa806d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0036000 tx=0x7fdfc003c040 comp rx=0 tx=0).stop 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd00ae6b0 msgr2=0x7fdfd00cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd00ae6b0 0x7fdfd00cab30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c430 tx=0x7fdfb800c8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 shutdown_connections 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdfa806ae70 0x7fdfa806d330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfd0155a30 0x7fdfd01443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfd00ae6b0 0x7fdfd00cab30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 --2- 172.21.15.162:0/196096168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfd0070630 0x7fdfd0147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 >> 172.21.15.162:0/196096168 conn(0x7fdfd00b0cd0 msgr2=0x7fdfd00ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 shutdown_connections 2024-01-20T11:07:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.066+0000 7fdfd5e00640 1 -- 172.21.15.162:0/196096168 wait complete. 2024-01-20T11:07:28.086 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:28.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.264+0000 7f4793600640 1 Processor -- start 2024-01-20T11:07:28.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.265+0000 7f4793600640 1 -- start start 2024-01-20T11:07:28.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.266+0000 7f4793600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 0x7f478c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.266+0000 7f4793600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c0cdf20 con 0x7f478c15d4e0 2024-01-20T11:07:28.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.266+0000 7f4793600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c0ce1a0 con 0x7f478c0d2030 2024-01-20T11:07:28.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.266+0000 7f4793600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0d24c0 con 0x7f478c0d37f0 2024-01-20T11:07:28.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.266+0000 7f4790c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f478c15d4e0 0x7f478c0d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44526/0 (socket says 172.21.15.162:44526) 2024-01-20T11:07:28.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.266+0000 7f4790c00640 1 -- 172.21.15.162:0/2876122392 learned_addr learned my addr 172.21.15.162:0/2876122392 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:28.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f4791600640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 0x7f478c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987331732 0 0) 0x7f478c0cdf20 con 0x7f478c15d4e0 2024-01-20T11:07:28.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f476c003520 con 0x7f478c15d4e0 2024-01-20T11:07:28.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2754068932 0 0) 0x7f476c003520 con 0x7f478c15d4e0 2024-01-20T11:07:28.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 msgr2=0x7f478c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:28.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 0x7f478c15d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 >> v1:172.21.15.179:6789/0 conn(0x7f478c0d2030 legacy=0x7f478c0d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0ce460 con 0x7f478c15d4e0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f477c001670 con 0x7f478c15d4e0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 >> v1:172.21.15.162:6789/0 conn(0x7f478c15d4e0 legacy=0x7f478c0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039a0 0x7f476c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f476c0047c0 0x7f476c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 0x7f476c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0d24c0 con 0x7f476c0039a0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c00bab0 con 0x7f476c0047c0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.267+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c00bc70 con 0x7f478c0d37f0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f4790c00640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039a0 0x7f476c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f4791600640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 0x7f476c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f478be00640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f476c0047c0 0x7f476c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f4790c00640 1 -- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 msgr2=0x7f476c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f4790c00640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f478c0d37f0 0x7f476c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f4790c00640 1 -- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f476c0047c0 msgr2=0x7f476c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:28.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f4790c00640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f476c0047c0 0x7f476c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.268+0000 7f4790c00640 1 -- 172.21.15.162:0/2876122392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c003520 con 0x7f476c0039a0 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.269+0000 7f4790c00640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039a0 0x7f476c003dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c190 tx=0x7f476c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cb5941f978646a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.269+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c005ad0 con 0x7f476c0039a0 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.269+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c005c30 con 0x7f476c0039a0 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.269+0000 7f478b400640 1 -- 172.21.15.162:0/2876122392 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c02c8a0 con 0x7f476c0039a0 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.270+0000 7f4793600640 1 -- 172.21.15.162:0/2876122392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039a0 msgr2=0x7f476c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.270+0000 7f4793600640 1 --2- 172.21.15.162:0/2876122392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c0039a0 0x7f476c003dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c190 tx=0x7f476c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.270+0000 7f4791600640 1 -- 172.21.15.162:0/2876122392 reap_dead start 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.270+0000 7f4793600640 1 -- 172.21.15.162:0/2876122392 shutdown_connections 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.270+0000 7f4793600640 1 -- 172.21.15.162:0/2876122392 >> 172.21.15.162:0/2876122392 conn(0x7f478c09c7a0 msgr2=0x7f478c08afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:28.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.270+0000 7f4793600640 1 -- 172.21.15.162:0/2876122392 shutdown_connections 2024-01-20T11:07:28.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.270+0000 7f4793600640 1 -- 172.21.15.162:0/2876122392 wait complete. 2024-01-20T11:07:28.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.272+0000 7f4793600640 1 Processor -- start 2024-01-20T11:07:28.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.272+0000 7f4793600640 1 -- start start 2024-01-20T11:07:28.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4793600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f476c0039a0 0x7f478c0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4793600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478c152ce0 0x7f478c0b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4793600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c160000 0x7f478c160480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4793600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b82e0 con 0x7f478c160000 2024-01-20T11:07:28.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4793600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b8530 con 0x7f478c152ce0 2024-01-20T11:07:28.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4793600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b8810 con 0x7f476c0039a0 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4791600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c160000 0x7f478c160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4791600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c160000 0x7f478c160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54412/0 (socket says 172.21.15.162:54412) 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.273+0000 7f4791600640 1 -- 172.21.15.162:0/3031947510 learned_addr learned my addr 172.21.15.162:0/3031947510 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4790c00640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f476c0039a0 0x7f478c0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4791600640 1 -- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f476c0039a0 msgr2=0x7f478c0b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4791600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f476c0039a0 0x7f478c0b7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4791600640 1 -- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478c152ce0 msgr2=0x7f478c0b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f478be00640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478c152ce0 0x7f478c0b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4791600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478c152ce0 0x7f478c0b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4791600640 1 -- 172.21.15.162:0/3031947510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0b8af0 con 0x7f478c160000 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4791600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c160000 0x7f478c160480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f476c004740 tx=0x7f47840115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4788c00640 1 -- 172.21.15.162:0/3031947510 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400e070 con 0x7f478c160000 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4788c00640 1 -- 172.21.15.162:0/3031947510 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784011ed0 con 0x7f478c160000 2024-01-20T11:07:28.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4788c00640 1 -- 172.21.15.162:0/3031947510 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784003990 con 0x7f478c160000 2024-01-20T11:07:28.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.274+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c15de90 con 0x7f478c160000 2024-01-20T11:07:28.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.275+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c1609c0 con 0x7f478c160000 2024-01-20T11:07:28.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.276+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c04e970 con 0x7f478c160000 2024-01-20T11:07:28.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.277+0000 7f4788c00640 1 -- 172.21.15.162:0/3031947510 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f4784003b10 con 0x7f478c160000 2024-01-20T11:07:28.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.278+0000 7f4788c00640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f476406ae40 0x7f476406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.278+0000 7f4788c00640 1 -- 172.21.15.162:0/3031947510 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4784089890 con 0x7f478c160000 2024-01-20T11:07:28.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.278+0000 7f4790c00640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f476406ae40 0x7f476406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.279+0000 7f4790c00640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f476406ae40 0x7f476406d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f477c034000 tx=0x7f477c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:28.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.282+0000 7f4788c00640 1 -- 172.21.15.162:0/3031947510 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4784054b00 con 0x7f478c160000 2024-01-20T11:07:28.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.482+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f478c0d4160 con 0x7f478c160000 2024-01-20T11:07:28.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.484+0000 7f4788c00640 1 -- 172.21.15.162:0/3031947510 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12875 (secure 0 0 0) 0x7f4784058120 con 0x7f478c160000 2024-01-20T11:07:28.484 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:28.485 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":18,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:28.383349+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f476406ae40 msgr2=0x7f476406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f476406ae40 0x7f476406d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f477c034000 tx=0x7f477c009030 comp rx=0 tx=0).stop 2024-01-20T11:07:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c160000 msgr2=0x7f478c160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c160000 0x7f478c160480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f476c004740 tx=0x7f47840115a0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 shutdown_connections 2024-01-20T11:07:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c160000 0x7f478c160480 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f476406ae40 0x7f476406d300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478c152ce0 0x7f478c0b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 --2- 172.21.15.162:0/3031947510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f476c0039a0 0x7f478c0b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.486+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 >> 172.21.15.162:0/3031947510 conn(0x7f478c09c7a0 msgr2=0x7f478c0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.487+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 shutdown_connections 2024-01-20T11:07:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.487+0000 7f4793600640 1 -- 172.21.15.162:0/3031947510 wait complete. 2024-01-20T11:07:28.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:07:28.504 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:07:28.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.692+0000 7f0384200640 1 Processor -- start 2024-01-20T11:07:28.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.692+0000 7f0384200640 1 -- start start 2024-01-20T11:07:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0384200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f037c15d5a0 0x7f037c0b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0384200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0384200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0cec90 con 0x7f037c0d2250 2024-01-20T11:07:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0384200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0d0dd0 con 0x7f037c15d5a0 2024-01-20T11:07:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0384200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0d2730 con 0x7f037c0d0400 2024-01-20T11:07:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0381800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f037c15d5a0 0x7f037c0b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0381800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f037c15d5a0 0x7f037c0b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54416/0 (socket says 172.21.15.162:54416) 2024-01-20T11:07:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0381800640 1 -- 172.21.15.162:0/2467108372 learned_addr learned my addr 172.21.15.162:0/2467108372 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0382200640 1 --2- 172.21.15.162:0/2467108372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0381800640 1 -- 172.21.15.162:0/2467108372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 msgr2=0x7f037c0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.694+0000 7f0381800640 1 --2- 172.21.15.162:0/2467108372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.695+0000 7f0381800640 1 -- 172.21.15.162:0/2467108372 >> v1:172.21.15.162:6789/0 conn(0x7f037c0d2250 legacy=0x7f037c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.695+0000 7f0381800640 1 -- 172.21.15.162:0/2467108372 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0d2a10 con 0x7f037c15d5a0 2024-01-20T11:07:28.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.695+0000 7f0382200640 1 --2- 172.21.15.162:0/2467108372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:28.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.696+0000 7f0381800640 1 --2- 172.21.15.162:0/2467108372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0b6650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f036c009870 tx=0x7f036c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39558e945ab1f289 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:28.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.696+0000 7f037be00640 1 -- 172.21.15.162:0/2467108372 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c030840 con 0x7f037c15d5a0 2024-01-20T11:07:28.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.696+0000 7f037be00640 1 -- 172.21.15.162:0/2467108372 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c0309a0 con 0x7f037c15d5a0 2024-01-20T11:07:28.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.696+0000 7f037be00640 1 -- 172.21.15.162:0/2467108372 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c030d30 con 0x7f037c15d5a0 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.696+0000 7f0384200640 1 -- 172.21.15.162:0/2467108372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 msgr2=0x7f037c0b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.696+0000 7f0384200640 1 --2- 172.21.15.162:0/2467108372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0b6650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f036c009870 tx=0x7f036c02b980 comp rx=0 tx=0).stop 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.697+0000 7f0384200640 1 -- 172.21.15.162:0/2467108372 shutdown_connections 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.697+0000 7f0384200640 1 --2- 172.21.15.162:0/2467108372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.697+0000 7f0384200640 1 --2- 172.21.15.162:0/2467108372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0b6650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.697+0000 7f0384200640 1 -- 172.21.15.162:0/2467108372 >> 172.21.15.162:0/2467108372 conn(0x7f037c066760 msgr2=0x7f037c066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.697+0000 7f0384200640 1 -- 172.21.15.162:0/2467108372 shutdown_connections 2024-01-20T11:07:28.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.697+0000 7f0384200640 1 -- 172.21.15.162:0/2467108372 wait complete. 2024-01-20T11:07:28.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.698+0000 7f0384200640 1 Processor -- start 2024-01-20T11:07:28.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.699+0000 7f0384200640 1 -- start start 2024-01-20T11:07:28.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.699+0000 7f0384200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.699+0000 7f0384200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037c0d2250 0x7f037c1f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.699+0000 7f0384200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.699+0000 7f0384200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c1491f0 con 0x7f037c15d5a0 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.699+0000 7f0384200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c1494d0 con 0x7f037c0d2250 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.699+0000 7f0384200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c1497b0 con 0x7f037c0d0400 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54430/0 (socket says 172.21.15.162:54430) 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 -- 172.21.15.162:0/2106776083 learned_addr learned my addr 172.21.15.162:0/2106776083 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0381800640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0380e00640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037c0d2250 0x7f037c1f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 -- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 msgr2=0x7f037c0c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 -- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037c0d2250 msgr2=0x7f037c1f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037c0d2250 0x7f037c1f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.700+0000 7f0382200640 1 -- 172.21.15.162:0/2106776083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0094d0 con 0x7f037c15d5a0 2024-01-20T11:07:28.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.701+0000 7f0382200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0c91b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f037400ce40 tx=0x7f037400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:28.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.701+0000 7f0379600640 1 -- 172.21.15.162:0/2106776083 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400d840 con 0x7f037c15d5a0 2024-01-20T11:07:28.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.701+0000 7f0379600640 1 -- 172.21.15.162:0/2106776083 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400d9a0 con 0x7f037c15d5a0 2024-01-20T11:07:28.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.701+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c149a90 con 0x7f037c15d5a0 2024-01-20T11:07:28.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.701+0000 7f0379600640 1 -- 172.21.15.162:0/2106776083 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400dd50 con 0x7f037c15d5a0 2024-01-20T11:07:28.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.701+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c0c6670 con 0x7f037c15d5a0 2024-01-20T11:07:28.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.702+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c149fb0 con 0x7f037c15d5a0 2024-01-20T11:07:28.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.703+0000 7f0379600640 1 -- 172.21.15.162:0/2106776083 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f037401e3b0 con 0x7f037c15d5a0 2024-01-20T11:07:28.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.704+0000 7f0379600640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f035406ae70 0x7f035406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:28.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.704+0000 7f0379600640 1 -- 172.21.15.162:0/2106776083 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0374089bc0 con 0x7f037c15d5a0 2024-01-20T11:07:28.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.704+0000 7f0381800640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f035406ae70 0x7f035406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:28.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.705+0000 7f0381800640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f035406ae70 0x7f035406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f036c036000 tx=0x7f036c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:28.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.708+0000 7f0379600640 1 -- 172.21.15.162:0/2106776083 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f037c149fb0 con 0x7f037c15d5a0 2024-01-20T11:07:28.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.889+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f037c149fb0 con 0x7f037c15d5a0 2024-01-20T11:07:28.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.890+0000 7f0379600640 1 -- 172.21.15.162:0/2106776083 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f037c149fb0 con 0x7f037c15d5a0 2024-01-20T11:07:28.890 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f035406ae70 msgr2=0x7f035406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f035406ae70 0x7f035406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f036c036000 tx=0x7f036c03b040 comp rx=0 tx=0).stop 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 msgr2=0x7f037c0c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0c91b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f037400ce40 tx=0x7f037400a710 comp rx=0 tx=0).stop 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 shutdown_connections 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f037c15d5a0 0x7f037c0c91b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f035406ae70 0x7f035406d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037c0d2250 0x7f037c1f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 --2- 172.21.15.162:0/2106776083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f037c0d0400 0x7f037c0c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 >> 172.21.15.162:0/2106776083 conn(0x7f037c066760 msgr2=0x7f037c15dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 shutdown_connections 2024-01-20T11:07:28.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:28.892+0000 7f0384200640 1 -- 172.21.15.162:0/2106776083 wait complete. 2024-01-20T11:07:28.910 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T11:07:29.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.121+0000 7fce71a00640 1 Processor -- start 2024-01-20T11:07:29.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.121+0000 7fce71a00640 1 -- start start 2024-01-20T11:07:29.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce71a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce6c15d750 0x7fce6c0b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce71a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce6c0b91e0 0x7fce6c0b6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce71a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c0b6f30 con 0x7fce6c0d1460 2024-01-20T11:07:29.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce71a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c15db30 con 0x7fce6c0b91e0 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce71a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c0b7210 con 0x7fce6c15d750 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce61e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce6c0b91e0 0x7fce6c0b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce61e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce6c0b91e0 0x7fce6c0b6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54444/0 (socket says 172.21.15.162:54444) 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce61e00640 1 -- 172.21.15.162:0/1568521524 learned_addr learned my addr 172.21.15.162:0/1568521524 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce6aa00640 1 --2- 172.21.15.162:0/1568521524 >> v2:172.21.15.179:3300/0 conn(0x7fce6c15d750 0x7fce6c0b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.123+0000 7fce61e00640 1 -- 172.21.15.162:0/1568521524 >> v2:172.21.15.179:3300/0 conn(0x7fce6c15d750 msgr2=0x7fce6c0b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.124+0000 7fce61e00640 1 --2- 172.21.15.162:0/1568521524 >> v2:172.21.15.179:3300/0 conn(0x7fce6c15d750 0x7fce6c0b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.124+0000 7fce61e00640 1 -- 172.21.15.162:0/1568521524 >> v1:172.21.15.179:6789/0 conn(0x7fce6c0d1460 legacy=0x7fce6c0b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.124+0000 7fce61e00640 1 -- 172.21.15.162:0/1568521524 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0b74f0 con 0x7fce6c0b91e0 2024-01-20T11:07:29.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.125+0000 7fce61e00640 1 --2- 172.21.15.162:0/1568521524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c0b6940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0b5d90 tx=0x7fce5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d79cdf1599982ca server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:29.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.125+0000 7fce6a000640 1 -- 172.21.15.162:0/1568521524 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54031870 con 0x7fce6c0b91e0 2024-01-20T11:07:29.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.125+0000 7fce6a000640 1 -- 172.21.15.162:0/1568521524 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce540319d0 con 0x7fce6c0b91e0 2024-01-20T11:07:29.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.125+0000 7fce6a000640 1 -- 172.21.15.162:0/1568521524 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54031d60 con 0x7fce6c0b91e0 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 -- 172.21.15.162:0/1568521524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 msgr2=0x7fce6c0b6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 --2- 172.21.15.162:0/1568521524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c0b6940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0b5d90 tx=0x7fce5402b910 comp rx=0 tx=0).stop 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 -- 172.21.15.162:0/1568521524 shutdown_connections 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 --2- 172.21.15.162:0/1568521524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c0b6940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 --2- 172.21.15.162:0/1568521524 >> v2:172.21.15.179:3300/0 conn(0x7fce6c15d750 0x7fce6c0b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 -- 172.21.15.162:0/1568521524 >> 172.21.15.162:0/1568521524 conn(0x7fce6c066760 msgr2=0x7fce6c066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 -- 172.21.15.162:0/1568521524 shutdown_connections 2024-01-20T11:07:29.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.126+0000 7fce71a00640 1 -- 172.21.15.162:0/1568521524 wait complete. 2024-01-20T11:07:29.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.128+0000 7fce71a00640 1 Processor -- start 2024-01-20T11:07:29.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.128+0000 7fce71a00640 1 -- start start 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.129+0000 7fce71a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.129+0000 7fce71a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c0d1460 0x7fce6c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.129+0000 7fce71a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce6c15d750 0x7fce6c1f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.129+0000 7fce71a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c149d80 con 0x7fce6c0b91e0 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.129+0000 7fce71a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c0cb970 con 0x7fce6c0d1460 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.129+0000 7fce71a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c160810 con 0x7fce6c15d750 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54446/0 (socket says 172.21.15.162:54446) 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 -- 172.21.15.162:0/3627089913 learned_addr learned my addr 172.21.15.162:0/3627089913 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce61e00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c0d1460 0x7fce6c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 -- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce6c15d750 msgr2=0x7fce6c1f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce6c15d750 0x7fce6c1f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 -- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c0d1460 msgr2=0x7fce6c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c0d1460 0x7fce6c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 -- 172.21.15.162:0/3627089913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540094d0 con 0x7fce6c0b91e0 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce61e00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c0d1460 0x7fce6c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.130+0000 7fce6aa00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c149840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00d5f0 tx=0x7fce5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.131+0000 7fce63400640 1 -- 172.21.15.162:0/3627089913 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0125f0 con 0x7fce6c0b91e0 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.131+0000 7fce63400640 1 -- 172.21.15.162:0/3627089913 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c012750 con 0x7fce6c0b91e0 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.131+0000 7fce63400640 1 -- 172.21.15.162:0/3627089913 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c012b00 con 0x7fce6c0b91e0 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.131+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c160af0 con 0x7fce6c0b91e0 2024-01-20T11:07:29.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.131+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c0cb600 con 0x7fce6c0b91e0 2024-01-20T11:07:29.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.132+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c0cb790 con 0x7fce6c0b91e0 2024-01-20T11:07:29.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.133+0000 7fce63400640 1 -- 172.21.15.162:0/3627089913 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7fce5c012c60 con 0x7fce6c0b91e0 2024-01-20T11:07:29.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.133+0000 7fce63400640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce4406ae40 0x7fce4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.134+0000 7fce63400640 1 -- 172.21.15.162:0/3627089913 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce5c089750 con 0x7fce6c0b91e0 2024-01-20T11:07:29.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.134+0000 7fce61e00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce4406ae40 0x7fce4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.134+0000 7fce61e00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce4406ae40 0x7fce4406d300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce54036000 tx=0x7fce5403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:29.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.138+0000 7fce63400640 1 -- 172.21.15.162:0/3627089913 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fce5c0549b0 con 0x7fce6c0b91e0 2024-01-20T11:07:29.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.332+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fce6c04e970 con 0x7fce6c0b91e0 2024-01-20T11:07:29.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.333+0000 7fce63400640 1 -- 172.21.15.162:0/3627089913 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fce5c057fd0 con 0x7fce6c0b91e0 2024-01-20T11:07:29.333 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:29.333 INFO:teuthology.orchestra.run.smithi162.stdout:[ 2024-01-20T11:07:29.333 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:07:29.334 INFO:teuthology.orchestra.run.smithi162.stdout: "poolnum": 1, 2024-01-20T11:07:29.334 INFO:teuthology.orchestra.run.smithi162.stdout: "poolname": ".mgr" 2024-01-20T11:07:29.334 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:07:29.334 INFO:teuthology.orchestra.run.smithi162.stdout:] 2024-01-20T11:07:29.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce4406ae40 msgr2=0x7fce4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce4406ae40 0x7fce4406d300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce54036000 tx=0x7fce5403c040 comp rx=0 tx=0).stop 2024-01-20T11:07:29.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 msgr2=0x7fce6c149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c149840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00d5f0 tx=0x7fce5c00dab0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 shutdown_connections 2024-01-20T11:07:29.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce6c15d750 0x7fce6c1f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce4406ae40 0x7fce4406d300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c0d1460 0x7fce6c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 --2- 172.21.15.162:0/3627089913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce6c0b91e0 0x7fce6c149840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.335+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 >> 172.21.15.162:0/3627089913 conn(0x7fce6c066760 msgr2=0x7fce6c0d3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:29.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.336+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 shutdown_connections 2024-01-20T11:07:29.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.336+0000 7fce71a00640 1 -- 172.21.15.162:0/3627089913 wait complete. 2024-01-20T11:07:29.353 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-20T11:07:29.353 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-20T11:07:29.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.561+0000 7f0672000640 1 Processor -- start 2024-01-20T11:07:29.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.561+0000 7f0672000640 1 -- start start 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0672000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f066c157c30 0x7f066c0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0672000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f066c15db30 0x7f066c0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0672000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066c0b4ae0 con 0x7f066c0ad810 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0672000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c0adc80 con 0x7f066c15db30 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0672000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c0b3ed0 con 0x7f066c157c30 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f066be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f066c15db30 0x7f066c0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0671600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f066c0ad810 0x7f066c160fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44548/0 (socket says 172.21.15.162:44548) 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f066be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f066c15db30 0x7f066c0ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54450/0 (socket says 172.21.15.162:54450) 2024-01-20T11:07:29.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0671600640 1 -- 172.21.15.162:0/4142921557 learned_addr learned my addr 172.21.15.162:0/4142921557 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:29.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.563+0000 7f0670c00640 1 --2- 172.21.15.162:0/4142921557 >> v2:172.21.15.179:3300/0 conn(0x7f066c157c30 0x7f066c0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.564+0000 7f066be00640 1 -- 172.21.15.162:0/4142921557 >> v2:172.21.15.179:3300/0 conn(0x7f066c157c30 msgr2=0x7f066c0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:29.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.564+0000 7f066be00640 1 --2- 172.21.15.162:0/4142921557 >> v2:172.21.15.179:3300/0 conn(0x7f066c157c30 0x7f066c0b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.564+0000 7f066be00640 1 -- 172.21.15.162:0/4142921557 >> v1:172.21.15.162:6789/0 conn(0x7f066c0ad810 legacy=0x7f066c160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.564+0000 7f066be00640 1 -- 172.21.15.162:0/4142921557 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c0b41b0 con 0x7f066c15db30 2024-01-20T11:07:29.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.564+0000 7f066b400640 1 -- 172.21.15.162:0/4142921557 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731515802 0 0) 0x7f066c0b4ae0 con 0x7f066c0ad810 2024-01-20T11:07:29.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.565+0000 7f066be00640 1 --2- 172.21.15.162:0/4142921557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c15db30 0x7f066c0ad2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f066c066540 tx=0x7f065402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8965da7ed645506 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:29.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.565+0000 7f066b400640 1 -- 172.21.15.162:0/4142921557 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654031830 con 0x7f066c15db30 2024-01-20T11:07:29.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.565+0000 7f066b400640 1 -- 172.21.15.162:0/4142921557 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0654031990 con 0x7f066c15db30 2024-01-20T11:07:29.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.565+0000 7f066b400640 1 -- 172.21.15.162:0/4142921557 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654031d20 con 0x7f066c15db30 2024-01-20T11:07:29.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.565+0000 7f0672000640 1 -- 172.21.15.162:0/4142921557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c15db30 msgr2=0x7f066c0ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.565+0000 7f0672000640 1 --2- 172.21.15.162:0/4142921557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c15db30 0x7f066c0ad2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f066c066540 tx=0x7f065402b8d0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.566+0000 7f0672000640 1 -- 172.21.15.162:0/4142921557 shutdown_connections 2024-01-20T11:07:29.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.566+0000 7f0672000640 1 --2- 172.21.15.162:0/4142921557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c15db30 0x7f066c0ad2d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.566+0000 7f0672000640 1 --2- 172.21.15.162:0/4142921557 >> v2:172.21.15.179:3300/0 conn(0x7f066c157c30 0x7f066c0b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.566+0000 7f0672000640 1 -- 172.21.15.162:0/4142921557 >> 172.21.15.162:0/4142921557 conn(0x7f066c0cfaf0 msgr2=0x7f066c0cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:29.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.566+0000 7f0672000640 1 -- 172.21.15.162:0/4142921557 shutdown_connections 2024-01-20T11:07:29.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.566+0000 7f0672000640 1 -- 172.21.15.162:0/4142921557 wait complete. 2024-01-20T11:07:29.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.567+0000 7f0672000640 1 Processor -- start 2024-01-20T11:07:29.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.568+0000 7f0672000640 1 -- start start 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.568+0000 7f0672000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f066c0ad810 0x7f066c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.568+0000 7f0672000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c157c30 0x7f066c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.568+0000 7f0672000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f066c15db30 0x7f066c14bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.568+0000 7f0672000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0ccf60 con 0x7f066c157c30 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.568+0000 7f0672000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0cc350 con 0x7f066c15db30 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.568+0000 7f0672000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0cc630 con 0x7f066c0ad810 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c157c30 0x7f066c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c157c30 0x7f066c0b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54460/0 (socket says 172.21.15.162:54460) 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 -- 172.21.15.162:0/1275766730 learned_addr learned my addr 172.21.15.162:0/1275766730 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f0671600640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f066c15db30 0x7f066c14bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f0670c00640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f066c0ad810 0x7f066c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 -- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f066c0ad810 msgr2=0x7f066c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f066c0ad810 0x7f066c06d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 -- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f066c15db30 msgr2=0x7f066c14bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:29.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f066c15db30 0x7f066c14bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:29.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f066be00640 1 -- 172.21.15.162:0/1275766730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654009400 con 0x7f066c157c30 2024-01-20T11:07:29.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.569+0000 7f0671600640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f066c15db30 0x7f066c14bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:29.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.570+0000 7f066be00640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c157c30 0x7f066c0b05c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f06540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:29.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.570+0000 7f0668c00640 1 -- 172.21.15.162:0/1275766730 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540317d0 con 0x7f066c157c30 2024-01-20T11:07:29.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.570+0000 7f0668c00640 1 -- 172.21.15.162:0/1275766730 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065403aa60 con 0x7f066c157c30 2024-01-20T11:07:29.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.570+0000 7f0668c00640 1 -- 172.21.15.162:0/1275766730 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065403ae10 con 0x7f066c157c30 2024-01-20T11:07:29.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.570+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c0cc910 con 0x7f066c157c30 2024-01-20T11:07:29.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.570+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c06da30 con 0x7f066c157c30 2024-01-20T11:07:29.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.571+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c074aa0 con 0x7f066c157c30 2024-01-20T11:07:29.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.572+0000 7f0668c00640 1 -- 172.21.15.162:0/1275766730 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f065404d450 con 0x7f066c157c30 2024-01-20T11:07:29.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.573+0000 7f0668c00640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f064406ae40 0x7f064406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:29.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.573+0000 7f0668c00640 1 -- 172.21.15.162:0/1275766730 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06540ab310 con 0x7f066c157c30 2024-01-20T11:07:29.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.573+0000 7f0670c00640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f064406ae40 0x7f064406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:29.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.574+0000 7f0670c00640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f064406ae40 0x7f064406d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f065c006fd0 tx=0x7f065c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:29.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.577+0000 7f0668c00640 1 -- 172.21.15.162:0/1275766730 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0654076610 con 0x7f066c157c30 2024-01-20T11:07:29.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:29.773+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f066c0b3110 con 0x7f066c157c30 2024-01-20T11:07:30.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.437+0000 7f0668c00640 1 -- 172.21.15.162:0/1275766730 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0654079c30 con 0x7f066c157c30 2024-01-20T11:07:30.438 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' created 2024-01-20T11:07:30.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f064406ae40 msgr2=0x7f064406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:30.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f064406ae40 0x7f064406d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f065c006fd0 tx=0x7f065c008040 comp rx=0 tx=0).stop 2024-01-20T11:07:30.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c157c30 msgr2=0x7f066c0b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:30.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c157c30 0x7f066c0b05c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f06540046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 shutdown_connections 2024-01-20T11:07:30.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f064406ae40 0x7f064406d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f066c15db30 0x7f066c14bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f066c157c30 0x7f066c0b05c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 --2- 172.21.15.162:0/1275766730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f066c0ad810 0x7f066c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.441+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 >> 172.21.15.162:0/1275766730 conn(0x7f066c0cfaf0 msgr2=0x7f066c160340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:30.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.442+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 shutdown_connections 2024-01-20T11:07:30.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.442+0000 7f0672000640 1 -- 172.21.15.162:0/1275766730 wait complete. 2024-01-20T11:07:30.468 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T11:07:30.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.667+0000 7f6472800640 1 Processor -- start 2024-01-20T11:07:30.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.667+0000 7f6472800640 1 -- start start 2024-01-20T11:07:30.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f6472800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f646c0b2040 0x7f646c15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:30.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f6472800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f646c0cf060 0x7f646c0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:30.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f6472800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c0b2ec0 con 0x7f646c15a380 2024-01-20T11:07:30.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f6472800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c070eb0 con 0x7f646c0cf060 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f6472800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c15ee30 con 0x7f646c0b2040 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f646be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f646c0cf060 0x7f646c0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f646be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f646c0cf060 0x7f646c0cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54486/0 (socket says 172.21.15.162:54486) 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f646be00640 1 -- 172.21.15.162:0/169294701 learned_addr learned my addr 172.21.15.162:0/169294701 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.669+0000 7f646b400640 1 --1- 172.21.15.162:0/169294701 >> v1:172.21.15.162:6789/0 conn(0x7f646c15a380 0x7f646c0707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44560/0 (socket says 172.21.15.162:44560) 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.670+0000 7f6462800640 1 --2- 172.21.15.162:0/169294701 >> v2:172.21.15.179:3300/0 conn(0x7f646c0b2040 0x7f646c15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.670+0000 7f646be00640 1 -- 172.21.15.162:0/169294701 >> v2:172.21.15.179:3300/0 conn(0x7f646c0b2040 msgr2=0x7f646c15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.670+0000 7f646be00640 1 --2- 172.21.15.162:0/169294701 >> v2:172.21.15.179:3300/0 conn(0x7f646c0b2040 0x7f646c15e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.670+0000 7f646be00640 1 -- 172.21.15.162:0/169294701 >> v1:172.21.15.162:6789/0 conn(0x7f646c15a380 legacy=0x7f646c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.670+0000 7f646be00640 1 -- 172.21.15.162:0/169294701 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0cf9f0 con 0x7f646c0cf060 2024-01-20T11:07:30.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.670+0000 7f646aa00640 1 -- 172.21.15.162:0/169294701 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456398851 0 0) 0x7f645c001110 con 0x7f646c15a380 2024-01-20T11:07:30.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.671+0000 7f646be00640 1 --2- 172.21.15.162:0/169294701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0cf060 0x7f646c0cf4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f646c0671c0 tx=0x7f646402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe1b9e5d96122e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:30.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.671+0000 7f646aa00640 1 -- 172.21.15.162:0/169294701 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646402ca80 con 0x7f646c0cf060 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.671+0000 7f646aa00640 1 -- 172.21.15.162:0/169294701 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646402cbe0 con 0x7f646c0cf060 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.671+0000 7f646aa00640 1 -- 172.21.15.162:0/169294701 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640343f0 con 0x7f646c0cf060 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 -- 172.21.15.162:0/169294701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0cf060 msgr2=0x7f646c0cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 --2- 172.21.15.162:0/169294701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0cf060 0x7f646c0cf4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f646c0671c0 tx=0x7f646402bee0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 -- 172.21.15.162:0/169294701 shutdown_connections 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 --2- 172.21.15.162:0/169294701 >> v2:172.21.15.179:3300/0 conn(0x7f646c0b2040 0x7f646c15e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 --2- 172.21.15.162:0/169294701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0cf060 0x7f646c0cf4b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 -- 172.21.15.162:0/169294701 >> 172.21.15.162:0/169294701 conn(0x7f646c06a600 msgr2=0x7f646c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 -- 172.21.15.162:0/169294701 shutdown_connections 2024-01-20T11:07:30.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.672+0000 7f6472800640 1 -- 172.21.15.162:0/169294701 wait complete. 2024-01-20T11:07:30.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.674+0000 7f6472800640 1 Processor -- start 2024-01-20T11:07:30.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.674+0000 7f6472800640 1 -- start start 2024-01-20T11:07:30.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f6472800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0b2040 0x7f646c158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f6472800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f646c0cf060 0x7f646c14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f6472800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646c15a380 0x7f646c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f6472800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c9eb0 con 0x7f646c0b2040 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f6472800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0ca190 con 0x7f646c0cf060 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f6472800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0ca470 con 0x7f646c15a380 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f646b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0b2040 0x7f646c158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f646b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0b2040 0x7f646c158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54500/0 (socket says 172.21.15.162:54500) 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f646b400640 1 -- 172.21.15.162:0/1109266159 learned_addr learned my addr 172.21.15.162:0/1109266159 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.675+0000 7f6462800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f646c0cf060 0x7f646c14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f646b400640 1 -- 172.21.15.162:0/1109266159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646c15a380 msgr2=0x7f646c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f646b400640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646c15a380 0x7f646c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f646b400640 1 -- 172.21.15.162:0/1109266159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f646c0cf060 msgr2=0x7f646c14ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:30.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f646b400640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f646c0cf060 0x7f646c14ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f646b400640 1 -- 172.21.15.162:0/1109266159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464009b30 con 0x7f646c0b2040 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f646b400640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0b2040 0x7f646c158380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f645c00c430 tx=0x7f645c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f6463e00640 1 -- 172.21.15.162:0/1109266159 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0074e0 con 0x7f646c0b2040 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f6463e00640 1 -- 172.21.15.162:0/1109266159 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c007660 con 0x7f646c0b2040 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f6463e00640 1 -- 172.21.15.162:0/1109266159 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c004a20 con 0x7f646c0b2040 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c0ca750 con 0x7f646c0b2040 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.676+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c14f1c0 con 0x7f646c0b2040 2024-01-20T11:07:30.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.677+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c0cac70 con 0x7f646c0b2040 2024-01-20T11:07:30.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.678+0000 7f6463e00640 1 -- 172.21.15.162:0/1109266159 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f645c004b80 con 0x7f646c0b2040 2024-01-20T11:07:30.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.679+0000 7f6463e00640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f644406aed0 0x7f644406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:30.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.679+0000 7f6463e00640 1 -- 172.21.15.162:0/1109266159 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f645c0890d0 con 0x7f646c0b2040 2024-01-20T11:07:30.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.679+0000 7f6462800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f644406aed0 0x7f644406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:30.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.680+0000 7f6462800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f644406aed0 0x7f644406d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f646c06c010 tx=0x7f6454009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:30.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.686+0000 7f6463e00640 1 -- 172.21.15.162:0/1109266159 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f646c0cac70 con 0x7f646c0b2040 2024-01-20T11:07:30.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:30.882+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f646c0b2ec0 con 0x7f646c0b2040 2024-01-20T11:07:31.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.455+0000 7f6463e00640 1 -- 172.21.15.162:0/1109266159 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f646c0b2ec0 con 0x7f646c0b2040 2024-01-20T11:07:31.456 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' created 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f644406aed0 msgr2=0x7f644406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f644406aed0 0x7f644406d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f646c06c010 tx=0x7f6454009190 comp rx=0 tx=0).stop 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0b2040 msgr2=0x7f646c158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0b2040 0x7f646c158380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f645c00c430 tx=0x7f645c00c8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 shutdown_connections 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646c15a380 0x7f646c154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f644406aed0 0x7f644406d390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f646c0cf060 0x7f646c14ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 --2- 172.21.15.162:0/1109266159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646c0b2040 0x7f646c158380 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f645c00c430 tx=0x7f645c00c8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.461+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 >> 172.21.15.162:0/1109266159 conn(0x7f646c06a600 msgr2=0x7f646c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:31.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.463+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 shutdown_connections 2024-01-20T11:07:31.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.463+0000 7f6472800640 1 -- 172.21.15.162:0/1109266159 wait complete. 2024-01-20T11:07:31.498 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-20T11:07:31.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.679+0000 7f9dd2600640 1 Processor -- start 2024-01-20T11:07:31.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.679+0000 7f9dd2600640 1 -- start start 2024-01-20T11:07:31.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dd2600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc144ea0 0x7f9dcc070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:31.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dd2600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9dcc070ec0 0x7f9dcc15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:31.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dd2600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc145280 con 0x7f9dcc15bf80 2024-01-20T11:07:31.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dd2600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc15c430 con 0x7f9dcc070ec0 2024-01-20T11:07:31.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dd2600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc15c710 con 0x7f9dcc144ea0 2024-01-20T11:07:31.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dcaa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9dcc070ec0 0x7f9dcc15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:31.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc144ea0 0x7f9dcc070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:31.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dcaa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9dcc070ec0 0x7f9dcc15ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:32876/0 (socket says 172.21.15.162:32876) 2024-01-20T11:07:31.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.681+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2420945045 learned_addr learned my addr 172.21.15.162:0/2420945045 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:31.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.682+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc144ea0 msgr2=0x7f9dcc070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:31.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.682+0000 7f9dcaa00640 1 --2- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc144ea0 0x7f9dcc070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.682+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2420945045 >> v1:172.21.15.179:6789/0 conn(0x7f9dcc15bf80 legacy=0x7f9dcc0d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:31.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.682+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2420945045 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc15c9f0 con 0x7f9dcc070ec0 2024-01-20T11:07:31.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.682+0000 7f9dcb400640 1 --2- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc144ea0 0x7f9dcc070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:31.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.683+0000 7f9dcaa00640 1 --2- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc070ec0 0x7f9dcc15ba40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009870 tx=0x7f9db402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=373db49a8b42001f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:31.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.684+0000 7f9dca000640 1 -- 172.21.15.162:0/2420945045 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4031640 con 0x7f9dcc070ec0 2024-01-20T11:07:31.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.684+0000 7f9dca000640 1 -- 172.21.15.162:0/2420945045 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db40317a0 con 0x7f9dcc070ec0 2024-01-20T11:07:31.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.684+0000 7f9dca000640 1 -- 172.21.15.162:0/2420945045 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4031b30 con 0x7f9dcc070ec0 2024-01-20T11:07:31.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 -- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc070ec0 msgr2=0x7f9dcc15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:31.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc070ec0 0x7f9dcc15ba40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009870 tx=0x7f9db402b8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 -- 172.21.15.162:0/2420945045 shutdown_connections 2024-01-20T11:07:31.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc070ec0 0x7f9dcc15ba40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2420945045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc144ea0 0x7f9dcc070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 -- 172.21.15.162:0/2420945045 >> 172.21.15.162:0/2420945045 conn(0x7f9dcc06e980 msgr2=0x7f9dcc06ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:31.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 -- 172.21.15.162:0/2420945045 shutdown_connections 2024-01-20T11:07:31.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.685+0000 7f9dd2600640 1 -- 172.21.15.162:0/2420945045 wait complete. 2024-01-20T11:07:31.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.687+0000 7f9dd2600640 1 Processor -- start 2024-01-20T11:07:31.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.687+0000 7f9dd2600640 1 -- start start 2024-01-20T11:07:31.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dd2600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc144ea0 0x7f9dcc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dd2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc15bf80 0x7f9dcc06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dd2600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc0cb4c0 0x7f9dcc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dd2600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0cbeb0 con 0x7f9dcc15bf80 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dd2600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc15b440 con 0x7f9dcc144ea0 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dd2600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc06b6f0 con 0x7f9dcc0cb4c0 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc15bf80 0x7f9dcc06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc15bf80 0x7f9dcc06c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54516/0 (socket says 172.21.15.162:54516) 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2646738320 learned_addr learned my addr 172.21.15.162:0/2646738320 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcb400640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc144ea0 0x7f9dcc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcbe00640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc0cb4c0 0x7f9dcc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc0cb4c0 msgr2=0x7f9dcc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc0cb4c0 0x7f9dcc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc144ea0 msgr2=0x7f9dcc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc144ea0 0x7f9dcc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:31.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.688+0000 7f9dcaa00640 1 -- 172.21.15.162:0/2646738320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc009400 con 0x7f9dcc15bf80 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dcb400640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc144ea0 0x7f9dcc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dcbe00640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc0cb4c0 0x7f9dcc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dcaa00640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc15bf80 0x7f9dcc06c9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9db4000c00 tx=0x7f9db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dc3400640 1 -- 172.21.15.162:0/2646738320 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db403a930 con 0x7f9dcc15bf80 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dc3400640 1 -- 172.21.15.162:0/2646738320 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db403aa90 con 0x7f9dcc15bf80 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40094d0 con 0x7f9dcc15bf80 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dc3400640 1 -- 172.21.15.162:0/2646738320 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db403ae40 con 0x7f9dcc15bf80 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.689+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc06bc20 con 0x7f9dcc15bf80 2024-01-20T11:07:31.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.690+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0cfa10 con 0x7f9dcc15bf80 2024-01-20T11:07:31.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.691+0000 7f9dc3400640 1 -- 172.21.15.162:0/2646738320 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9db402f050 con 0x7f9dcc15bf80 2024-01-20T11:07:31.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.692+0000 7f9dc3400640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9da406aed0 0x7f9da406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:31.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.692+0000 7f9dc3400640 1 -- 172.21.15.162:0/2646738320 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9db40ab450 con 0x7f9dcc15bf80 2024-01-20T11:07:31.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.692+0000 7f9dcb400640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9da406aed0 0x7f9da406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:31.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.693+0000 7f9dcb400640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9da406aed0 0x7f9da406d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009c50 tx=0x7f9dbc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:31.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.697+0000 7f9dc3400640 1 -- 172.21.15.162:0/2646738320 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9db40762e0 con 0x7f9dcc15bf80 2024-01-20T11:07:31.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:31.924+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9dcc04e970 con 0x7f9dcc15bf80 2024-01-20T11:07:32.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.479+0000 7f9dc3400640 1 -- 172.21.15.162:0/2646738320 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9db4079900 con 0x7f9dcc15bf80 2024-01-20T11:07:32.481 INFO:teuthology.orchestra.run.smithi162.stderr:new fs with metadata pool 2 and data pool 3 2024-01-20T11:07:32.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.486+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9da406aed0 msgr2=0x7f9da406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:32.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.486+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9da406aed0 0x7f9da406d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009c50 tx=0x7f9dbc008040 comp rx=0 tx=0).stop 2024-01-20T11:07:32.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.486+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc15bf80 msgr2=0x7f9dcc06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:32.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.486+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc15bf80 0x7f9dcc06c9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9db4000c00 tx=0x7f9db40046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.487+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 shutdown_connections 2024-01-20T11:07:32.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.487+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dcc0cb4c0 0x7f9dcc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.487+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc15bf80 0x7f9dcc06c9e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.487+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9da406aed0 0x7f9da406d390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.487+0000 7f9dd2600640 1 --2- 172.21.15.162:0/2646738320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc144ea0 0x7f9dcc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.487+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 >> 172.21.15.162:0/2646738320 conn(0x7f9dcc06e980 msgr2=0x7f9dcc0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:32.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.488+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 shutdown_connections 2024-01-20T11:07:32.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.488+0000 7f9dd2600640 1 -- 172.21.15.162:0/2646738320 wait complete. 2024-01-20T11:07:32.520 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:32.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.696+0000 7fc0cfe00640 1 Processor -- start 2024-01-20T11:07:32.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.696+0000 7fc0cfe00640 1 -- start start 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc0d013e040 0x7fc0d00cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cfe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d00cd9c0 0x7fc0d00cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cfe00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d00cc570 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d015fe00 con 0x7fc0d013e040 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cfe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d015b910 con 0x7fc0d00cd9c0 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc0d013e040 0x7fc0d00cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc0d013e040 0x7fc0d00cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54520/0 (socket says 172.21.15.162:54520) 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0cea00640 1 -- 172.21.15.162:0/1140442905 learned_addr learned my addr 172.21.15.162:0/1140442905 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.698+0000 7fc0c7e00640 1 --2- 172.21.15.162:0/1140442905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d00cd9c0 0x7fc0d00cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:32.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.699+0000 7fc0cea00640 1 -- 172.21.15.162:0/1140442905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d00cd9c0 msgr2=0x7fc0d00cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:32.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.699+0000 7fc0cea00640 1 --2- 172.21.15.162:0/1140442905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d00cd9c0 0x7fc0d00cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.699+0000 7fc0cea00640 1 -- 172.21.15.162:0/1140442905 >> v1:172.21.15.179:6789/0 conn(0x7fc0d00cb9d0 legacy=0x7fc0d00cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:32.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.699+0000 7fc0cea00640 1 -- 172.21.15.162:0/1140442905 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d015bbf0 con 0x7fc0d013e040 2024-01-20T11:07:32.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.700+0000 7fc0cea00640 1 --2- 172.21.15.162:0/1140442905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d013e040 0x7fc0d00cf370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009870 tx=0x7fc0c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37580ed18f0a3920 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:32.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.700+0000 7fc0ce000640 1 -- 172.21.15.162:0/1140442905 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00317c0 con 0x7fc0d013e040 2024-01-20T11:07:32.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.700+0000 7fc0ce000640 1 -- 172.21.15.162:0/1140442905 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0031920 con 0x7fc0d013e040 2024-01-20T11:07:32.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.700+0000 7fc0ce000640 1 -- 172.21.15.162:0/1140442905 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0031cb0 con 0x7fc0d013e040 2024-01-20T11:07:32.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 -- 172.21.15.162:0/1140442905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d013e040 msgr2=0x7fc0d00cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:32.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/1140442905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d013e040 0x7fc0d00cf370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009870 tx=0x7fc0c002b860 comp rx=0 tx=0).stop 2024-01-20T11:07:32.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 -- 172.21.15.162:0/1140442905 shutdown_connections 2024-01-20T11:07:32.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/1140442905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d00cd9c0 0x7fc0d00cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/1140442905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d013e040 0x7fc0d00cf370 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 -- 172.21.15.162:0/1140442905 >> 172.21.15.162:0/1140442905 conn(0x7fc0d006aa20 msgr2=0x7fc0d006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:32.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 -- 172.21.15.162:0/1140442905 shutdown_connections 2024-01-20T11:07:32.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.701+0000 7fc0cfe00640 1 -- 172.21.15.162:0/1140442905 wait complete. 2024-01-20T11:07:32.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.703+0000 7fc0cfe00640 1 Processor -- start 2024-01-20T11:07:32.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.703+0000 7fc0cfe00640 1 -- start start 2024-01-20T11:07:32.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d00cb9d0 0x7fc0d013c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:32.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cfe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d00cd9c0 0x7fc0d0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:32.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cfe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d013e040 0x7fc0d0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:32.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d013f370 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cfe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d013f650 con 0x7fc0d00cd9c0 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cfe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d013f930 con 0x7fc0d013e040 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d00cb9d0 0x7fc0d013c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d00cb9d0 0x7fc0d013c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54536/0 (socket says 172.21.15.162:54536) 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 -- 172.21.15.162:0/737628081 learned_addr learned my addr 172.21.15.162:0/737628081 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0c7e00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d00cd9c0 0x7fc0d0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 -- 172.21.15.162:0/737628081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d013e040 msgr2=0x7fc0d0152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d013e040 0x7fc0d0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 -- 172.21.15.162:0/737628081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d00cd9c0 msgr2=0x7fc0d0152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d00cd9c0 0x7fc0d0152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.704+0000 7fc0cea00640 1 -- 172.21.15.162:0/737628081 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00094d0 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.705+0000 7fc0cea00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d00cb9d0 0x7fc0d013c850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009870 tx=0x7fc0c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.705+0000 7fc0c6a00640 1 -- 172.21.15.162:0/737628081 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0032860 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.705+0000 7fc0c6a00640 1 -- 172.21.15.162:0/737628081 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c00329c0 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.705+0000 7fc0c6a00640 1 -- 172.21.15.162:0/737628081 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0032d70 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.705+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d013fc10 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.705+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d013cd90 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.706+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d0074a30 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.707+0000 7fc0c6a00640 1 -- 172.21.15.162:0/737628081 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc0c004d3f0 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.708+0000 7fc0c6a00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0a806aed0 0x7fc0a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:32.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.708+0000 7fc0c6a00640 1 -- 172.21.15.162:0/737628081 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0c00ab540 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.708+0000 7fc0c7e00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0a806aed0 0x7fc0a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:32.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.709+0000 7fc0c7e00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0a806aed0 0x7fc0a806d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8006fd0 tx=0x7fc0b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:32.713 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.713+0000 7fc0c6a00640 1 -- 172.21.15.162:0/737628081 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc0c0076370 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.902+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0d0140130 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.905+0000 7fc0c6a00640 1 -- 172.21.15.162:0/737628081 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16543 (secure 0 0 0) 0x7fc0d0140130 con 0x7fc0d00cb9d0 2024-01-20T11:07:32.906 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:32.906 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":21,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:31.926293+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0a806aed0 msgr2=0x7fc0a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0a806aed0 0x7fc0a806d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8006fd0 tx=0x7fc0b8008040 comp rx=0 tx=0).stop 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d00cb9d0 msgr2=0x7fc0d013c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d00cb9d0 0x7fc0d013c850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009870 tx=0x7fc0c00046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 shutdown_connections 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d013e040 0x7fc0d0152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0a806aed0 0x7fc0a806d390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d00cd9c0 0x7fc0d0152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 --2- 172.21.15.162:0/737628081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d00cb9d0 0x7fc0d013c850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:32.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.907+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 >> 172.21.15.162:0/737628081 conn(0x7fc0d006aa20 msgr2=0x7fc0d006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:32.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.908+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 shutdown_connections 2024-01-20T11:07:32.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:32.908+0000 7fc0cfe00640 1 -- 172.21.15.162:0/737628081 wait complete. 2024-01-20T11:07:32.925 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:33.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.126+0000 7f835f400640 1 Processor -- start 2024-01-20T11:07:33.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.126+0000 7f835f400640 1 -- start start 2024-01-20T11:07:33.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.127+0000 7f835f400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f83580cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.127+0000 7f835f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f83580b55b0 0x7f83580ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.127+0000 7f835f400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f835806d040 0x7f83580ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.127+0000 7f835f400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835806ce20 con 0x7f83580b55b0 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.127+0000 7f835f400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835806c210 con 0x7f835806d040 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.127+0000 7f835f400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835806c4f0 con 0x7f83580b51d0 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f83580b55b0 0x7f83580ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f83580b55b0 0x7f83580ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54550/0 (socket says 172.21.15.162:54550) 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 -- 172.21.15.162:0/2275063773 learned_addr learned my addr 172.21.15.162:0/2275063773 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f835d400640 1 --2- 172.21.15.162:0/2275063773 >> v2:172.21.15.179:3300/0 conn(0x7f835806d040 0x7f83580ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 -- 172.21.15.162:0/2275063773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 msgr2=0x7f83580cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 --2- 172.21.15.162:0/2275063773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f83580cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 -- 172.21.15.162:0/2275063773 >> v2:172.21.15.179:3300/0 conn(0x7f835806d040 msgr2=0x7f83580ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 --2- 172.21.15.162:0/2275063773 >> v2:172.21.15.179:3300/0 conn(0x7f835806d040 0x7f83580ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.128+0000 7f8357e00640 1 -- 172.21.15.162:0/2275063773 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835806c7d0 con 0x7f83580b55b0 2024-01-20T11:07:33.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.129+0000 7f8357e00640 1 --2- 172.21.15.162:0/2275063773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f83580ce3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83580d40b0 tx=0x7f834002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8851bad83a3ee1cf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:33.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f8357400640 1 -- 172.21.15.162:0/2275063773 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834002c9e0 con 0x7f83580b55b0 2024-01-20T11:07:33.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f8357400640 1 -- 172.21.15.162:0/2275063773 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834002cb40 con 0x7f83580b55b0 2024-01-20T11:07:33.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f8357400640 1 -- 172.21.15.162:0/2275063773 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400343f0 con 0x7f83580b55b0 2024-01-20T11:07:33.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f835f400640 1 -- 172.21.15.162:0/2275063773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 msgr2=0x7f83580ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f835f400640 1 --2- 172.21.15.162:0/2275063773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f83580ce3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83580d40b0 tx=0x7f834002be40 comp rx=0 tx=0).stop 2024-01-20T11:07:33.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f835f400640 1 -- 172.21.15.162:0/2275063773 shutdown_connections 2024-01-20T11:07:33.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f835f400640 1 --2- 172.21.15.162:0/2275063773 >> v2:172.21.15.179:3300/0 conn(0x7f835806d040 0x7f83580ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f835f400640 1 --2- 172.21.15.162:0/2275063773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f83580ce3a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f835f400640 1 --2- 172.21.15.162:0/2275063773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f83580cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.130+0000 7f835f400640 1 -- 172.21.15.162:0/2275063773 >> 172.21.15.162:0/2275063773 conn(0x7f835809c790 msgr2=0x7f83580d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:33.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.131+0000 7f835f400640 1 -- 172.21.15.162:0/2275063773 shutdown_connections 2024-01-20T11:07:33.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.131+0000 7f835f400640 1 -- 172.21.15.162:0/2275063773 wait complete. 2024-01-20T11:07:33.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.132+0000 7f835f400640 1 Processor -- start 2024-01-20T11:07:33.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.132+0000 7f835f400640 1 -- start start 2024-01-20T11:07:33.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.133+0000 7f835f400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f835806d040 0x7f8358151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.133+0000 7f835f400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f835809d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.133+0000 7f835f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f835809ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.133+0000 7f835f400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835809e7d0 con 0x7f83580b55b0 2024-01-20T11:07:33.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.133+0000 7f835f400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8358152440 con 0x7f835806d040 2024-01-20T11:07:33.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.133+0000 7f835f400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835809dbc0 con 0x7f83580b51d0 2024-01-20T11:07:33.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.133+0000 7f835d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f835809ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f835809ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54556/0 (socket says 172.21.15.162:54556) 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 -- 172.21.15.162:0/1933281594 learned_addr learned my addr 172.21.15.162:0/1933281594 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835ca00640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f835806d040 0x7f8358151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f8357e00640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f835809d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 -- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 msgr2=0x7f835809d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f835809d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 -- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f835806d040 msgr2=0x7f8358151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f835806d040 0x7f8358151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 -- 172.21.15.162:0/1933281594 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340009b30 con 0x7f83580b55b0 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f8357e00640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f835809d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f835d400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f835809ea40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f835000d800 tx=0x7f835000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.134+0000 7f8354c00640 1 -- 172.21.15.162:0/1933281594 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000b6c0 con 0x7f83580b55b0 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.135+0000 7f8354c00640 1 -- 172.21.15.162:0/1933281594 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835000b840 con 0x7f83580b55b0 2024-01-20T11:07:33.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.135+0000 7f8354c00640 1 -- 172.21.15.162:0/1933281594 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000bbf0 con 0x7f83580b55b0 2024-01-20T11:07:33.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.135+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835809dea0 con 0x7f83580b55b0 2024-01-20T11:07:33.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.135+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835809e460 con 0x7f83580b55b0 2024-01-20T11:07:33.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.136+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835804e970 con 0x7f83580b55b0 2024-01-20T11:07:33.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.137+0000 7f8354c00640 1 -- 172.21.15.162:0/1933281594 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f835000bd50 con 0x7f83580b55b0 2024-01-20T11:07:33.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.137+0000 7f8354c00640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f833006af00 0x7f833006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.138+0000 7f8354c00640 1 -- 172.21.15.162:0/1933281594 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8350089c00 con 0x7f83580b55b0 2024-01-20T11:07:33.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.138+0000 7f835ca00640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f833006af00 0x7f833006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.138+0000 7f835ca00640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f833006af00 0x7f833006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8348009890 tx=0x7f8348008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:33.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.142+0000 7f8354c00640 1 -- 172.21.15.162:0/1933281594 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8350054a30 con 0x7f83580b55b0 2024-01-20T11:07:33.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.338+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83580d1eb0 con 0x7f83580b55b0 2024-01-20T11:07:33.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.340+0000 7f8354c00640 1 -- 172.21.15.162:0/1933281594 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16543 (secure 0 0 0) 0x7f8350058050 con 0x7f83580b55b0 2024-01-20T11:07:33.341 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:33.341 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":21,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:31.926293+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f833006af00 msgr2=0x7f833006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f833006af00 0x7f833006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8348009890 tx=0x7f8348008040 comp rx=0 tx=0).stop 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 msgr2=0x7f835809ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f835809ea40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f835000d800 tx=0x7f835000dcc0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 shutdown_connections 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83580b55b0 0x7f835809ea40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83580b51d0 0x7f835809d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f833006af00 0x7f833006d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 --2- 172.21.15.162:0/1933281594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f835806d040 0x7f8358151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 >> 172.21.15.162:0/1933281594 conn(0x7f835809c790 msgr2=0x7f83580b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:33.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 shutdown_connections 2024-01-20T11:07:33.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.343+0000 7f835f400640 1 -- 172.21.15.162:0/1933281594 wait complete. 2024-01-20T11:07:33.363 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-20T11:07:33.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.576+0000 7fc18cc00640 1 Processor -- start 2024-01-20T11:07:33.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.576+0000 7fc18cc00640 1 -- start start 2024-01-20T11:07:33.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc18cc00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc18815d5b0 0x7fc18806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc18cc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc188161d20 0x7fc1880cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc18cc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc188162190 con 0x7fc1881618e0 2024-01-20T11:07:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc18cc00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880ae130 con 0x7fc18815d5b0 2024-01-20T11:07:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc18cc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880ae410 con 0x7fc188161d20 2024-01-20T11:07:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc185400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc1881618e0 0x7fc1880b2040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44566/0 (socket says 172.21.15.162:44566) 2024-01-20T11:07:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc185400640 1 -- 172.21.15.162:0/4162234229 learned_addr learned my addr 172.21.15.162:0/4162234229 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.578+0000 7fc185e00640 1 --2- 172.21.15.162:0/4162234229 >> v2:172.21.15.179:3300/0 conn(0x7fc18815d5b0 0x7fc18806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692837152 0 0) 0x7fc188162190 con 0x7fc1881618e0 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc186800640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc188161d20 0x7fc1880cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc168003520 con 0x7fc1881618e0 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1806959583 0 0) 0x7fc168003520 con 0x7fc1881618e0 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc188161d20 msgr2=0x7fc1880cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc188161d20 0x7fc1880cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 >> v2:172.21.15.179:3300/0 conn(0x7fc18815d5b0 msgr2=0x7fc18806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 --2- 172.21.15.162:0/4162234229 >> v2:172.21.15.179:3300/0 conn(0x7fc18815d5b0 0x7fc18806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880ae6f0 con 0x7fc1881618e0 2024-01-20T11:07:33.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fc170001670 con 0x7fc1881618e0 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 >> v1:172.21.15.162:6789/0 conn(0x7fc1881618e0 legacy=0x7fc1880b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc168003970 0x7fc168003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1680047c0 0x7fc168004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc188161d20 0x7fc168005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880ae130 con 0x7fc1680047c0 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880ae410 con 0x7fc168003970 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16800b980 con 0x7fc188161d20 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.579+0000 7fc185400640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1680047c0 0x7fc168004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.580+0000 7fc185e00640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc168003970 0x7fc168003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.580+0000 7fc185400640 1 -- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc188161d20 msgr2=0x7fc168005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.580+0000 7fc185400640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc188161d20 0x7fc168005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.580+0000 7fc185400640 1 -- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc168003970 msgr2=0x7fc168003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.580+0000 7fc185400640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc168003970 0x7fc168003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.580+0000 7fc185400640 1 -- 172.21.15.162:0/4162234229 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168003520 con 0x7fc1680047c0 2024-01-20T11:07:33.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.581+0000 7fc185400640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1680047c0 0x7fc168004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc17000c290 tx=0x7fc1680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2463909577fd1d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:33.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.581+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170005ad0 con 0x7fc1680047c0 2024-01-20T11:07:33.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.581+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc170005c30 con 0x7fc1680047c0 2024-01-20T11:07:33.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.581+0000 7fc184a00640 1 -- 172.21.15.162:0/4162234229 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17002c8d0 con 0x7fc1680047c0 2024-01-20T11:07:33.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.582+0000 7fc18cc00640 1 -- 172.21.15.162:0/4162234229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1680047c0 msgr2=0x7fc168004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.582+0000 7fc18cc00640 1 --2- 172.21.15.162:0/4162234229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1680047c0 0x7fc168004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc17000c290 tx=0x7fc1680057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.582+0000 7fc186800640 1 -- 172.21.15.162:0/4162234229 reap_dead start 2024-01-20T11:07:33.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.582+0000 7fc18cc00640 1 -- 172.21.15.162:0/4162234229 shutdown_connections 2024-01-20T11:07:33.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.582+0000 7fc18cc00640 1 -- 172.21.15.162:0/4162234229 >> 172.21.15.162:0/4162234229 conn(0x7fc18806a600 msgr2=0x7fc18806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:33.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.582+0000 7fc18cc00640 1 -- 172.21.15.162:0/4162234229 shutdown_connections 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.582+0000 7fc18cc00640 1 -- 172.21.15.162:0/4162234229 wait complete. 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.584+0000 7fc18cc00640 1 Processor -- start 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.584+0000 7fc18cc00640 1 -- start start 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc18cc00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1680047c0 0x7fc1881f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc18cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc188155ef0 0x7fc1880aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc18cc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1880afd20 0x7fc1880b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc18cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880b0710 con 0x7fc188155ef0 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc18cc00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880af400 con 0x7fc1680047c0 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc18cc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880af6e0 con 0x7fc1880afd20 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc185400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc188155ef0 0x7fc1880aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc185400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc188155ef0 0x7fc1880aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54578/0 (socket says 172.21.15.162:54578) 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc185400640 1 -- 172.21.15.162:0/784912710 learned_addr learned my addr 172.21.15.162:0/784912710 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc185e00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1680047c0 0x7fc1881f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc186800640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1880afd20 0x7fc1880b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.585+0000 7fc185400640 1 -- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1880afd20 msgr2=0x7fc1880b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc185400640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1880afd20 0x7fc1880b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc185400640 1 -- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1680047c0 msgr2=0x7fc1881f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc185400640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1680047c0 0x7fc1881f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc185400640 1 -- 172.21.15.162:0/784912710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18815db10 con 0x7fc188155ef0 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc186800640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1880afd20 0x7fc1880b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc185400640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc188155ef0 0x7fc1880aebb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc17000c3b0 tx=0x7fc170000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc17e000640 1 -- 172.21.15.162:0/784912710 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17002cce0 con 0x7fc188155ef0 2024-01-20T11:07:33.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc17e000640 1 -- 172.21.15.162:0/784912710 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17002ce80 con 0x7fc188155ef0 2024-01-20T11:07:33.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc17e000640 1 -- 172.21.15.162:0/784912710 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1700072b0 con 0x7fc188155ef0 2024-01-20T11:07:33.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1880af9c0 con 0x7fc188155ef0 2024-01-20T11:07:33.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.586+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1881f42c0 con 0x7fc188155ef0 2024-01-20T11:07:33.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.588+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1881f4450 con 0x7fc188155ef0 2024-01-20T11:07:33.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.588+0000 7fc17e000640 1 -- 172.21.15.162:0/784912710 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc170032070 con 0x7fc188155ef0 2024-01-20T11:07:33.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.589+0000 7fc17e000640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc16006af00 0x7fc16006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:33.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.589+0000 7fc17e000640 1 -- 172.21.15.162:0/784912710 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc17003c040 con 0x7fc188155ef0 2024-01-20T11:07:33.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.589+0000 7fc185e00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc16006af00 0x7fc16006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:33.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.590+0000 7fc185e00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc16006af00 0x7fc16006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc18815bc30 tx=0x7fc17800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:33.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.593+0000 7fc17e000640 1 -- 172.21.15.162:0/784912710 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc1700759f0 con 0x7fc188155ef0 2024-01-20T11:07:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:33.829+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc18804e970 con 0x7fc188155ef0 2024-01-20T11:07:34.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.551+0000 7fc17e000640 1 -- 172.21.15.162:0/784912710 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc170045070 con 0x7fc188155ef0 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc16006af00 msgr2=0x7fc16006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc16006af00 0x7fc16006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc18815bc30 tx=0x7fc17800b040 comp rx=0 tx=0).stop 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc188155ef0 msgr2=0x7fc1880aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc188155ef0 0x7fc1880aebb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc17000c3b0 tx=0x7fc170000fe0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 shutdown_connections 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1880afd20 0x7fc1880b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc188155ef0 0x7fc1880aebb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc16006af00 0x7fc16006d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 --2- 172.21.15.162:0/784912710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1680047c0 0x7fc1881f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 >> 172.21.15.162:0/784912710 conn(0x7fc18806a600 msgr2=0x7fc1880718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 shutdown_connections 2024-01-20T11:07:34.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.555+0000 7fc18cc00640 1 -- 172.21.15.162:0/784912710 wait complete. 2024-01-20T11:07:34.575 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T11:07:34.575 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-20T11:07:34.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.791+0000 7f2b03c00640 1 Processor -- start 2024-01-20T11:07:34.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.791+0000 7f2b03c00640 1 -- start start 2024-01-20T11:07:34.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.793+0000 7f2b03c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc15d5a0 0x7f2afc0b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.793+0000 7f2b03c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc0cec90 con 0x7f2afc0d0400 2024-01-20T11:07:34.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.793+0000 7f2b03c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc0d2730 con 0x7f2afc0d2250 2024-01-20T11:07:34.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.793+0000 7f2b03c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0d2a10 con 0x7f2afc15d5a0 2024-01-20T11:07:34.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.794+0000 7f2b01c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2afc0d0400 0x7f2afc0d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44574/0 (socket says 172.21.15.162:44574) 2024-01-20T11:07:34.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.794+0000 7f2b01c00640 1 -- 172.21.15.162:0/3033891411 learned_addr learned my addr 172.21.15.162:0/3033891411 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:34.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.794+0000 7f2b01200640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc15d5a0 0x7f2afc0b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:34.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.794+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515676242 0 0) 0x7f2afc0cec90 con 0x7f2afc0d0400 2024-01-20T11:07:34.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.794+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc003520 con 0x7f2afc0d0400 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.794+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3178303662 0 0) 0x7f2adc003520 con 0x7f2afc0d0400 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc15d5a0 msgr2=0x7f2afc0b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc15d5a0 0x7f2afc0b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 >> v1:172.21.15.179:6789/0 conn(0x7f2afc0d2250 legacy=0x7f2afc0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0d2cf0 con 0x7f2afc0d0400 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f2af4001670 con 0x7f2afc0d0400 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 >> v1:172.21.15.162:6789/0 conn(0x7f2afc0d0400 legacy=0x7f2afc0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:34.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2adc0039a0 0x7f2adc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc15d5a0 0x7f2adc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc004d00 0x7f2adc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0d2a10 con 0x7f2adc0039a0 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc00ba30 con 0x7f2adc004d00 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc00bbf0 con 0x7f2afc15d5a0 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2b01200640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2adc0039a0 0x7f2adc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2b01200640 1 -- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc15d5a0 msgr2=0x7f2adc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2b01200640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc15d5a0 0x7f2adc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2b01200640 1 -- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc004d00 msgr2=0x7f2adc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2b01200640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc004d00 0x7f2adc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.795+0000 7f2b01200640 1 -- 172.21.15.162:0/3033891411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc003520 con 0x7f2adc0039a0 2024-01-20T11:07:34.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.796+0000 7f2b01200640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2adc0039a0 0x7f2adc003dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009f90 tx=0x7f2adc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40ac5e4ce64cd30 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec02cc20 con 0x7f2adc0039a0 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00f040 con 0x7f2adc0039a0 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2afbe00640 1 -- 172.21.15.162:0/3033891411 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec034440 con 0x7f2adc0039a0 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2b03c00640 1 -- 172.21.15.162:0/3033891411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2adc0039a0 msgr2=0x7f2adc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2b03c00640 1 --2- 172.21.15.162:0/3033891411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2adc0039a0 0x7f2adc003dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009f90 tx=0x7f2adc0057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2b01c00640 1 -- 172.21.15.162:0/3033891411 reap_dead start 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2b03c00640 1 -- 172.21.15.162:0/3033891411 shutdown_connections 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2b03c00640 1 -- 172.21.15.162:0/3033891411 >> 172.21.15.162:0/3033891411 conn(0x7f2afc066760 msgr2=0x7f2afc066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.797+0000 7f2b03c00640 1 -- 172.21.15.162:0/3033891411 shutdown_connections 2024-01-20T11:07:34.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.798+0000 7f2b03c00640 1 -- 172.21.15.162:0/3033891411 wait complete. 2024-01-20T11:07:34.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.799+0000 7f2b03c00640 1 Processor -- start 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.799+0000 7f2b03c00640 1 -- start start 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.800+0000 7f2b03c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc0039a0 0x7f2afc1e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.800+0000 7f2b03c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc1e8ed0 0x7f2afc15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.800+0000 7f2b03c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc1527f0 0x7f2afc152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.800+0000 7f2b03c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0c8490 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.800+0000 7f2b03c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc1e9440 con 0x7f2adc0039a0 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.800+0000 7f2b03c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc1e9720 con 0x7f2afc1527f0 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc1e8ed0 0x7f2afc15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc1e8ed0 0x7f2afc15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54598/0 (socket says 172.21.15.162:54598) 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 -- 172.21.15.162:0/3296225193 learned_addr learned my addr 172.21.15.162:0/3296225193 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2b01200640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc0039a0 0x7f2afc1e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:34.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 -- 172.21.15.162:0/3296225193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc1527f0 msgr2=0x7f2afc152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc1527f0 0x7f2afc152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 -- 172.21.15.162:0/3296225193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc0039a0 msgr2=0x7f2afc1e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc0039a0 0x7f2afc1e7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 -- 172.21.15.162:0/3296225193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc1e9a00 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af3c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc1e8ed0 0x7f2afc15a630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400c500 tx=0x7f2ae400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.801+0000 7f2af9600640 1 -- 172.21.15.162:0/3296225193 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40052d0 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.802+0000 7f2af9600640 1 -- 172.21.15.162:0/3296225193 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4005430 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.802+0000 7f2af9600640 1 -- 172.21.15.162:0/3296225193 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4012870 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.802+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc0c80b0 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.802+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc1e8210 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.803+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc04e970 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.804+0000 7f2af9600640 1 -- 172.21.15.162:0/3296225193 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2ae40129d0 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.805+0000 7f2af9600640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ad406aed0 0x7f2ad406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:34.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.805+0000 7f2af9600640 1 -- 172.21.15.162:0/3296225193 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ae4089320 con 0x7f2afc1e8ed0 2024-01-20T11:07:34.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.806+0000 7f2b01200640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ad406aed0 0x7f2ad406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:34.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.807+0000 7f2b01200640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ad406aed0 0x7f2ad406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aec036000 tx=0x7f2aec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:34.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:34.810+0000 7f2af9600640 1 -- 172.21.15.162:0/3296225193 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2ae4054150 con 0x7f2afc1e8ed0 2024-01-20T11:07:35.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.044+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2afc1e9bf0 con 0x7f2afc1e8ed0 2024-01-20T11:07:35.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.554+0000 7f2af9600640 1 -- 172.21.15.162:0/3296225193 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ae4057770 con 0x7f2afc1e8ed0 2024-01-20T11:07:35.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ad406aed0 msgr2=0x7f2ad406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:35.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ad406aed0 0x7f2ad406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aec036000 tx=0x7f2aec02e000 comp rx=0 tx=0).stop 2024-01-20T11:07:35.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc1e8ed0 msgr2=0x7f2afc15a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:35.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc1e8ed0 0x7f2afc15a630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400c500 tx=0x7f2ae400c9c0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 shutdown_connections 2024-01-20T11:07:35.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc1527f0 0x7f2afc152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc1e8ed0 0x7f2afc15a630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ad406aed0 0x7f2ad406d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 --2- 172.21.15.162:0/3296225193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2adc0039a0 0x7f2afc1e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 >> 172.21.15.162:0/3296225193 conn(0x7f2afc066760 msgr2=0x7f2afc15b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:35.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.558+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 shutdown_connections 2024-01-20T11:07:35.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.559+0000 7f2b03c00640 1 -- 172.21.15.162:0/3296225193 wait complete. 2024-01-20T11:07:35.581 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-20T11:07:35.581 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:07:35.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.793+0000 7fb615400640 1 Processor -- start 2024-01-20T11:07:35.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.793+0000 7fb615400640 1 -- start start 2024-01-20T11:07:35.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.795+0000 7fb615400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb610155a30 0x7fb6100ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:35.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.795+0000 7fb615400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6100ae6b0 0x7fb61006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:35.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.795+0000 7fb615400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb610070b60 con 0x7fb610070630 2024-01-20T11:07:35.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.795+0000 7fb615400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61015ba10 con 0x7fb610155a30 2024-01-20T11:07:35.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.795+0000 7fb615400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015bc00 con 0x7fb6100ae6b0 2024-01-20T11:07:35.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.795+0000 7fb60e800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb610155a30 0x7fb6100ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:35.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.795+0000 7fb60f200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6100ae6b0 0x7fb61006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:35.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60e800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb610155a30 0x7fb6100ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:32962/0 (socket says 172.21.15.162:32962) 2024-01-20T11:07:35.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60f200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6100ae6b0 0x7fb61006c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:59314/0 (socket says 172.21.15.162:59314) 2024-01-20T11:07:35.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60e800640 1 -- 172.21.15.162:0/4258698263 learned_addr learned my addr 172.21.15.162:0/4258698263 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:35.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60e800640 1 -- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6100ae6b0 msgr2=0x7fb61006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:35.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60e800640 1 --2- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6100ae6b0 0x7fb61006c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60e800640 1 -- 172.21.15.162:0/4258698263 >> v1:172.21.15.179:6789/0 conn(0x7fb610070630 legacy=0x7fb6100adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:35.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60e800640 1 -- 172.21.15.162:0/4258698263 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61015bee0 con 0x7fb610155a30 2024-01-20T11:07:35.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.796+0000 7fb60f200640 1 --2- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6100ae6b0 0x7fb61006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:35.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.798+0000 7fb60e800640 1 --2- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb610155a30 0x7fb6100ce800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb600009870 tx=0x7fb60002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d014e786d8ab483 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:35.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.798+0000 7fb60de00640 1 -- 172.21.15.162:0/4258698263 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600031640 con 0x7fb610155a30 2024-01-20T11:07:35.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.798+0000 7fb60de00640 1 -- 172.21.15.162:0/4258698263 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6000317a0 con 0x7fb610155a30 2024-01-20T11:07:35.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.798+0000 7fb60de00640 1 -- 172.21.15.162:0/4258698263 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600031b30 con 0x7fb610155a30 2024-01-20T11:07:35.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 -- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb610155a30 msgr2=0x7fb6100ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:35.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 --2- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb610155a30 0x7fb6100ce800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb600009870 tx=0x7fb60002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 -- 172.21.15.162:0/4258698263 shutdown_connections 2024-01-20T11:07:35.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 --2- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6100ae6b0 0x7fb61006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 --2- 172.21.15.162:0/4258698263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb610155a30 0x7fb6100ce800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 -- 172.21.15.162:0/4258698263 >> 172.21.15.162:0/4258698263 conn(0x7fb6100b0cd0 msgr2=0x7fb6100b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:35.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 -- 172.21.15.162:0/4258698263 shutdown_connections 2024-01-20T11:07:35.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.799+0000 7fb615400640 1 -- 172.21.15.162:0/4258698263 wait complete. 2024-01-20T11:07:35.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.800+0000 7fb615400640 1 Processor -- start 2024-01-20T11:07:35.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.801+0000 7fb615400640 1 -- start start 2024-01-20T11:07:35.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.801+0000 7fb615400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb610070630 0x7fb6101445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.801+0000 7fb615400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6100ae6b0 0x7fb610143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb615400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb610155a30 0x7fb6100ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb615400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c9fb0 con 0x7fb610155a30 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb615400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c93a0 con 0x7fb6100ae6b0 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb615400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c9680 con 0x7fb610070630 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb610155a30 0x7fb6100ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb610155a30 0x7fb6100ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54604/0 (socket says 172.21.15.162:54604) 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 -- 172.21.15.162:0/1838903353 learned_addr learned my addr 172.21.15.162:0/1838903353 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60e800640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb610070630 0x7fb6101445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb607e00640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6100ae6b0 0x7fb610143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 -- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb610070630 msgr2=0x7fb6101445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb610070630 0x7fb6101445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 -- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6100ae6b0 msgr2=0x7fb610143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6100ae6b0 0x7fb610143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.802+0000 7fb60f200640 1 -- 172.21.15.162:0/1838903353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608009a70 con 0x7fb610155a30 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.803+0000 7fb60f200640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb610155a30 0x7fb6100ceec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb60800efc0 tx=0x7fb608009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.803+0000 7fb606a00640 1 -- 172.21.15.162:0/1838903353 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608009d70 con 0x7fb610155a30 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.803+0000 7fb606a00640 1 -- 172.21.15.162:0/1838903353 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60800f040 con 0x7fb610155a30 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.803+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6000094d0 con 0x7fb610155a30 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.803+0000 7fb606a00640 1 -- 172.21.15.162:0/1838903353 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608003990 con 0x7fb610155a30 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.803+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6100c9c40 con 0x7fb610155a30 2024-01-20T11:07:35.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.804+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6100ca120 con 0x7fb610155a30 2024-01-20T11:07:35.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.805+0000 7fb606a00640 1 -- 172.21.15.162:0/1838903353 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb6080144a0 con 0x7fb610155a30 2024-01-20T11:07:35.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.806+0000 7fb606a00640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb5e806aed0 0x7fb5e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:35.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.806+0000 7fb606a00640 1 -- 172.21.15.162:0/1838903353 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb60808a2b0 con 0x7fb610155a30 2024-01-20T11:07:35.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.806+0000 7fb60e800640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb5e806aed0 0x7fb5e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:35.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.807+0000 7fb60e800640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb5e806aed0 0x7fb5e806d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb600036000 tx=0x7fb60003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:35.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:35.810+0000 7fb606a00640 1 -- 172.21.15.162:0/1838903353 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb608055170 con 0x7fb610155a30 2024-01-20T11:07:35.882 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-01-20T11:07:35.882+0000 7f30c7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T11:07:36.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.041+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb61004e970 con 0x7fb610155a30 2024-01-20T11:07:36.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.042+0000 7fb606a00640 1 -- 172.21.15.162:0/1838903353 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fb608058790 con 0x7fb610155a30 2024-01-20T11:07:36.042 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:36.043 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:07:36.043 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:07:36.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb5e806aed0 msgr2=0x7fb5e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb5e806aed0 0x7fb5e806d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb600036000 tx=0x7fb60003c040 comp rx=0 tx=0).stop 2024-01-20T11:07:36.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb610155a30 msgr2=0x7fb6100ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb610155a30 0x7fb6100ceec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb60800efc0 tx=0x7fb608009f90 comp rx=0 tx=0).stop 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 shutdown_connections 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb610155a30 0x7fb6100ceec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb5e806aed0 0x7fb5e806d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6100ae6b0 0x7fb610143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 --2- 172.21.15.162:0/1838903353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb610070630 0x7fb6101445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 >> 172.21.15.162:0/1838903353 conn(0x7fb6100b0cd0 msgr2=0x7fb6100ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 shutdown_connections 2024-01-20T11:07:36.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.045+0000 7fb615400640 1 -- 172.21.15.162:0/1838903353 wait complete. 2024-01-20T11:07:36.064 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:36.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.276+0000 7f8491400640 1 Processor -- start 2024-01-20T11:07:36.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.276+0000 7f8491400640 1 -- start start 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f8491400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f848c15a530 0x7f848c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f8491400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f848c06deb0 0x7f848c0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f8491400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c15a910 con 0x7f848c071260 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f8491400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c0ca390 con 0x7f848c06deb0 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f8491400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c072960 con 0x7f848c15a530 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f848b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f848c06deb0 0x7f848c0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f848b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f848c06deb0 0x7f848c0716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54618/0 (socket says 172.21.15.162:54618) 2024-01-20T11:07:36.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f848b200640 1 -- 172.21.15.162:0/4222645849 learned_addr learned my addr 172.21.15.162:0/4222645849 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:36.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.278+0000 7f848a800640 1 --2- 172.21.15.162:0/4222645849 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a530 0x7f848c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.279+0000 7f848b200640 1 -- 172.21.15.162:0/4222645849 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a530 msgr2=0x7f848c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:36.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.279+0000 7f848b200640 1 --2- 172.21.15.162:0/4222645849 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a530 0x7f848c0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.279+0000 7f848b200640 1 -- 172.21.15.162:0/4222645849 >> v1:172.21.15.179:6789/0 conn(0x7f848c071260 legacy=0x7f848c06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:36.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.279+0000 7f848b200640 1 -- 172.21.15.162:0/4222645849 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0ce730 con 0x7f848c06deb0 2024-01-20T11:07:36.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.280+0000 7f848b200640 1 --2- 172.21.15.162:0/4222645849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c06deb0 0x7f848c0716d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f848400d150 tx=0x7f848402e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183d4cbbdffcbcdc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:36.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.280+0000 7f8489e00640 1 -- 172.21.15.162:0/4222645849 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848402ea00 con 0x7f848c06deb0 2024-01-20T11:07:36.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.280+0000 7f8489e00640 1 -- 172.21.15.162:0/4222645849 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848402eb60 con 0x7f848c06deb0 2024-01-20T11:07:36.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.280+0000 7f8489e00640 1 -- 172.21.15.162:0/4222645849 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484009600 con 0x7f848c06deb0 2024-01-20T11:07:36.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 -- 172.21.15.162:0/4222645849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c06deb0 msgr2=0x7f848c0716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 --2- 172.21.15.162:0/4222645849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c06deb0 0x7f848c0716d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f848400d150 tx=0x7f848402e060 comp rx=0 tx=0).stop 2024-01-20T11:07:36.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 -- 172.21.15.162:0/4222645849 shutdown_connections 2024-01-20T11:07:36.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 --2- 172.21.15.162:0/4222645849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c06deb0 0x7f848c0716d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 --2- 172.21.15.162:0/4222645849 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a530 0x7f848c0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 -- 172.21.15.162:0/4222645849 >> 172.21.15.162:0/4222645849 conn(0x7f848c0b0cd0 msgr2=0x7f848c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:36.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 -- 172.21.15.162:0/4222645849 shutdown_connections 2024-01-20T11:07:36.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.281+0000 7f8491400640 1 -- 172.21.15.162:0/4222645849 wait complete. 2024-01-20T11:07:36.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.283+0000 7f8491400640 1 Processor -- start 2024-01-20T11:07:36.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.283+0000 7f8491400640 1 -- start start 2024-01-20T11:07:36.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8491400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c06deb0 0x7f848c099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8491400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c071260 0x7f848c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8491400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c15a530 0x7f848c1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8491400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1595b0 con 0x7f848c071260 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8491400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c159890 con 0x7f848c15a530 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8491400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c159b70 con 0x7f848c06deb0 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c071260 0x7f848c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c071260 0x7f848c158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54622/0 (socket says 172.21.15.162:54622) 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 -- 172.21.15.162:0/881810289 learned_addr learned my addr 172.21.15.162:0/881810289 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f848a800640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c06deb0 0x7f848c099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 -- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c06deb0 msgr2=0x7f848c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c06deb0 0x7f848c099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 -- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c15a530 msgr2=0x7f848c1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f848b200640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c15a530 0x7f848c1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c15a530 0x7f848c1495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.284+0000 7f8483e00640 1 -- 172.21.15.162:0/881810289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848400bd40 con 0x7f848c071260 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.285+0000 7f8483e00640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c071260 0x7f848c158b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f847400c430 tx=0x7f847400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.285+0000 7f8482a00640 1 -- 172.21.15.162:0/881810289 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474011790 con 0x7f848c071260 2024-01-20T11:07:36.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.285+0000 7f8482a00640 1 -- 172.21.15.162:0/881810289 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84740118f0 con 0x7f848c071260 2024-01-20T11:07:36.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.285+0000 7f8482a00640 1 -- 172.21.15.162:0/881810289 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474011ce0 con 0x7f848c071260 2024-01-20T11:07:36.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.285+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c0b1e30 con 0x7f848c071260 2024-01-20T11:07:36.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.285+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c1585c0 con 0x7f848c071260 2024-01-20T11:07:36.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.286+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c0b2020 con 0x7f848c071260 2024-01-20T11:07:36.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.287+0000 7f8482a00640 1 -- 172.21.15.162:0/881810289 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f847401c460 con 0x7f848c071260 2024-01-20T11:07:36.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.288+0000 7f8482a00640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f846406aed0 0x7f846406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.288+0000 7f8482a00640 1 -- 172.21.15.162:0/881810289 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8474089690 con 0x7f848c071260 2024-01-20T11:07:36.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.288+0000 7f848a800640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f846406aed0 0x7f846406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.289+0000 7f848a800640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f846406aed0 0x7f846406d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f847c006fd0 tx=0x7f847c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:36.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.292+0000 7f8482a00640 1 -- 172.21.15.162:0/881810289 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f84740544c0 con 0x7f848c071260 2024-01-20T11:07:36.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.487+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f848c04e970 con 0x7f848c071260 2024-01-20T11:07:36.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.488+0000 7f8482a00640 1 -- 172.21.15.162:0/881810289 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f8474057ae0 con 0x7f848c071260 2024-01-20T11:07:36.490 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:36.490 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:36.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f846406aed0 msgr2=0x7f846406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f846406aed0 0x7f846406d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f847c006fd0 tx=0x7f847c008040 comp rx=0 tx=0).stop 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c071260 msgr2=0x7f848c158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c071260 0x7f848c158b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f847400c430 tx=0x7f847400c8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 shutdown_connections 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f846406aed0 0x7f846406d390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c15a530 0x7f848c1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f848c071260 0x7f848c158b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 --2- 172.21.15.162:0/881810289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c06deb0 0x7f848c099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.491+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 >> 172.21.15.162:0/881810289 conn(0x7f848c0b0cd0 msgr2=0x7f848c0acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.492+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 shutdown_connections 2024-01-20T11:07:36.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.492+0000 7f8491400640 1 -- 172.21.15.162:0/881810289 wait complete. 2024-01-20T11:07:36.511 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T11:07:36.511 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:07:36.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.720+0000 7fdc82600640 1 Processor -- start 2024-01-20T11:07:36.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.720+0000 7fdc82600640 1 -- start start 2024-01-20T11:07:36.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc82600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 0x7fdc7c06d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc82600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c15b6e0 con 0x7fdc7c0c8350 2024-01-20T11:07:36.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc82600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c0ce580 con 0x7fdc7c15b300 2024-01-20T11:07:36.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc82600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c8c90 con 0x7fdc7c0c8800 2024-01-20T11:07:36.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc73e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fdc7c0c8350 0x7fdc7c06cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33606/0 (socket says 172.21.15.162:33606) 2024-01-20T11:07:36.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc73e00640 1 -- 172.21.15.162:0/2933836540 learned_addr learned my addr 172.21.15.162:0/2933836540 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc7be00640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 0x7fdc7c06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754879315 0 0) 0x7fdc7c15b6e0 con 0x7fdc7c0c8350 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.722+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc5c003520 con 0x7fdc7c0c8350 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2810860931 0 0) 0x7fdc5c003520 con 0x7fdc7c0c8350 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 msgr2=0x7fdc7c06d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 0x7fdc7c06d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 >> v1:172.21.15.179:6789/0 conn(0x7fdc7c15b300 legacy=0x7fdc7c0ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c0cd6d0 con 0x7fdc7c0c8350 2024-01-20T11:07:36.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fdc64001670 con 0x7fdc7c0c8350 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 >> v1:172.21.15.162:6789/0 conn(0x7fdc7c0c8350 legacy=0x7fdc7c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5c0039a0 0x7fdc5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 0x7fdc5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc5c004d00 0x7fdc5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c8c90 con 0x7fdc5c0039a0 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c00bab0 con 0x7fdc5c004d00 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c00bc70 con 0x7fdc7c0c8800 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc7b400640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5c0039a0 0x7fdc5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.723+0000 7fdc73e00640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 0x7fdc5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.724+0000 7fdc7b400640 1 -- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 msgr2=0x7fdc5c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.724+0000 7fdc7b400640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0c8800 0x7fdc5c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.724+0000 7fdc7be00640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc5c004d00 0x7fdc5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.724+0000 7fdc7b400640 1 -- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc5c004d00 msgr2=0x7fdc5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.724+0000 7fdc7b400640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc5c004d00 0x7fdc5c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.724+0000 7fdc7b400640 1 -- 172.21.15.162:0/2933836540 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c003520 con 0x7fdc5c0039a0 2024-01-20T11:07:36.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.725+0000 7fdc7b400640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5c0039a0 0x7fdc5c003dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c001750 tx=0x7fdc5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d485b339da8dfe server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.725+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0052d0 con 0x7fdc5c0039a0 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.725+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c02e050 con 0x7fdc5c0039a0 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.725+0000 7fdc7aa00640 1 -- 172.21.15.162:0/2933836540 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0035f0 con 0x7fdc5c0039a0 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.726+0000 7fdc82600640 1 -- 172.21.15.162:0/2933836540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5c0039a0 msgr2=0x7fdc5c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.726+0000 7fdc82600640 1 --2- 172.21.15.162:0/2933836540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5c0039a0 0x7fdc5c003dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c001750 tx=0x7fdc5c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.726+0000 7fdc7be00640 1 -- 172.21.15.162:0/2933836540 reap_dead start 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.726+0000 7fdc82600640 1 -- 172.21.15.162:0/2933836540 shutdown_connections 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.726+0000 7fdc82600640 1 -- 172.21.15.162:0/2933836540 >> 172.21.15.162:0/2933836540 conn(0x7fdc7c0b0cd0 msgr2=0x7fdc7c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:36.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.726+0000 7fdc82600640 1 -- 172.21.15.162:0/2933836540 shutdown_connections 2024-01-20T11:07:36.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.726+0000 7fdc82600640 1 -- 172.21.15.162:0/2933836540 wait complete. 2024-01-20T11:07:36.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.727+0000 7fdc82600640 1 Processor -- start 2024-01-20T11:07:36.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.728+0000 7fdc82600640 1 -- start start 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.728+0000 7fdc82600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc5c0039a0 0x7fdc7c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.728+0000 7fdc82600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c070f40 0x7fdc7c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.728+0000 7fdc82600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b2210 0x7fdc7c0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.728+0000 7fdc82600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c153780 con 0x7fdc7c0b2210 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.728+0000 7fdc82600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0b2bd0 con 0x7fdc7c070f40 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc82600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c153a20 con 0x7fdc5c0039a0 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b2210 0x7fdc7c0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b2210 0x7fdc7c0b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41058/0 (socket says 172.21.15.162:41058) 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 -- 172.21.15.162:0/3833310366 learned_addr learned my addr 172.21.15.162:0/3833310366 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc73e00640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c070f40 0x7fdc7c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 -- 172.21.15.162:0/3833310366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc5c0039a0 msgr2=0x7fdc7c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc5c0039a0 0x7fdc7c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 -- 172.21.15.162:0/3833310366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c070f40 msgr2=0x7fdc7c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c070f40 0x7fdc7c152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 -- 172.21.15.162:0/3833310366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c071720 con 0x7fdc7c0b2210 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.729+0000 7fdc7be00640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b2210 0x7fdc7c0b2690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c072aa0 tx=0x7fdc7400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.730+0000 7fdc73400640 1 -- 172.21.15.162:0/3833310366 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74017400 con 0x7fdc7c0b2210 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.730+0000 7fdc73400640 1 -- 172.21.15.162:0/3833310366 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74011040 con 0x7fdc7c0b2210 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.730+0000 7fdc73400640 1 -- 172.21.15.162:0/3833310366 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740177c0 con 0x7fdc7c0b2210 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.730+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c071a00 con 0x7fdc7c0b2210 2024-01-20T11:07:36.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.730+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c0713c0 con 0x7fdc7c0b2210 2024-01-20T11:07:36.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.731+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c071f20 con 0x7fdc7c0b2210 2024-01-20T11:07:36.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.732+0000 7fdc73400640 1 -- 172.21.15.162:0/3833310366 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdc74021440 con 0x7fdc7c0b2210 2024-01-20T11:07:36.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.733+0000 7fdc73400640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdc5406aed0 0x7fdc5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:36.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.733+0000 7fdc73400640 1 -- 172.21.15.162:0/3833310366 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc74089830 con 0x7fdc7c0b2210 2024-01-20T11:07:36.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.733+0000 7fdc7b400640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdc5406aed0 0x7fdc5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:36.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.734+0000 7fdc7b400640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdc5406aed0 0x7fdc5406d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c033000 tx=0x7fdc6c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:36.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.737+0000 7fdc73400640 1 -- 172.21.15.162:0/3833310366 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdc740546f0 con 0x7fdc7c0b2210 2024-01-20T11:07:36.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.913+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc7c0cdf30 con 0x7fdc5406aed0 2024-01-20T11:07:36.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.929+0000 7fdc73400640 1 -- 172.21.15.162:0/3833310366 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264425 (secure 0 0 0) 0x7fdc6c0052e0 con 0x7fdc5406aed0 2024-01-20T11:07:36.934 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:36.936 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:07:36.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.935+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdc5406aed0 msgr2=0x7fdc5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.935+0000 7fdc82600640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdc5406aed0 0x7fdc5406d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c033000 tx=0x7fdc6c02f000 comp rx=0 tx=0).stop 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.935+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b2210 msgr2=0x7fdc7c0b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.935+0000 7fdc82600640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b2210 0x7fdc7c0b2690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c072aa0 tx=0x7fdc7400f4a0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.935+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 shutdown_connections 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.935+0000 7fdc82600640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b2210 0x7fdc7c0b2690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.935+0000 7fdc82600640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdc5406aed0 0x7fdc5406d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.936+0000 7fdc82600640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c070f40 0x7fdc7c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.936+0000 7fdc82600640 1 --2- 172.21.15.162:0/3833310366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc5c0039a0 0x7fdc7c0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.936+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 >> 172.21.15.162:0/3833310366 conn(0x7fdc7c0b0cd0 msgr2=0x7fdc7c0ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.936+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 shutdown_connections 2024-01-20T11:07:36.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:36.936+0000 7fdc82600640 1 -- 172.21.15.162:0/3833310366 wait complete. 2024-01-20T11:07:36.954 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-20T11:07:35.580394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":2948,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3018752,"data_stored":1796480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.136908"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498954+0000","last_change":"2024-01-20T11:07:32.511393+0000","last_active":"2024-01-20T11:07:33.498954+0000","last_peered":"2024-01-20T11:07:33.498954+0000","last_clean":"2024-01-20T11:07:33.498954+0000","last_became_active":"2024-01-20T11:07:32.511094+0000","last_became_peered":"2024-01-20T11:07:32.511094+0000","last_unstale":"2024-01-20T11:07:33.498954+0000","last_undegraded":"2024-01-20T11:07:33.498954+0000","last_fullsized":"2024-01-20T11:07:33.498954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160365+0000","last_change":"2024-01-20T11:07:32.495713+0000","last_active":"2024-01-20T11:07:34.160365+0000","last_peered":"2024-01-20T11:07:34.160365+0000","last_clean":"2024-01-20T11:07:34.160365+0000","last_became_active":"2024-01-20T11:07:32.495487+0000","last_became_peered":"2024-01-20T11:07:32.495487+0000","last_unstale":"2024-01-20T11:07:34.160365+0000","last_undegraded":"2024-01-20T11:07:34.160365+0000","last_fullsized":"2024-01-20T11:07:34.160365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:21.564586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.487852+0000","last_change":"2024-01-20T11:07:32.481755+0000","last_active":"2024-01-20T11:07:32.487852+0000","last_peered":"2024-01-20T11:07:32.487852+0000","last_clean":"2024-01-20T11:07:32.487852+0000","last_became_active":"2024-01-20T11:07:32.481213+0000","last_became_peered":"2024-01-20T11:07:32.481213+0000","last_unstale":"2024-01-20T11:07:32.487852+0000","last_undegraded":"2024-01-20T11:07:32.487852+0000","last_fullsized":"2024-01-20T11:07:32.487852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:18:39.354286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501649+0000","last_change":"2024-01-20T11:07:32.502344+0000","last_active":"2024-01-20T11:07:33.501649+0000","last_peered":"2024-01-20T11:07:33.501649+0000","last_clean":"2024-01-20T11:07:33.501649+0000","last_became_active":"2024-01-20T11:07:32.502037+0000","last_became_peered":"2024-01-20T11:07:32.502037+0000","last_unstale":"2024-01-20T11:07:33.501649+0000","last_undegraded":"2024-01-20T11:07:33.501649+0000","last_fullsized":"2024-01-20T11:07:33.501649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498895+0000","last_change":"2024-01-20T11:07:32.511019+0000","last_active":"2024-01-20T11:07:33.498895+0000","last_peered":"2024-01-20T11:07:33.498895+0000","last_clean":"2024-01-20T11:07:33.498895+0000","last_became_active":"2024-01-20T11:07:32.509419+0000","last_became_peered":"2024-01-20T11:07:32.509419+0000","last_unstale":"2024-01-20T11:07:33.498895+0000","last_undegraded":"2024-01-20T11:07:33.498895+0000","last_fullsized":"2024-01-20T11:07:33.498895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500988+0000","last_change":"2024-01-20T11:07:32.500145+0000","last_active":"2024-01-20T11:07:33.500988+0000","last_peered":"2024-01-20T11:07:33.500988+0000","last_clean":"2024-01-20T11:07:33.500988+0000","last_became_active":"2024-01-20T11:07:32.499948+0000","last_became_peered":"2024-01-20T11:07:32.499948+0000","last_unstale":"2024-01-20T11:07:33.500988+0000","last_undegraded":"2024-01-20T11:07:33.500988+0000","last_fullsized":"2024-01-20T11:07:33.500988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498132+0000","last_change":"2024-01-20T11:07:32.509101+0000","last_active":"2024-01-20T11:07:33.498132+0000","last_peered":"2024-01-20T11:07:33.498132+0000","last_clean":"2024-01-20T11:07:33.498132+0000","last_became_active":"2024-01-20T11:07:32.508125+0000","last_became_peered":"2024-01-20T11:07:32.508125+0000","last_unstale":"2024-01-20T11:07:33.498132+0000","last_undegraded":"2024-01-20T11:07:33.498132+0000","last_fullsized":"2024-01-20T11:07:33.498132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307168+0000","last_change":"2024-01-20T11:07:32.508785+0000","last_active":"2024-01-20T11:07:34.307168+0000","last_peered":"2024-01-20T11:07:34.307168+0000","last_clean":"2024-01-20T11:07:34.307168+0000","last_became_active":"2024-01-20T11:07:32.508563+0000","last_became_peered":"2024-01-20T11:07:32.508563+0000","last_unstale":"2024-01-20T11:07:34.307168+0000","last_undegraded":"2024-01-20T11:07:34.307168+0000","last_fullsized":"2024-01-20T11:07:34.307168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499139+0000","last_change":"2024-01-20T11:07:32.521686+0000","last_active":"2024-01-20T11:07:33.499139+0000","last_peered":"2024-01-20T11:07:33.499139+0000","last_clean":"2024-01-20T11:07:33.499139+0000","last_became_active":"2024-01-20T11:07:32.521333+0000","last_became_peered":"2024-01-20T11:07:32.521333+0000","last_unstale":"2024-01-20T11:07:33.499139+0000","last_undegraded":"2024-01-20T11:07:33.499139+0000","last_fullsized":"2024-01-20T11:07:33.499139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390247+0000","last_change":"2024-01-20T11:07:32.511433+0000","last_active":"2024-01-20T11:07:34.390247+0000","last_peered":"2024-01-20T11:07:34.390247+0000","last_clean":"2024-01-20T11:07:34.390247+0000","last_became_active":"2024-01-20T11:07:32.507192+0000","last_became_peered":"2024-01-20T11:07:32.507192+0000","last_unstale":"2024-01-20T11:07:34.390247+0000","last_undegraded":"2024-01-20T11:07:34.390247+0000","last_fullsized":"2024-01-20T11:07:34.390247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389662+0000","last_change":"2024-01-20T11:07:32.510460+0000","last_active":"2024-01-20T11:07:34.389662+0000","last_peered":"2024-01-20T11:07:34.389662+0000","last_clean":"2024-01-20T11:07:34.389662+0000","last_became_active":"2024-01-20T11:07:32.510165+0000","last_became_peered":"2024-01-20T11:07:32.510165+0000","last_unstale":"2024-01-20T11:07:34.389662+0000","last_undegraded":"2024-01-20T11:07:34.389662+0000","last_fullsized":"2024-01-20T11:07:34.389662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.512861+0000","last_change":"2024-01-20T11:07:32.507297+0000","last_active":"2024-01-20T11:07:32.512861+0000","last_peered":"2024-01-20T11:07:32.512861+0000","last_clean":"2024-01-20T11:07:32.512861+0000","last_became_active":"2024-01-20T11:07:32.505550+0000","last_became_peered":"2024-01-20T11:07:32.505550+0000","last_unstale":"2024-01-20T11:07:32.512861+0000","last_undegraded":"2024-01-20T11:07:32.512861+0000","last_fullsized":"2024-01-20T11:07:32.512861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:36.882282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307927+0000","last_change":"2024-01-20T11:07:32.499378+0000","last_active":"2024-01-20T11:07:34.307927+0000","last_peered":"2024-01-20T11:07:34.307927+0000","last_clean":"2024-01-20T11:07:34.307927+0000","last_became_active":"2024-01-20T11:07:32.498514+0000","last_became_peered":"2024-01-20T11:07:32.498514+0000","last_unstale":"2024-01-20T11:07:34.307927+0000","last_undegraded":"2024-01-20T11:07:34.307927+0000","last_fullsized":"2024-01-20T11:07:34.307927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.498538+0000","last_change":"2024-01-20T11:07:32.494967+0000","last_active":"2024-01-20T11:07:32.498538+0000","last_peered":"2024-01-20T11:07:32.498538+0000","last_clean":"2024-01-20T11:07:32.498538+0000","last_became_active":"2024-01-20T11:07:32.494120+0000","last_became_peered":"2024-01-20T11:07:32.494120+0000","last_unstale":"2024-01-20T11:07:32.498538+0000","last_undegraded":"2024-01-20T11:07:32.498538+0000","last_fullsized":"2024-01-20T11:07:32.498538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:31.922293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.491525+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491262+0000","last_became_peered":"2024-01-20T11:07:32.491262+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:52.065195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500692+0000","last_change":"2024-01-20T11:07:32.500042+0000","last_active":"2024-01-20T11:07:33.500692+0000","last_peered":"2024-01-20T11:07:33.500692+0000","last_clean":"2024-01-20T11:07:33.500692+0000","last_became_active":"2024-01-20T11:07:32.499808+0000","last_became_peered":"2024-01-20T11:07:32.499808+0000","last_unstale":"2024-01-20T11:07:33.500692+0000","last_undegraded":"2024-01-20T11:07:33.500692+0000","last_fullsized":"2024-01-20T11:07:33.500692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502287+0000","last_change":"2024-01-20T11:07:32.517082+0000","last_active":"2024-01-20T11:07:33.502287+0000","last_peered":"2024-01-20T11:07:33.502287+0000","last_clean":"2024-01-20T11:07:33.502287+0000","last_became_active":"2024-01-20T11:07:32.516792+0000","last_became_peered":"2024-01-20T11:07:32.516792+0000","last_unstale":"2024-01-20T11:07:33.502287+0000","last_undegraded":"2024-01-20T11:07:33.502287+0000","last_fullsized":"2024-01-20T11:07:33.502287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498121+0000","last_change":"2024-01-20T11:07:32.496924+0000","last_active":"2024-01-20T11:07:33.498121+0000","last_peered":"2024-01-20T11:07:33.498121+0000","last_clean":"2024-01-20T11:07:33.498121+0000","last_became_active":"2024-01-20T11:07:32.496711+0000","last_became_peered":"2024-01-20T11:07:32.496711+0000","last_unstale":"2024-01-20T11:07:33.498121+0000","last_undegraded":"2024-01-20T11:07:33.498121+0000","last_fullsized":"2024-01-20T11:07:33.498121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:50.078866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499802+0000","last_change":"2024-01-20T11:07:32.509963+0000","last_active":"2024-01-20T11:07:33.499802+0000","last_peered":"2024-01-20T11:07:33.499802+0000","last_clean":"2024-01-20T11:07:33.499802+0000","last_became_active":"2024-01-20T11:07:32.509355+0000","last_became_peered":"2024-01-20T11:07:32.509355+0000","last_unstale":"2024-01-20T11:07:33.499802+0000","last_undegraded":"2024-01-20T11:07:33.499802+0000","last_fullsized":"2024-01-20T11:07:33.499802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:51:48.711512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389493+0000","last_change":"2024-01-20T11:07:32.499797+0000","last_active":"2024-01-20T11:07:34.389493+0000","last_peered":"2024-01-20T11:07:34.389493+0000","last_clean":"2024-01-20T11:07:34.389493+0000","last_became_active":"2024-01-20T11:07:32.499479+0000","last_became_peered":"2024-01-20T11:07:32.499479+0000","last_unstale":"2024-01-20T11:07:34.389493+0000","last_undegraded":"2024-01-20T11:07:34.389493+0000","last_fullsized":"2024-01-20T11:07:34.389493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.515460+0000","last_change":"2024-01-20T11:07:32.510484+0000","last_active":"2024-01-20T11:07:32.515460+0000","last_peered":"2024-01-20T11:07:32.515460+0000","last_clean":"2024-01-20T11:07:32.515460+0000","last_became_active":"2024-01-20T11:07:32.510232+0000","last_became_peered":"2024-01-20T11:07:32.510232+0000","last_unstale":"2024-01-20T11:07:32.515460+0000","last_undegraded":"2024-01-20T11:07:32.515460+0000","last_fullsized":"2024-01-20T11:07:32.515460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:37:18.467607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501069+0000","last_change":"2024-01-20T11:07:32.514040+0000","last_active":"2024-01-20T11:07:33.501069+0000","last_peered":"2024-01-20T11:07:33.501069+0000","last_clean":"2024-01-20T11:07:33.501069+0000","last_became_active":"2024-01-20T11:07:32.513752+0000","last_became_peered":"2024-01-20T11:07:32.513752+0000","last_unstale":"2024-01-20T11:07:33.501069+0000","last_undegraded":"2024-01-20T11:07:33.501069+0000","last_fullsized":"2024-01-20T11:07:33.501069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307277+0000","last_change":"2024-01-20T11:07:32.506093+0000","last_active":"2024-01-20T11:07:34.307277+0000","last_peered":"2024-01-20T11:07:34.307277+0000","last_clean":"2024-01-20T11:07:34.307277+0000","last_became_active":"2024-01-20T11:07:32.505824+0000","last_became_peered":"2024-01-20T11:07:32.505824+0000","last_unstale":"2024-01-20T11:07:34.307277+0000","last_undegraded":"2024-01-20T11:07:34.307277+0000","last_fullsized":"2024-01-20T11:07:34.307277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500841+0000","last_change":"2024-01-20T11:07:32.499561+0000","last_active":"2024-01-20T11:07:33.500841+0000","last_peered":"2024-01-20T11:07:33.500841+0000","last_clean":"2024-01-20T11:07:33.500841+0000","last_became_active":"2024-01-20T11:07:32.499132+0000","last_became_peered":"2024-01-20T11:07:32.499132+0000","last_unstale":"2024-01-20T11:07:33.500841+0000","last_undegraded":"2024-01-20T11:07:33.500841+0000","last_fullsized":"2024-01-20T11:07:33.500841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308164+0000","last_change":"2024-01-20T11:07:32.504381+0000","last_active":"2024-01-20T11:07:34.308164+0000","last_peered":"2024-01-20T11:07:34.308164+0000","last_clean":"2024-01-20T11:07:34.308164+0000","last_became_active":"2024-01-20T11:07:32.504077+0000","last_became_peered":"2024-01-20T11:07:32.504077+0000","last_unstale":"2024-01-20T11:07:34.308164+0000","last_undegraded":"2024-01-20T11:07:34.308164+0000","last_fullsized":"2024-01-20T11:07:34.308164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390177+0000","last_change":"2024-01-20T11:07:32.516522+0000","last_active":"2024-01-20T11:07:34.390177+0000","last_peered":"2024-01-20T11:07:34.390177+0000","last_clean":"2024-01-20T11:07:34.390177+0000","last_became_active":"2024-01-20T11:07:32.516166+0000","last_became_peered":"2024-01-20T11:07:32.516166+0000","last_unstale":"2024-01-20T11:07:34.390177+0000","last_undegraded":"2024-01-20T11:07:34.390177+0000","last_fullsized":"2024-01-20T11:07:34.390177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160091+0000","last_change":"2024-01-20T11:07:32.493441+0000","last_active":"2024-01-20T11:07:34.160091+0000","last_peered":"2024-01-20T11:07:34.160091+0000","last_clean":"2024-01-20T11:07:34.160091+0000","last_became_active":"2024-01-20T11:07:32.493167+0000","last_became_peered":"2024-01-20T11:07:32.493167+0000","last_unstale":"2024-01-20T11:07:34.160091+0000","last_undegraded":"2024-01-20T11:07:34.160091+0000","last_fullsized":"2024-01-20T11:07:34.160091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:37:16.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308502+0000","last_change":"2024-01-20T11:07:32.506319+0000","last_active":"2024-01-20T11:07:34.308502+0000","last_peered":"2024-01-20T11:07:34.308502+0000","last_clean":"2024-01-20T11:07:34.308502+0000","last_became_active":"2024-01-20T11:07:32.505816+0000","last_became_peered":"2024-01-20T11:07:32.505816+0000","last_unstale":"2024-01-20T11:07:34.308502+0000","last_undegraded":"2024-01-20T11:07:34.308502+0000","last_fullsized":"2024-01-20T11:07:34.308502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.495233+0000","last_change":"2024-01-20T11:07:32.493479+0000","last_active":"2024-01-20T11:07:32.495233+0000","last_peered":"2024-01-20T11:07:32.495233+0000","last_clean":"2024-01-20T11:07:32.495233+0000","last_became_active":"2024-01-20T11:07:32.493225+0000","last_became_peered":"2024-01-20T11:07:32.493225+0000","last_unstale":"2024-01-20T11:07:32.495233+0000","last_undegraded":"2024-01-20T11:07:32.495233+0000","last_fullsized":"2024-01-20T11:07:32.495233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:46.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501201+0000","last_change":"2024-01-20T11:07:32.499811+0000","last_active":"2024-01-20T11:07:33.501201+0000","last_peered":"2024-01-20T11:07:33.501201+0000","last_clean":"2024-01-20T11:07:33.501201+0000","last_became_active":"2024-01-20T11:07:32.499484+0000","last_became_peered":"2024-01-20T11:07:32.499484+0000","last_unstale":"2024-01-20T11:07:33.501201+0000","last_undegraded":"2024-01-20T11:07:33.501201+0000","last_fullsized":"2024-01-20T11:07:33.501201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497885+0000","last_change":"2024-01-20T11:07:32.502715+0000","last_active":"2024-01-20T11:07:33.497885+0000","last_peered":"2024-01-20T11:07:33.497885+0000","last_clean":"2024-01-20T11:07:33.497885+0000","last_became_active":"2024-01-20T11:07:32.502450+0000","last_became_peered":"2024-01-20T11:07:32.502450+0000","last_unstale":"2024-01-20T11:07:33.497885+0000","last_undegraded":"2024-01-20T11:07:33.497885+0000","last_fullsized":"2024-01-20T11:07:33.497885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.007672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389175+0000","last_change":"2024-01-20T11:07:32.489772+0000","last_active":"2024-01-20T11:07:34.389175+0000","last_peered":"2024-01-20T11:07:34.389175+0000","last_clean":"2024-01-20T11:07:34.389175+0000","last_became_active":"2024-01-20T11:07:32.489524+0000","last_became_peered":"2024-01-20T11:07:32.489524+0000","last_unstale":"2024-01-20T11:07:34.389175+0000","last_undegraded":"2024-01-20T11:07:34.389175+0000","last_fullsized":"2024-01-20T11:07:34.389175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.503728+0000","last_change":"2024-01-20T11:07:32.494072+0000","last_active":"2024-01-20T11:07:32.503728+0000","last_peered":"2024-01-20T11:07:32.503728+0000","last_clean":"2024-01-20T11:07:32.503728+0000","last_became_active":"2024-01-20T11:07:32.493626+0000","last_became_peered":"2024-01-20T11:07:32.493626+0000","last_unstale":"2024-01-20T11:07:32.503728+0000","last_undegraded":"2024-01-20T11:07:32.503728+0000","last_fullsized":"2024-01-20T11:07:32.503728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:33.827221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308311+0000","last_change":"2024-01-20T11:07:31.495270+0000","last_active":"2024-01-20T11:07:34.308311+0000","last_peered":"2024-01-20T11:07:34.308311+0000","last_clean":"2024-01-20T11:07:34.308311+0000","last_became_active":"2024-01-20T11:07:31.494820+0000","last_became_peered":"2024-01-20T11:07:31.494820+0000","last_unstale":"2024-01-20T11:07:34.308311+0000","last_undegraded":"2024-01-20T11:07:34.308311+0000","last_fullsized":"2024-01-20T11:07:34.308311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.508166+0000","last_change":"2024-01-20T11:07:32.502657+0000","last_active":"2024-01-20T11:07:32.508166+0000","last_peered":"2024-01-20T11:07:32.508166+0000","last_clean":"2024-01-20T11:07:32.508166+0000","last_became_active":"2024-01-20T11:07:32.502221+0000","last_became_peered":"2024-01-20T11:07:32.502221+0000","last_unstale":"2024-01-20T11:07:32.508166+0000","last_undegraded":"2024-01-20T11:07:32.508166+0000","last_fullsized":"2024-01-20T11:07:32.508166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:58.427021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389440+0000","last_change":"2024-01-20T11:07:31.493668+0000","last_active":"2024-01-20T11:07:34.389440+0000","last_peered":"2024-01-20T11:07:34.389440+0000","last_clean":"2024-01-20T11:07:34.389440+0000","last_became_active":"2024-01-20T11:07:31.493350+0000","last_became_peered":"2024-01-20T11:07:31.493350+0000","last_unstale":"2024-01-20T11:07:34.389440+0000","last_undegraded":"2024-01-20T11:07:34.389440+0000","last_fullsized":"2024-01-20T11:07:34.389440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307546+0000","last_change":"2024-01-20T11:07:31.500395+0000","last_active":"2024-01-20T11:07:34.307546+0000","last_peered":"2024-01-20T11:07:34.307546+0000","last_clean":"2024-01-20T11:07:34.307546+0000","last_became_active":"2024-01-20T11:07:31.500032+0000","last_became_peered":"2024-01-20T11:07:31.500032+0000","last_unstale":"2024-01-20T11:07:34.307546+0000","last_undegraded":"2024-01-20T11:07:34.307546+0000","last_fullsized":"2024-01-20T11:07:34.307546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:18:38.315489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307397+0000","last_change":"2024-01-20T11:07:32.494245+0000","last_active":"2024-01-20T11:07:34.307397+0000","last_peered":"2024-01-20T11:07:34.307397+0000","last_clean":"2024-01-20T11:07:34.307397+0000","last_became_active":"2024-01-20T11:07:32.493862+0000","last_became_peered":"2024-01-20T11:07:32.493862+0000","last_unstale":"2024-01-20T11:07:34.307397+0000","last_undegraded":"2024-01-20T11:07:34.307397+0000","last_fullsized":"2024-01-20T11:07:34.307397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502269+0000","last_change":"2024-01-20T11:07:31.483052+0000","last_active":"2024-01-20T11:07:33.502269+0000","last_peered":"2024-01-20T11:07:33.502269+0000","last_clean":"2024-01-20T11:07:33.502269+0000","last_became_active":"2024-01-20T11:07:31.482767+0000","last_became_peered":"2024-01-20T11:07:31.482767+0000","last_unstale":"2024-01-20T11:07:33.502269+0000","last_undegraded":"2024-01-20T11:07:33.502269+0000","last_fullsized":"2024-01-20T11:07:33.502269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.492275+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491992+0000","last_became_peered":"2024-01-20T11:07:32.491992+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:21:36.093817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390038+0000","last_change":"2024-01-20T11:07:31.495203+0000","last_active":"2024-01-20T11:07:34.390038+0000","last_peered":"2024-01-20T11:07:34.390038+0000","last_clean":"2024-01-20T11:07:34.390038+0000","last_became_active":"2024-01-20T11:07:31.494906+0000","last_became_peered":"2024-01-20T11:07:31.494906+0000","last_unstale":"2024-01-20T11:07:34.390038+0000","last_undegraded":"2024-01-20T11:07:34.390038+0000","last_fullsized":"2024-01-20T11:07:34.390038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502013+0000","last_change":"2024-01-20T11:07:32.517083+0000","last_active":"2024-01-20T11:07:33.502013+0000","last_peered":"2024-01-20T11:07:33.502013+0000","last_clean":"2024-01-20T11:07:33.502013+0000","last_became_active":"2024-01-20T11:07:32.516815+0000","last_became_peered":"2024-01-20T11:07:32.516815+0000","last_unstale":"2024-01-20T11:07:33.502013+0000","last_undegraded":"2024-01-20T11:07:33.502013+0000","last_fullsized":"2024-01-20T11:07:33.502013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502340+0000","last_change":"2024-01-20T11:07:31.497490+0000","last_active":"2024-01-20T11:07:33.502340+0000","last_peered":"2024-01-20T11:07:33.502340+0000","last_clean":"2024-01-20T11:07:33.502340+0000","last_became_active":"2024-01-20T11:07:31.497068+0000","last_became_peered":"2024-01-20T11:07:31.497068+0000","last_unstale":"2024-01-20T11:07:33.502340+0000","last_undegraded":"2024-01-20T11:07:33.502340+0000","last_fullsized":"2024-01-20T11:07:33.502340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.515177+0000","last_change":"2024-01-20T11:07:32.508883+0000","last_active":"2024-01-20T11:07:32.515177+0000","last_peered":"2024-01-20T11:07:32.515177+0000","last_clean":"2024-01-20T11:07:32.515177+0000","last_became_active":"2024-01-20T11:07:32.508389+0000","last_became_peered":"2024-01-20T11:07:32.508389+0000","last_unstale":"2024-01-20T11:07:32.515177+0000","last_undegraded":"2024-01-20T11:07:32.515177+0000","last_fullsized":"2024-01-20T11:07:32.515177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:16:13.928547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160453+0000","last_change":"2024-01-20T11:07:31.487647+0000","last_active":"2024-01-20T11:07:34.160453+0000","last_peered":"2024-01-20T11:07:34.160453+0000","last_clean":"2024-01-20T11:07:34.160453+0000","last_became_active":"2024-01-20T11:07:31.487411+0000","last_became_peered":"2024-01-20T11:07:31.487411+0000","last_unstale":"2024-01-20T11:07:34.160453+0000","last_undegraded":"2024-01-20T11:07:34.160453+0000","last_fullsized":"2024-01-20T11:07:34.160453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:41.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.519187+0000","last_change":"2024-01-20T11:07:32.511836+0000","last_active":"2024-01-20T11:07:32.519187+0000","last_peered":"2024-01-20T11:07:32.519187+0000","last_clean":"2024-01-20T11:07:32.519187+0000","last_became_active":"2024-01-20T11:07:32.510548+0000","last_became_peered":"2024-01-20T11:07:32.510548+0000","last_unstale":"2024-01-20T11:07:32.519187+0000","last_undegraded":"2024-01-20T11:07:32.519187+0000","last_fullsized":"2024-01-20T11:07:32.519187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:08.039450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389476+0000","last_change":"2024-01-20T11:07:31.492414+0000","last_active":"2024-01-20T11:07:34.389476+0000","last_peered":"2024-01-20T11:07:34.389476+0000","last_clean":"2024-01-20T11:07:34.389476+0000","last_became_active":"2024-01-20T11:07:31.491799+0000","last_became_peered":"2024-01-20T11:07:31.491799+0000","last_unstale":"2024-01-20T11:07:34.389476+0000","last_undegraded":"2024-01-20T11:07:34.389476+0000","last_fullsized":"2024-01-20T11:07:34.389476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498912+0000","last_change":"2024-01-20T11:07:32.510180+0000","last_active":"2024-01-20T11:07:33.498912+0000","last_peered":"2024-01-20T11:07:33.498912+0000","last_clean":"2024-01-20T11:07:33.498912+0000","last_became_active":"2024-01-20T11:07:32.509697+0000","last_became_peered":"2024-01-20T11:07:32.509697+0000","last_unstale":"2024-01-20T11:07:33.498912+0000","last_undegraded":"2024-01-20T11:07:33.498912+0000","last_fullsized":"2024-01-20T11:07:33.498912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.519979+0000","last_change":"2024-01-20T11:07:31.482038+0000","last_active":"2024-01-20T11:07:32.519979+0000","last_peered":"2024-01-20T11:07:32.519979+0000","last_clean":"2024-01-20T11:07:32.519979+0000","last_became_active":"2024-01-20T11:07:31.480827+0000","last_became_peered":"2024-01-20T11:07:31.480827+0000","last_unstale":"2024-01-20T11:07:32.519979+0000","last_undegraded":"2024-01-20T11:07:32.519979+0000","last_fullsized":"2024-01-20T11:07:32.519979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:55:30.237540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.510164+0000","last_change":"2024-01-20T11:07:32.506977+0000","last_active":"2024-01-20T11:07:32.510164+0000","last_peered":"2024-01-20T11:07:32.510164+0000","last_clean":"2024-01-20T11:07:32.510164+0000","last_became_active":"2024-01-20T11:07:32.506670+0000","last_became_peered":"2024-01-20T11:07:32.506670+0000","last_unstale":"2024-01-20T11:07:32.510164+0000","last_undegraded":"2024-01-20T11:07:32.510164+0000","last_fullsized":"2024-01-20T11:07:32.510164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:35.261145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501345+0000","last_change":"2024-01-20T11:07:31.490601+0000","last_active":"2024-01-20T11:07:33.501345+0000","last_peered":"2024-01-20T11:07:33.501345+0000","last_clean":"2024-01-20T11:07:33.501345+0000","last_became_active":"2024-01-20T11:07:31.490325+0000","last_became_peered":"2024-01-20T11:07:31.490325+0000","last_unstale":"2024-01-20T11:07:33.501345+0000","last_undegraded":"2024-01-20T11:07:33.501345+0000","last_fullsized":"2024-01-20T11:07:33.501345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499267+0000","last_change":"2024-01-20T11:07:32.511343+0000","last_active":"2024-01-20T11:07:33.499267+0000","last_peered":"2024-01-20T11:07:33.499267+0000","last_clean":"2024-01-20T11:07:33.499267+0000","last_became_active":"2024-01-20T11:07:32.510728+0000","last_became_peered":"2024-01-20T11:07:32.510728+0000","last_unstale":"2024-01-20T11:07:33.499267+0000","last_undegraded":"2024-01-20T11:07:33.499267+0000","last_fullsized":"2024-01-20T11:07:33.499267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389024+0000","last_change":"2024-01-20T11:07:31.498147+0000","last_active":"2024-01-20T11:07:34.389024+0000","last_peered":"2024-01-20T11:07:34.389024+0000","last_clean":"2024-01-20T11:07:34.389024+0000","last_became_active":"2024-01-20T11:07:31.497862+0000","last_became_peered":"2024-01-20T11:07:31.497862+0000","last_unstale":"2024-01-20T11:07:34.389024+0000","last_undegraded":"2024-01-20T11:07:34.389024+0000","last_fullsized":"2024-01-20T11:07:34.389024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389272+0000","last_change":"2024-01-20T11:07:32.488914+0000","last_active":"2024-01-20T11:07:34.389272+0000","last_peered":"2024-01-20T11:07:34.389272+0000","last_clean":"2024-01-20T11:07:34.389272+0000","last_became_active":"2024-01-20T11:07:32.488534+0000","last_became_peered":"2024-01-20T11:07:32.488534+0000","last_unstale":"2024-01-20T11:07:34.389272+0000","last_undegraded":"2024-01-20T11:07:34.389272+0000","last_fullsized":"2024-01-20T11:07:34.389272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497591+0000","last_change":"2024-01-20T11:07:31.478318+0000","last_active":"2024-01-20T11:07:33.497591+0000","last_peered":"2024-01-20T11:07:33.497591+0000","last_clean":"2024-01-20T11:07:33.497591+0000","last_became_active":"2024-01-20T11:07:31.477994+0000","last_became_peered":"2024-01-20T11:07:31.477994+0000","last_unstale":"2024-01-20T11:07:33.497591+0000","last_undegraded":"2024-01-20T11:07:33.497591+0000","last_fullsized":"2024-01-20T11:07:33.497591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:28:19.098438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498521+0000","last_change":"2024-01-20T11:07:32.513578+0000","last_active":"2024-01-20T11:07:33.498521+0000","last_peered":"2024-01-20T11:07:33.498521+0000","last_clean":"2024-01-20T11:07:33.498521+0000","last_became_active":"2024-01-20T11:07:32.512877+0000","last_became_peered":"2024-01-20T11:07:32.512877+0000","last_unstale":"2024-01-20T11:07:33.498521+0000","last_undegraded":"2024-01-20T11:07:33.498521+0000","last_fullsized":"2024-01-20T11:07:33.498521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.520065+0000","last_change":"2024-01-20T11:07:31.484253+0000","last_active":"2024-01-20T11:07:32.520065+0000","last_peered":"2024-01-20T11:07:32.520065+0000","last_clean":"2024-01-20T11:07:32.520065+0000","last_became_active":"2024-01-20T11:07:31.483906+0000","last_became_peered":"2024-01-20T11:07:31.483906+0000","last_unstale":"2024-01-20T11:07:32.520065+0000","last_undegraded":"2024-01-20T11:07:32.520065+0000","last_fullsized":"2024-01-20T11:07:32.520065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:36:56.507275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500008+0000","last_change":"2024-01-20T11:07:32.514965+0000","last_active":"2024-01-20T11:07:33.500008+0000","last_peered":"2024-01-20T11:07:33.500008+0000","last_clean":"2024-01-20T11:07:33.500008+0000","last_became_active":"2024-01-20T11:07:32.514653+0000","last_became_peered":"2024-01-20T11:07:32.514653+0000","last_unstale":"2024-01-20T11:07:33.500008+0000","last_undegraded":"2024-01-20T11:07:33.500008+0000","last_fullsized":"2024-01-20T11:07:33.500008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:57:36.226100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498288+0000","last_change":"2024-01-20T11:07:31.483149+0000","last_active":"2024-01-20T11:07:33.498288+0000","last_peered":"2024-01-20T11:07:33.498288+0000","last_clean":"2024-01-20T11:07:33.498288+0000","last_became_active":"2024-01-20T11:07:31.482857+0000","last_became_peered":"2024-01-20T11:07:31.482857+0000","last_unstale":"2024-01-20T11:07:33.498288+0000","last_undegraded":"2024-01-20T11:07:33.498288+0000","last_fullsized":"2024-01-20T11:07:33.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499404+0000","last_change":"2024-01-20T11:07:32.511923+0000","last_active":"2024-01-20T11:07:33.499404+0000","last_peered":"2024-01-20T11:07:33.499404+0000","last_clean":"2024-01-20T11:07:33.499404+0000","last_became_active":"2024-01-20T11:07:32.511673+0000","last_became_peered":"2024-01-20T11:07:32.511673+0000","last_unstale":"2024-01-20T11:07:33.499404+0000","last_undegraded":"2024-01-20T11:07:33.499404+0000","last_fullsized":"2024-01-20T11:07:33.499404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:17.125662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160314+0000","last_change":"2024-01-20T11:07:31.483039+0000","last_active":"2024-01-20T11:07:34.160314+0000","last_peered":"2024-01-20T11:07:34.160314+0000","last_clean":"2024-01-20T11:07:34.160314+0000","last_became_active":"2024-01-20T11:07:31.482677+0000","last_became_peered":"2024-01-20T11:07:31.482677+0000","last_unstale":"2024-01-20T11:07:34.160314+0000","last_undegraded":"2024-01-20T11:07:34.160314+0000","last_fullsized":"2024-01-20T11:07:34.160314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:56.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502126+0000","last_change":"2024-01-20T11:07:32.507370+0000","last_active":"2024-01-20T11:07:33.502126+0000","last_peered":"2024-01-20T11:07:33.502126+0000","last_clean":"2024-01-20T11:07:33.502126+0000","last_became_active":"2024-01-20T11:07:32.505163+0000","last_became_peered":"2024-01-20T11:07:32.505163+0000","last_unstale":"2024-01-20T11:07:33.502126+0000","last_undegraded":"2024-01-20T11:07:33.502126+0000","last_fullsized":"2024-01-20T11:07:33.502126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497973+0000","last_change":"2024-01-20T11:07:31.487538+0000","last_active":"2024-01-20T11:07:33.497973+0000","last_peered":"2024-01-20T11:07:33.497973+0000","last_clean":"2024-01-20T11:07:33.497973+0000","last_became_active":"2024-01-20T11:07:31.487176+0000","last_became_peered":"2024-01-20T11:07:31.487176+0000","last_unstale":"2024-01-20T11:07:33.497973+0000","last_undegraded":"2024-01-20T11:07:33.497973+0000","last_fullsized":"2024-01-20T11:07:33.497973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:35.843485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499114+0000","last_change":"2024-01-20T11:07:32.523249+0000","last_active":"2024-01-20T11:07:33.499114+0000","last_peered":"2024-01-20T11:07:33.499114+0000","last_clean":"2024-01-20T11:07:33.499114+0000","last_became_active":"2024-01-20T11:07:32.523025+0000","last_became_peered":"2024-01-20T11:07:32.523025+0000","last_unstale":"2024-01-20T11:07:33.499114+0000","last_undegraded":"2024-01-20T11:07:33.499114+0000","last_fullsized":"2024-01-20T11:07:33.499114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.493831+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:07:32.493831+0000","last_peered":"2024-01-20T11:07:32.493831+0000","last_clean":"2024-01-20T11:07:32.493831+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:07:32.493831+0000","last_undegraded":"2024-01-20T11:07:32.493831+0000","last_fullsized":"2024-01-20T11:07:32.493831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500923+0000","last_change":"2024-01-20T11:07:31.485438+0000","last_active":"2024-01-20T11:07:33.500923+0000","last_peered":"2024-01-20T11:07:33.500923+0000","last_clean":"2024-01-20T11:07:33.500923+0000","last_became_active":"2024-01-20T11:07:31.485131+0000","last_became_peered":"2024-01-20T11:07:31.485131+0000","last_unstale":"2024-01-20T11:07:33.500923+0000","last_undegraded":"2024-01-20T11:07:33.500923+0000","last_fullsized":"2024-01-20T11:07:33.500923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307797+0000","last_change":"2024-01-20T11:07:32.503033+0000","last_active":"2024-01-20T11:07:34.307797+0000","last_peered":"2024-01-20T11:07:34.307797+0000","last_clean":"2024-01-20T11:07:34.307797+0000","last_became_active":"2024-01-20T11:07:32.502390+0000","last_became_peered":"2024-01-20T11:07:32.502390+0000","last_unstale":"2024-01-20T11:07:34.307797+0000","last_undegraded":"2024-01-20T11:07:34.307797+0000","last_fullsized":"2024-01-20T11:07:34.307797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497374+0000","last_change":"2024-01-20T11:07:31.493977+0000","last_active":"2024-01-20T11:07:33.497374+0000","last_peered":"2024-01-20T11:07:33.497374+0000","last_clean":"2024-01-20T11:07:33.497374+0000","last_became_active":"2024-01-20T11:07:31.493633+0000","last_became_peered":"2024-01-20T11:07:31.493633+0000","last_unstale":"2024-01-20T11:07:33.497374+0000","last_undegraded":"2024-01-20T11:07:33.497374+0000","last_fullsized":"2024-01-20T11:07:33.497374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.510502+0000","last_change":"2024-01-20T11:07:32.506901+0000","last_active":"2024-01-20T11:07:32.510502+0000","last_peered":"2024-01-20T11:07:32.510502+0000","last_clean":"2024-01-20T11:07:32.510502+0000","last_became_active":"2024-01-20T11:07:32.506048+0000","last_became_peered":"2024-01-20T11:07:32.506048+0000","last_unstale":"2024-01-20T11:07:32.510502+0000","last_undegraded":"2024-01-20T11:07:32.510502+0000","last_fullsized":"2024-01-20T11:07:32.510502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:24.159242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497694+0000","last_change":"2024-01-20T11:07:31.489897+0000","last_active":"2024-01-20T11:07:33.497694+0000","last_peered":"2024-01-20T11:07:33.497694+0000","last_clean":"2024-01-20T11:07:33.497694+0000","last_became_active":"2024-01-20T11:07:31.489264+0000","last_became_peered":"2024-01-20T11:07:31.489264+0000","last_unstale":"2024-01-20T11:07:33.497694+0000","last_undegraded":"2024-01-20T11:07:33.497694+0000","last_fullsized":"2024-01-20T11:07:33.497694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159751+0000","last_change":"2024-01-20T11:07:32.489551+0000","last_active":"2024-01-20T11:07:34.159751+0000","last_peered":"2024-01-20T11:07:34.159751+0000","last_clean":"2024-01-20T11:07:34.159751+0000","last_became_active":"2024-01-20T11:07:32.489277+0000","last_became_peered":"2024-01-20T11:07:32.489277+0000","last_unstale":"2024-01-20T11:07:34.159751+0000","last_undegraded":"2024-01-20T11:07:34.159751+0000","last_fullsized":"2024-01-20T11:07:34.159751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:48.457758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501412+0000","last_change":"2024-01-20T11:07:31.483881+0000","last_active":"2024-01-20T11:07:33.501412+0000","last_peered":"2024-01-20T11:07:33.501412+0000","last_clean":"2024-01-20T11:07:33.501412+0000","last_became_active":"2024-01-20T11:07:31.483528+0000","last_became_peered":"2024-01-20T11:07:31.483528+0000","last_unstale":"2024-01-20T11:07:33.501412+0000","last_undegraded":"2024-01-20T11:07:33.501412+0000","last_fullsized":"2024-01-20T11:07:33.501412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.504240+0000","last_change":"2024-01-20T11:07:32.496285+0000","last_active":"2024-01-20T11:07:32.504240+0000","last_peered":"2024-01-20T11:07:32.504240+0000","last_clean":"2024-01-20T11:07:32.504240+0000","last_became_active":"2024-01-20T11:07:32.495112+0000","last_became_peered":"2024-01-20T11:07:32.495112+0000","last_unstale":"2024-01-20T11:07:32.504240+0000","last_undegraded":"2024-01-20T11:07:32.504240+0000","last_fullsized":"2024-01-20T11:07:32.504240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:28:20.137235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159900+0000","last_change":"2024-01-20T11:07:31.481611+0000","last_active":"2024-01-20T11:07:34.159900+0000","last_peered":"2024-01-20T11:07:34.159900+0000","last_clean":"2024-01-20T11:07:34.159900+0000","last_became_active":"2024-01-20T11:07:31.481322+0000","last_became_peered":"2024-01-20T11:07:31.481322+0000","last_unstale":"2024-01-20T11:07:34.159900+0000","last_undegraded":"2024-01-20T11:07:34.159900+0000","last_fullsized":"2024-01-20T11:07:34.159900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:49.040069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501882+0000","last_change":"2024-01-20T11:07:32.506000+0000","last_active":"2024-01-20T11:07:33.501882+0000","last_peered":"2024-01-20T11:07:33.501882+0000","last_clean":"2024-01-20T11:07:33.501882+0000","last_became_active":"2024-01-20T11:07:32.505039+0000","last_became_peered":"2024-01-20T11:07:32.505039+0000","last_unstale":"2024-01-20T11:07:33.501882+0000","last_undegraded":"2024-01-20T11:07:33.501882+0000","last_fullsized":"2024-01-20T11:07:33.501882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499473+0000","last_change":"2024-01-20T11:07:31.496162+0000","last_active":"2024-01-20T11:07:33.499473+0000","last_peered":"2024-01-20T11:07:33.499473+0000","last_clean":"2024-01-20T11:07:33.499473+0000","last_became_active":"2024-01-20T11:07:31.495742+0000","last_became_peered":"2024-01-20T11:07:31.495742+0000","last_unstale":"2024-01-20T11:07:33.499473+0000","last_undegraded":"2024-01-20T11:07:33.499473+0000","last_fullsized":"2024-01-20T11:07:33.499473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:37:17.428810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160078+0000","last_change":"2024-01-20T11:07:32.489292+0000","last_active":"2024-01-20T11:07:34.160078+0000","last_peered":"2024-01-20T11:07:34.160078+0000","last_clean":"2024-01-20T11:07:34.160078+0000","last_became_active":"2024-01-20T11:07:32.488833+0000","last_became_peered":"2024-01-20T11:07:32.488833+0000","last_unstale":"2024-01-20T11:07:34.160078+0000","last_undegraded":"2024-01-20T11:07:34.160078+0000","last_fullsized":"2024-01-20T11:07:34.160078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:03:48.348342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160582+0000","last_change":"2024-01-20T11:07:31.499423+0000","last_active":"2024-01-20T11:07:34.160582+0000","last_peered":"2024-01-20T11:07:34.160582+0000","last_clean":"2024-01-20T11:07:34.160582+0000","last_became_active":"2024-01-20T11:07:31.499207+0000","last_became_peered":"2024-01-20T11:07:31.499207+0000","last_unstale":"2024-01-20T11:07:34.160582+0000","last_undegraded":"2024-01-20T11:07:34.160582+0000","last_fullsized":"2024-01-20T11:07:34.160582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:38:53.823701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307987+0000","last_change":"2024-01-20T11:07:32.518826+0000","last_active":"2024-01-20T11:07:34.307987+0000","last_peered":"2024-01-20T11:07:34.307987+0000","last_clean":"2024-01-20T11:07:34.307987+0000","last_became_active":"2024-01-20T11:07:32.518540+0000","last_became_peered":"2024-01-20T11:07:32.518540+0000","last_unstale":"2024-01-20T11:07:34.307987+0000","last_undegraded":"2024-01-20T11:07:34.307987+0000","last_fullsized":"2024-01-20T11:07:34.307987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390151+0000","last_change":"2024-01-20T11:07:31.498846+0000","last_active":"2024-01-20T11:07:34.390151+0000","last_peered":"2024-01-20T11:07:34.390151+0000","last_clean":"2024-01-20T11:07:34.390151+0000","last_became_active":"2024-01-20T11:07:31.498477+0000","last_became_peered":"2024-01-20T11:07:31.498477+0000","last_unstale":"2024-01-20T11:07:34.390151+0000","last_undegraded":"2024-01-20T11:07:34.390151+0000","last_fullsized":"2024-01-20T11:07:34.390151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.500961+0000","last_change":"2024-01-20T11:07:32.495729+0000","last_active":"2024-01-20T11:07:32.500961+0000","last_peered":"2024-01-20T11:07:32.500961+0000","last_clean":"2024-01-20T11:07:32.500961+0000","last_became_active":"2024-01-20T11:07:32.493695+0000","last_became_peered":"2024-01-20T11:07:32.493695+0000","last_unstale":"2024-01-20T11:07:32.500961+0000","last_undegraded":"2024-01-20T11:07:32.500961+0000","last_fullsized":"2024-01-20T11:07:32.500961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:07.765390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497112+0000","last_change":"2024-01-20T11:07:31.495706+0000","last_active":"2024-01-20T11:07:33.497112+0000","last_peered":"2024-01-20T11:07:33.497112+0000","last_clean":"2024-01-20T11:07:33.497112+0000","last_became_active":"2024-01-20T11:07:31.495412+0000","last_became_peered":"2024-01-20T11:07:31.495412+0000","last_unstale":"2024-01-20T11:07:33.497112+0000","last_undegraded":"2024-01-20T11:07:33.497112+0000","last_fullsized":"2024-01-20T11:07:33.497112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.503781+0000","last_change":"2024-01-20T11:07:32.492080+0000","last_active":"2024-01-20T11:07:32.503781+0000","last_peered":"2024-01-20T11:07:32.503781+0000","last_clean":"2024-01-20T11:07:32.503781+0000","last_became_active":"2024-01-20T11:07:32.491063+0000","last_became_peered":"2024-01-20T11:07:32.491063+0000","last_unstale":"2024-01-20T11:07:32.503781+0000","last_undegraded":"2024-01-20T11:07:32.503781+0000","last_fullsized":"2024-01-20T11:07:32.503781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:09:15.949062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159828+0000","last_change":"2024-01-20T11:07:31.485898+0000","last_active":"2024-01-20T11:07:34.159828+0000","last_peered":"2024-01-20T11:07:34.159828+0000","last_clean":"2024-01-20T11:07:34.159828+0000","last_became_active":"2024-01-20T11:07:31.485601+0000","last_became_peered":"2024-01-20T11:07:31.485601+0000","last_unstale":"2024-01-20T11:07:34.159828+0000","last_undegraded":"2024-01-20T11:07:34.159828+0000","last_fullsized":"2024-01-20T11:07:34.159828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307529+0000","last_change":"2024-01-20T11:07:32.491885+0000","last_active":"2024-01-20T11:07:34.307529+0000","last_peered":"2024-01-20T11:07:34.307529+0000","last_clean":"2024-01-20T11:07:34.307529+0000","last_became_active":"2024-01-20T11:07:32.491603+0000","last_became_peered":"2024-01-20T11:07:32.491603+0000","last_unstale":"2024-01-20T11:07:34.307529+0000","last_undegraded":"2024-01-20T11:07:34.307529+0000","last_fullsized":"2024-01-20T11:07:34.307529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159878+0000","last_change":"2024-01-20T11:07:31.492532+0000","last_active":"2024-01-20T11:07:34.159878+0000","last_peered":"2024-01-20T11:07:34.159878+0000","last_clean":"2024-01-20T11:07:34.159878+0000","last_became_active":"2024-01-20T11:07:31.492086+0000","last_became_peered":"2024-01-20T11:07:31.492086+0000","last_unstale":"2024-01-20T11:07:34.159878+0000","last_undegraded":"2024-01-20T11:07:34.159878+0000","last_fullsized":"2024-01-20T11:07:34.159878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308413+0000","last_change":"2024-01-20T11:07:32.496745+0000","last_active":"2024-01-20T11:07:34.308413+0000","last_peered":"2024-01-20T11:07:34.308413+0000","last_clean":"2024-01-20T11:07:34.308413+0000","last_became_active":"2024-01-20T11:07:32.496476+0000","last_became_peered":"2024-01-20T11:07:32.496476+0000","last_unstale":"2024-01-20T11:07:34.308413+0000","last_undegraded":"2024-01-20T11:07:34.308413+0000","last_fullsized":"2024-01-20T11:07:34.308413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499806+0000","last_change":"2024-01-20T11:07:31.497898+0000","last_active":"2024-01-20T11:07:33.499806+0000","last_peered":"2024-01-20T11:07:33.499806+0000","last_clean":"2024-01-20T11:07:33.499806+0000","last_became_active":"2024-01-20T11:07:31.497633+0000","last_became_peered":"2024-01-20T11:07:31.497633+0000","last_unstale":"2024-01-20T11:07:33.499806+0000","last_undegraded":"2024-01-20T11:07:33.499806+0000","last_fullsized":"2024-01-20T11:07:33.499806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:16:12.889750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389455+0000","last_change":"2024-01-20T11:07:32.502048+0000","last_active":"2024-01-20T11:07:34.389455+0000","last_peered":"2024-01-20T11:07:34.389455+0000","last_clean":"2024-01-20T11:07:34.389455+0000","last_became_active":"2024-01-20T11:07:32.501771+0000","last_became_peered":"2024-01-20T11:07:32.501771+0000","last_unstale":"2024-01-20T11:07:34.389455+0000","last_undegraded":"2024-01-20T11:07:34.389455+0000","last_fullsized":"2024-01-20T11:07:34.389455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501677+0000","last_change":"2024-01-20T11:07:32.505630+0000","last_active":"2024-01-20T11:07:33.501677+0000","last_peered":"2024-01-20T11:07:33.501677+0000","last_clean":"2024-01-20T11:07:33.501677+0000","last_became_active":"2024-01-20T11:07:32.505349+0000","last_became_peered":"2024-01-20T11:07:32.505349+0000","last_unstale":"2024-01-20T11:07:33.501677+0000","last_undegraded":"2024-01-20T11:07:33.501677+0000","last_fullsized":"2024-01-20T11:07:33.501677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498700+0000","last_change":"2024-01-20T11:07:31.500045+0000","last_active":"2024-01-20T11:07:33.498700+0000","last_peered":"2024-01-20T11:07:33.498700+0000","last_clean":"2024-01-20T11:07:33.498700+0000","last_became_active":"2024-01-20T11:07:31.499737+0000","last_became_peered":"2024-01-20T11:07:31.499737+0000","last_unstale":"2024-01-20T11:07:33.498700+0000","last_undegraded":"2024-01-20T11:07:33.498700+0000","last_fullsized":"2024-01-20T11:07:33.498700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:34.222349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501807+0000","last_change":"2024-01-20T11:07:32.506908+0000","last_active":"2024-01-20T11:07:33.501807+0000","last_peered":"2024-01-20T11:07:33.501807+0000","last_clean":"2024-01-20T11:07:33.501807+0000","last_became_active":"2024-01-20T11:07:32.506541+0000","last_became_peered":"2024-01-20T11:07:32.506541+0000","last_unstale":"2024-01-20T11:07:33.501807+0000","last_undegraded":"2024-01-20T11:07:33.501807+0000","last_fullsized":"2024-01-20T11:07:33.501807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499153+0000","last_change":"2024-01-20T11:07:31.500669+0000","last_active":"2024-01-20T11:07:33.499153+0000","last_peered":"2024-01-20T11:07:33.499153+0000","last_clean":"2024-01-20T11:07:33.499153+0000","last_became_active":"2024-01-20T11:07:31.500354+0000","last_became_peered":"2024-01-20T11:07:31.500354+0000","last_unstale":"2024-01-20T11:07:33.499153+0000","last_undegraded":"2024-01-20T11:07:33.499153+0000","last_fullsized":"2024-01-20T11:07:33.499153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:21.904186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.515196+0000","last_change":"2024-01-20T11:07:32.509179+0000","last_active":"2024-01-20T11:07:32.515196+0000","last_peered":"2024-01-20T11:07:32.515196+0000","last_clean":"2024-01-20T11:07:32.515196+0000","last_became_active":"2024-01-20T11:07:32.508667+0000","last_became_peered":"2024-01-20T11:07:32.508667+0000","last_unstale":"2024-01-20T11:07:32.515196+0000","last_undegraded":"2024-01-20T11:07:32.515196+0000","last_fullsized":"2024-01-20T11:07:32.515196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:22.942983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308404+0000","last_change":"2024-01-20T11:07:31.487022+0000","last_active":"2024-01-20T11:07:34.308404+0000","last_peered":"2024-01-20T11:07:34.308404+0000","last_clean":"2024-01-20T11:07:34.308404+0000","last_became_active":"2024-01-20T11:07:31.485438+0000","last_became_peered":"2024-01-20T11:07:31.485438+0000","last_unstale":"2024-01-20T11:07:34.308404+0000","last_undegraded":"2024-01-20T11:07:34.308404+0000","last_fullsized":"2024-01-20T11:07:34.308404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308147+0000","last_change":"2024-01-20T11:07:32.498652+0000","last_active":"2024-01-20T11:07:34.308147+0000","last_peered":"2024-01-20T11:07:34.308147+0000","last_clean":"2024-01-20T11:07:34.308147+0000","last_became_active":"2024-01-20T11:07:32.498322+0000","last_became_peered":"2024-01-20T11:07:32.498322+0000","last_unstale":"2024-01-20T11:07:34.308147+0000","last_undegraded":"2024-01-20T11:07:34.308147+0000","last_fullsized":"2024-01-20T11:07:34.308147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.525761+0000","last_change":"2024-01-20T11:07:31.495529+0000","last_active":"2024-01-20T11:07:32.525761+0000","last_peered":"2024-01-20T11:07:32.525761+0000","last_clean":"2024-01-20T11:07:32.525761+0000","last_became_active":"2024-01-20T11:07:31.495233+0000","last_became_peered":"2024-01-20T11:07:31.495233+0000","last_unstale":"2024-01-20T11:07:32.525761+0000","last_undegraded":"2024-01-20T11:07:32.525761+0000","last_fullsized":"2024-01-20T11:07:32.525761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":823296,"data_stored":669678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":74040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4740000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":72554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.008}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":819200,"data_stored":663434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:07:36.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:07:37.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.197+0000 7f46abe00640 1 Processor -- start 2024-01-20T11:07:37.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.197+0000 7f46abe00640 1 -- start start 2024-01-20T11:07:37.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.198+0000 7f46abe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46ac0700a0 0x7f46ac0cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.198+0000 7f46abe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac0b3820 con 0x7f46ac0c4020 2024-01-20T11:07:37.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.198+0000 7f46abe00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac070530 con 0x7f46ac0b0520 2024-01-20T11:07:37.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.198+0000 7f46abe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac0cbdb0 con 0x7f46ac0700a0 2024-01-20T11:07:37.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.199+0000 7f46ab400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46ac0700a0 0x7f46ac0cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.199+0000 7f46aaa00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f46ac0c4020 0x7f46ac0c4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33620/0 (socket says 172.21.15.162:33620) 2024-01-20T11:07:37.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.199+0000 7f46aaa00640 1 -- 172.21.15.162:0/3333702072 learned_addr learned my addr 172.21.15.162:0/3333702072 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.199+0000 7f46ab400640 1 -- 172.21.15.162:0/3333702072 >> v1:172.21.15.179:6789/0 conn(0x7f46ac0b0520 legacy=0x7f46ac0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.199+0000 7f46ab400640 1 -- 172.21.15.162:0/3333702072 >> v1:172.21.15.162:6789/0 conn(0x7f46ac0c4020 legacy=0x7f46ac0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.199+0000 7f46a9600640 1 -- 172.21.15.162:0/3333702072 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860632239 0 0) 0x7f46ac0b3820 con 0x7f46ac0c4020 2024-01-20T11:07:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.199+0000 7f46ab400640 1 -- 172.21.15.162:0/3333702072 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac06e5b0 con 0x7f46ac0700a0 2024-01-20T11:07:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.200+0000 7f46ab400640 1 --2- 172.21.15.162:0/3333702072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0cff60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46a40097a0 tx=0x7f46a402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4af732762baf50 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46a9600640 1 -- 172.21.15.162:0/3333702072 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a402f050 con 0x7f46ac0700a0 2024-01-20T11:07:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46a9600640 1 -- 172.21.15.162:0/3333702072 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a4031700 con 0x7f46ac0700a0 2024-01-20T11:07:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46a9600640 1 -- 172.21.15.162:0/3333702072 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4031a90 con 0x7f46ac0700a0 2024-01-20T11:07:37.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46abe00640 1 -- 172.21.15.162:0/3333702072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 msgr2=0x7f46ac0cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46abe00640 1 --2- 172.21.15.162:0/3333702072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0cff60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46a40097a0 tx=0x7f46a402b7a0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46abe00640 1 -- 172.21.15.162:0/3333702072 shutdown_connections 2024-01-20T11:07:37.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46abe00640 1 --2- 172.21.15.162:0/3333702072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0cff60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46abe00640 1 -- 172.21.15.162:0/3333702072 >> 172.21.15.162:0/3333702072 conn(0x7f46ac0b2b40 msgr2=0x7f46ac0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:37.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46abe00640 1 -- 172.21.15.162:0/3333702072 shutdown_connections 2024-01-20T11:07:37.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.201+0000 7f46abe00640 1 -- 172.21.15.162:0/3333702072 wait complete. 2024-01-20T11:07:37.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.203+0000 7f46abe00640 1 Processor -- start 2024-01-20T11:07:37.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.203+0000 7f46abe00640 1 -- start start 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46abe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46abe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0b0520 0x7f46ac1f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46abe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0c4020 0x7f46ac0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46abe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0afc20 con 0x7f46ac0700a0 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46abe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1f5630 con 0x7f46ac0b0520 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46abe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1f8840 con 0x7f46ac0c4020 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46aaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46aaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41076/0 (socket says 172.21.15.162:41076) 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.204+0000 7f46aaa00640 1 -- 172.21.15.162:0/1513115290 learned_addr learned my addr 172.21.15.162:0/1513115290 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46aa000640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0b0520 0x7f46ac1f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46ab400640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0c4020 0x7f46ac0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46aaa00640 1 -- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0c4020 msgr2=0x7f46ac0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46aaa00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0c4020 0x7f46ac0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46aaa00640 1 -- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0b0520 msgr2=0x7f46ac1f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46aaa00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0b0520 0x7f46ac1f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46aaa00640 1 -- 172.21.15.162:0/1513115290 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009400 con 0x7f46ac0700a0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46aaa00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0ae920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f469c00c890 tx=0x7f469c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46a2a00640 1 -- 172.21.15.162:0/1513115290 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00a640 con 0x7f46ac0700a0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46a2a00640 1 -- 172.21.15.162:0/1513115290 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00a7c0 con 0x7f46ac0700a0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46a2a00640 1 -- 172.21.15.162:0/1513115290 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00ab70 con 0x7f46ac0700a0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.205+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac1f8b20 con 0x7f46ac0700a0 2024-01-20T11:07:37.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.206+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac0ae120 con 0x7f46ac0700a0 2024-01-20T11:07:37.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.207+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac074a30 con 0x7f46ac0700a0 2024-01-20T11:07:37.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.207+0000 7f46a2a00640 1 -- 172.21.15.162:0/1513115290 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f469c00acd0 con 0x7f46ac0700a0 2024-01-20T11:07:37.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.208+0000 7f46a2a00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f468406af00 0x7f468406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.208+0000 7f46a2a00640 1 -- 172.21.15.162:0/1513115290 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f469c088bf0 con 0x7f46ac0700a0 2024-01-20T11:07:37.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.209+0000 7f46aa000640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f468406af00 0x7f468406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.209+0000 7f46aa000640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f468406af00 0x7f468406d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0b00c0 tx=0x7f4694009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:37.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.212+0000 7f46a2a00640 1 -- 172.21.15.162:0/1513115290 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f469c053a20 con 0x7f46ac0700a0 2024-01-20T11:07:37.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.400+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46ac0cfa40 con 0x7f468406af00 2024-01-20T11:07:37.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.409+0000 7f46a2a00640 1 -- 172.21.15.162:0/1513115290 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264425 (secure 0 0 0) 0x7f46940053f0 con 0x7f468406af00 2024-01-20T11:07:37.413 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:07:37.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f468406af00 msgr2=0x7f468406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f468406af00 0x7f468406d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0b00c0 tx=0x7f4694009040 comp rx=0 tx=0).stop 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 msgr2=0x7f46ac0ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0ae920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f469c00c890 tx=0x7f469c00cd50 comp rx=0 tx=0).stop 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 shutdown_connections 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0c4020 0x7f46ac0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f468406af00 0x7f468406d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0b0520 0x7f46ac1f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 --2- 172.21.15.162:0/1513115290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0700a0 0x7f46ac0ae920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 >> 172.21.15.162:0/1513115290 conn(0x7f46ac0b2b40 msgr2=0x7f46ac15f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 shutdown_connections 2024-01-20T11:07:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.414+0000 7f46abe00640 1 -- 172.21.15.162:0/1513115290 wait complete. 2024-01-20T11:07:37.433 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-20T11:07:35.580394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":2948,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3018752,"data_stored":1796480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.136908"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498954+0000","last_change":"2024-01-20T11:07:32.511393+0000","last_active":"2024-01-20T11:07:33.498954+0000","last_peered":"2024-01-20T11:07:33.498954+0000","last_clean":"2024-01-20T11:07:33.498954+0000","last_became_active":"2024-01-20T11:07:32.511094+0000","last_became_peered":"2024-01-20T11:07:32.511094+0000","last_unstale":"2024-01-20T11:07:33.498954+0000","last_undegraded":"2024-01-20T11:07:33.498954+0000","last_fullsized":"2024-01-20T11:07:33.498954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160365+0000","last_change":"2024-01-20T11:07:32.495713+0000","last_active":"2024-01-20T11:07:34.160365+0000","last_peered":"2024-01-20T11:07:34.160365+0000","last_clean":"2024-01-20T11:07:34.160365+0000","last_became_active":"2024-01-20T11:07:32.495487+0000","last_became_peered":"2024-01-20T11:07:32.495487+0000","last_unstale":"2024-01-20T11:07:34.160365+0000","last_undegraded":"2024-01-20T11:07:34.160365+0000","last_fullsized":"2024-01-20T11:07:34.160365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:21.564586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.487852+0000","last_change":"2024-01-20T11:07:32.481755+0000","last_active":"2024-01-20T11:07:32.487852+0000","last_peered":"2024-01-20T11:07:32.487852+0000","last_clean":"2024-01-20T11:07:32.487852+0000","last_became_active":"2024-01-20T11:07:32.481213+0000","last_became_peered":"2024-01-20T11:07:32.481213+0000","last_unstale":"2024-01-20T11:07:32.487852+0000","last_undegraded":"2024-01-20T11:07:32.487852+0000","last_fullsized":"2024-01-20T11:07:32.487852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:18:39.354286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501649+0000","last_change":"2024-01-20T11:07:32.502344+0000","last_active":"2024-01-20T11:07:33.501649+0000","last_peered":"2024-01-20T11:07:33.501649+0000","last_clean":"2024-01-20T11:07:33.501649+0000","last_became_active":"2024-01-20T11:07:32.502037+0000","last_became_peered":"2024-01-20T11:07:32.502037+0000","last_unstale":"2024-01-20T11:07:33.501649+0000","last_undegraded":"2024-01-20T11:07:33.501649+0000","last_fullsized":"2024-01-20T11:07:33.501649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498895+0000","last_change":"2024-01-20T11:07:32.511019+0000","last_active":"2024-01-20T11:07:33.498895+0000","last_peered":"2024-01-20T11:07:33.498895+0000","last_clean":"2024-01-20T11:07:33.498895+0000","last_became_active":"2024-01-20T11:07:32.509419+0000","last_became_peered":"2024-01-20T11:07:32.509419+0000","last_unstale":"2024-01-20T11:07:33.498895+0000","last_undegraded":"2024-01-20T11:07:33.498895+0000","last_fullsized":"2024-01-20T11:07:33.498895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500988+0000","last_change":"2024-01-20T11:07:32.500145+0000","last_active":"2024-01-20T11:07:33.500988+0000","last_peered":"2024-01-20T11:07:33.500988+0000","last_clean":"2024-01-20T11:07:33.500988+0000","last_became_active":"2024-01-20T11:07:32.499948+0000","last_became_peered":"2024-01-20T11:07:32.499948+0000","last_unstale":"2024-01-20T11:07:33.500988+0000","last_undegraded":"2024-01-20T11:07:33.500988+0000","last_fullsized":"2024-01-20T11:07:33.500988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498132+0000","last_change":"2024-01-20T11:07:32.509101+0000","last_active":"2024-01-20T11:07:33.498132+0000","last_peered":"2024-01-20T11:07:33.498132+0000","last_clean":"2024-01-20T11:07:33.498132+0000","last_became_active":"2024-01-20T11:07:32.508125+0000","last_became_peered":"2024-01-20T11:07:32.508125+0000","last_unstale":"2024-01-20T11:07:33.498132+0000","last_undegraded":"2024-01-20T11:07:33.498132+0000","last_fullsized":"2024-01-20T11:07:33.498132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307168+0000","last_change":"2024-01-20T11:07:32.508785+0000","last_active":"2024-01-20T11:07:34.307168+0000","last_peered":"2024-01-20T11:07:34.307168+0000","last_clean":"2024-01-20T11:07:34.307168+0000","last_became_active":"2024-01-20T11:07:32.508563+0000","last_became_peered":"2024-01-20T11:07:32.508563+0000","last_unstale":"2024-01-20T11:07:34.307168+0000","last_undegraded":"2024-01-20T11:07:34.307168+0000","last_fullsized":"2024-01-20T11:07:34.307168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499139+0000","last_change":"2024-01-20T11:07:32.521686+0000","last_active":"2024-01-20T11:07:33.499139+0000","last_peered":"2024-01-20T11:07:33.499139+0000","last_clean":"2024-01-20T11:07:33.499139+0000","last_became_active":"2024-01-20T11:07:32.521333+0000","last_became_peered":"2024-01-20T11:07:32.521333+0000","last_unstale":"2024-01-20T11:07:33.499139+0000","last_undegraded":"2024-01-20T11:07:33.499139+0000","last_fullsized":"2024-01-20T11:07:33.499139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390247+0000","last_change":"2024-01-20T11:07:32.511433+0000","last_active":"2024-01-20T11:07:34.390247+0000","last_peered":"2024-01-20T11:07:34.390247+0000","last_clean":"2024-01-20T11:07:34.390247+0000","last_became_active":"2024-01-20T11:07:32.507192+0000","last_became_peered":"2024-01-20T11:07:32.507192+0000","last_unstale":"2024-01-20T11:07:34.390247+0000","last_undegraded":"2024-01-20T11:07:34.390247+0000","last_fullsized":"2024-01-20T11:07:34.390247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389662+0000","last_change":"2024-01-20T11:07:32.510460+0000","last_active":"2024-01-20T11:07:34.389662+0000","last_peered":"2024-01-20T11:07:34.389662+0000","last_clean":"2024-01-20T11:07:34.389662+0000","last_became_active":"2024-01-20T11:07:32.510165+0000","last_became_peered":"2024-01-20T11:07:32.510165+0000","last_unstale":"2024-01-20T11:07:34.389662+0000","last_undegraded":"2024-01-20T11:07:34.389662+0000","last_fullsized":"2024-01-20T11:07:34.389662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.512861+0000","last_change":"2024-01-20T11:07:32.507297+0000","last_active":"2024-01-20T11:07:32.512861+0000","last_peered":"2024-01-20T11:07:32.512861+0000","last_clean":"2024-01-20T11:07:32.512861+0000","last_became_active":"2024-01-20T11:07:32.505550+0000","last_became_peered":"2024-01-20T11:07:32.505550+0000","last_unstale":"2024-01-20T11:07:32.512861+0000","last_undegraded":"2024-01-20T11:07:32.512861+0000","last_fullsized":"2024-01-20T11:07:32.512861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:36.882282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307927+0000","last_change":"2024-01-20T11:07:32.499378+0000","last_active":"2024-01-20T11:07:34.307927+0000","last_peered":"2024-01-20T11:07:34.307927+0000","last_clean":"2024-01-20T11:07:34.307927+0000","last_became_active":"2024-01-20T11:07:32.498514+0000","last_became_peered":"2024-01-20T11:07:32.498514+0000","last_unstale":"2024-01-20T11:07:34.307927+0000","last_undegraded":"2024-01-20T11:07:34.307927+0000","last_fullsized":"2024-01-20T11:07:34.307927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.498538+0000","last_change":"2024-01-20T11:07:32.494967+0000","last_active":"2024-01-20T11:07:32.498538+0000","last_peered":"2024-01-20T11:07:32.498538+0000","last_clean":"2024-01-20T11:07:32.498538+0000","last_became_active":"2024-01-20T11:07:32.494120+0000","last_became_peered":"2024-01-20T11:07:32.494120+0000","last_unstale":"2024-01-20T11:07:32.498538+0000","last_undegraded":"2024-01-20T11:07:32.498538+0000","last_fullsized":"2024-01-20T11:07:32.498538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:31.922293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.491525+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491262+0000","last_became_peered":"2024-01-20T11:07:32.491262+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:52.065195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500692+0000","last_change":"2024-01-20T11:07:32.500042+0000","last_active":"2024-01-20T11:07:33.500692+0000","last_peered":"2024-01-20T11:07:33.500692+0000","last_clean":"2024-01-20T11:07:33.500692+0000","last_became_active":"2024-01-20T11:07:32.499808+0000","last_became_peered":"2024-01-20T11:07:32.499808+0000","last_unstale":"2024-01-20T11:07:33.500692+0000","last_undegraded":"2024-01-20T11:07:33.500692+0000","last_fullsized":"2024-01-20T11:07:33.500692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502287+0000","last_change":"2024-01-20T11:07:32.517082+0000","last_active":"2024-01-20T11:07:33.502287+0000","last_peered":"2024-01-20T11:07:33.502287+0000","last_clean":"2024-01-20T11:07:33.502287+0000","last_became_active":"2024-01-20T11:07:32.516792+0000","last_became_peered":"2024-01-20T11:07:32.516792+0000","last_unstale":"2024-01-20T11:07:33.502287+0000","last_undegraded":"2024-01-20T11:07:33.502287+0000","last_fullsized":"2024-01-20T11:07:33.502287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498121+0000","last_change":"2024-01-20T11:07:32.496924+0000","last_active":"2024-01-20T11:07:33.498121+0000","last_peered":"2024-01-20T11:07:33.498121+0000","last_clean":"2024-01-20T11:07:33.498121+0000","last_became_active":"2024-01-20T11:07:32.496711+0000","last_became_peered":"2024-01-20T11:07:32.496711+0000","last_unstale":"2024-01-20T11:07:33.498121+0000","last_undegraded":"2024-01-20T11:07:33.498121+0000","last_fullsized":"2024-01-20T11:07:33.498121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:50.078866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499802+0000","last_change":"2024-01-20T11:07:32.509963+0000","last_active":"2024-01-20T11:07:33.499802+0000","last_peered":"2024-01-20T11:07:33.499802+0000","last_clean":"2024-01-20T11:07:33.499802+0000","last_became_active":"2024-01-20T11:07:32.509355+0000","last_became_peered":"2024-01-20T11:07:32.509355+0000","last_unstale":"2024-01-20T11:07:33.499802+0000","last_undegraded":"2024-01-20T11:07:33.499802+0000","last_fullsized":"2024-01-20T11:07:33.499802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:51:48.711512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389493+0000","last_change":"2024-01-20T11:07:32.499797+0000","last_active":"2024-01-20T11:07:34.389493+0000","last_peered":"2024-01-20T11:07:34.389493+0000","last_clean":"2024-01-20T11:07:34.389493+0000","last_became_active":"2024-01-20T11:07:32.499479+0000","last_became_peered":"2024-01-20T11:07:32.499479+0000","last_unstale":"2024-01-20T11:07:34.389493+0000","last_undegraded":"2024-01-20T11:07:34.389493+0000","last_fullsized":"2024-01-20T11:07:34.389493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.515460+0000","last_change":"2024-01-20T11:07:32.510484+0000","last_active":"2024-01-20T11:07:32.515460+0000","last_peered":"2024-01-20T11:07:32.515460+0000","last_clean":"2024-01-20T11:07:32.515460+0000","last_became_active":"2024-01-20T11:07:32.510232+0000","last_became_peered":"2024-01-20T11:07:32.510232+0000","last_unstale":"2024-01-20T11:07:32.515460+0000","last_undegraded":"2024-01-20T11:07:32.515460+0000","last_fullsized":"2024-01-20T11:07:32.515460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:37:18.467607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501069+0000","last_change":"2024-01-20T11:07:32.514040+0000","last_active":"2024-01-20T11:07:33.501069+0000","last_peered":"2024-01-20T11:07:33.501069+0000","last_clean":"2024-01-20T11:07:33.501069+0000","last_became_active":"2024-01-20T11:07:32.513752+0000","last_became_peered":"2024-01-20T11:07:32.513752+0000","last_unstale":"2024-01-20T11:07:33.501069+0000","last_undegraded":"2024-01-20T11:07:33.501069+0000","last_fullsized":"2024-01-20T11:07:33.501069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307277+0000","last_change":"2024-01-20T11:07:32.506093+0000","last_active":"2024-01-20T11:07:34.307277+0000","last_peered":"2024-01-20T11:07:34.307277+0000","last_clean":"2024-01-20T11:07:34.307277+0000","last_became_active":"2024-01-20T11:07:32.505824+0000","last_became_peered":"2024-01-20T11:07:32.505824+0000","last_unstale":"2024-01-20T11:07:34.307277+0000","last_undegraded":"2024-01-20T11:07:34.307277+0000","last_fullsized":"2024-01-20T11:07:34.307277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500841+0000","last_change":"2024-01-20T11:07:32.499561+0000","last_active":"2024-01-20T11:07:33.500841+0000","last_peered":"2024-01-20T11:07:33.500841+0000","last_clean":"2024-01-20T11:07:33.500841+0000","last_became_active":"2024-01-20T11:07:32.499132+0000","last_became_peered":"2024-01-20T11:07:32.499132+0000","last_unstale":"2024-01-20T11:07:33.500841+0000","last_undegraded":"2024-01-20T11:07:33.500841+0000","last_fullsized":"2024-01-20T11:07:33.500841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308164+0000","last_change":"2024-01-20T11:07:32.504381+0000","last_active":"2024-01-20T11:07:34.308164+0000","last_peered":"2024-01-20T11:07:34.308164+0000","last_clean":"2024-01-20T11:07:34.308164+0000","last_became_active":"2024-01-20T11:07:32.504077+0000","last_became_peered":"2024-01-20T11:07:32.504077+0000","last_unstale":"2024-01-20T11:07:34.308164+0000","last_undegraded":"2024-01-20T11:07:34.308164+0000","last_fullsized":"2024-01-20T11:07:34.308164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390177+0000","last_change":"2024-01-20T11:07:32.516522+0000","last_active":"2024-01-20T11:07:34.390177+0000","last_peered":"2024-01-20T11:07:34.390177+0000","last_clean":"2024-01-20T11:07:34.390177+0000","last_became_active":"2024-01-20T11:07:32.516166+0000","last_became_peered":"2024-01-20T11:07:32.516166+0000","last_unstale":"2024-01-20T11:07:34.390177+0000","last_undegraded":"2024-01-20T11:07:34.390177+0000","last_fullsized":"2024-01-20T11:07:34.390177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160091+0000","last_change":"2024-01-20T11:07:32.493441+0000","last_active":"2024-01-20T11:07:34.160091+0000","last_peered":"2024-01-20T11:07:34.160091+0000","last_clean":"2024-01-20T11:07:34.160091+0000","last_became_active":"2024-01-20T11:07:32.493167+0000","last_became_peered":"2024-01-20T11:07:32.493167+0000","last_unstale":"2024-01-20T11:07:34.160091+0000","last_undegraded":"2024-01-20T11:07:34.160091+0000","last_fullsized":"2024-01-20T11:07:34.160091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:37:16.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308502+0000","last_change":"2024-01-20T11:07:32.506319+0000","last_active":"2024-01-20T11:07:34.308502+0000","last_peered":"2024-01-20T11:07:34.308502+0000","last_clean":"2024-01-20T11:07:34.308502+0000","last_became_active":"2024-01-20T11:07:32.505816+0000","last_became_peered":"2024-01-20T11:07:32.505816+0000","last_unstale":"2024-01-20T11:07:34.308502+0000","last_undegraded":"2024-01-20T11:07:34.308502+0000","last_fullsized":"2024-01-20T11:07:34.308502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.495233+0000","last_change":"2024-01-20T11:07:32.493479+0000","last_active":"2024-01-20T11:07:32.495233+0000","last_peered":"2024-01-20T11:07:32.495233+0000","last_clean":"2024-01-20T11:07:32.495233+0000","last_became_active":"2024-01-20T11:07:32.493225+0000","last_became_peered":"2024-01-20T11:07:32.493225+0000","last_unstale":"2024-01-20T11:07:32.495233+0000","last_undegraded":"2024-01-20T11:07:32.495233+0000","last_fullsized":"2024-01-20T11:07:32.495233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:46.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501201+0000","last_change":"2024-01-20T11:07:32.499811+0000","last_active":"2024-01-20T11:07:33.501201+0000","last_peered":"2024-01-20T11:07:33.501201+0000","last_clean":"2024-01-20T11:07:33.501201+0000","last_became_active":"2024-01-20T11:07:32.499484+0000","last_became_peered":"2024-01-20T11:07:32.499484+0000","last_unstale":"2024-01-20T11:07:33.501201+0000","last_undegraded":"2024-01-20T11:07:33.501201+0000","last_fullsized":"2024-01-20T11:07:33.501201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497885+0000","last_change":"2024-01-20T11:07:32.502715+0000","last_active":"2024-01-20T11:07:33.497885+0000","last_peered":"2024-01-20T11:07:33.497885+0000","last_clean":"2024-01-20T11:07:33.497885+0000","last_became_active":"2024-01-20T11:07:32.502450+0000","last_became_peered":"2024-01-20T11:07:32.502450+0000","last_unstale":"2024-01-20T11:07:33.497885+0000","last_undegraded":"2024-01-20T11:07:33.497885+0000","last_fullsized":"2024-01-20T11:07:33.497885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.007672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389175+0000","last_change":"2024-01-20T11:07:32.489772+0000","last_active":"2024-01-20T11:07:34.389175+0000","last_peered":"2024-01-20T11:07:34.389175+0000","last_clean":"2024-01-20T11:07:34.389175+0000","last_became_active":"2024-01-20T11:07:32.489524+0000","last_became_peered":"2024-01-20T11:07:32.489524+0000","last_unstale":"2024-01-20T11:07:34.389175+0000","last_undegraded":"2024-01-20T11:07:34.389175+0000","last_fullsized":"2024-01-20T11:07:34.389175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.503728+0000","last_change":"2024-01-20T11:07:32.494072+0000","last_active":"2024-01-20T11:07:32.503728+0000","last_peered":"2024-01-20T11:07:32.503728+0000","last_clean":"2024-01-20T11:07:32.503728+0000","last_became_active":"2024-01-20T11:07:32.493626+0000","last_became_peered":"2024-01-20T11:07:32.493626+0000","last_unstale":"2024-01-20T11:07:32.503728+0000","last_undegraded":"2024-01-20T11:07:32.503728+0000","last_fullsized":"2024-01-20T11:07:32.503728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:33.827221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308311+0000","last_change":"2024-01-20T11:07:31.495270+0000","last_active":"2024-01-20T11:07:34.308311+0000","last_peered":"2024-01-20T11:07:34.308311+0000","last_clean":"2024-01-20T11:07:34.308311+0000","last_became_active":"2024-01-20T11:07:31.494820+0000","last_became_peered":"2024-01-20T11:07:31.494820+0000","last_unstale":"2024-01-20T11:07:34.308311+0000","last_undegraded":"2024-01-20T11:07:34.308311+0000","last_fullsized":"2024-01-20T11:07:34.308311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.508166+0000","last_change":"2024-01-20T11:07:32.502657+0000","last_active":"2024-01-20T11:07:32.508166+0000","last_peered":"2024-01-20T11:07:32.508166+0000","last_clean":"2024-01-20T11:07:32.508166+0000","last_became_active":"2024-01-20T11:07:32.502221+0000","last_became_peered":"2024-01-20T11:07:32.502221+0000","last_unstale":"2024-01-20T11:07:32.508166+0000","last_undegraded":"2024-01-20T11:07:32.508166+0000","last_fullsized":"2024-01-20T11:07:32.508166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:58.427021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389440+0000","last_change":"2024-01-20T11:07:31.493668+0000","last_active":"2024-01-20T11:07:34.389440+0000","last_peered":"2024-01-20T11:07:34.389440+0000","last_clean":"2024-01-20T11:07:34.389440+0000","last_became_active":"2024-01-20T11:07:31.493350+0000","last_became_peered":"2024-01-20T11:07:31.493350+0000","last_unstale":"2024-01-20T11:07:34.389440+0000","last_undegraded":"2024-01-20T11:07:34.389440+0000","last_fullsized":"2024-01-20T11:07:34.389440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307546+0000","last_change":"2024-01-20T11:07:31.500395+0000","last_active":"2024-01-20T11:07:34.307546+0000","last_peered":"2024-01-20T11:07:34.307546+0000","last_clean":"2024-01-20T11:07:34.307546+0000","last_became_active":"2024-01-20T11:07:31.500032+0000","last_became_peered":"2024-01-20T11:07:31.500032+0000","last_unstale":"2024-01-20T11:07:34.307546+0000","last_undegraded":"2024-01-20T11:07:34.307546+0000","last_fullsized":"2024-01-20T11:07:34.307546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:18:38.315489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307397+0000","last_change":"2024-01-20T11:07:32.494245+0000","last_active":"2024-01-20T11:07:34.307397+0000","last_peered":"2024-01-20T11:07:34.307397+0000","last_clean":"2024-01-20T11:07:34.307397+0000","last_became_active":"2024-01-20T11:07:32.493862+0000","last_became_peered":"2024-01-20T11:07:32.493862+0000","last_unstale":"2024-01-20T11:07:34.307397+0000","last_undegraded":"2024-01-20T11:07:34.307397+0000","last_fullsized":"2024-01-20T11:07:34.307397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502269+0000","last_change":"2024-01-20T11:07:31.483052+0000","last_active":"2024-01-20T11:07:33.502269+0000","last_peered":"2024-01-20T11:07:33.502269+0000","last_clean":"2024-01-20T11:07:33.502269+0000","last_became_active":"2024-01-20T11:07:31.482767+0000","last_became_peered":"2024-01-20T11:07:31.482767+0000","last_unstale":"2024-01-20T11:07:33.502269+0000","last_undegraded":"2024-01-20T11:07:33.502269+0000","last_fullsized":"2024-01-20T11:07:33.502269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.492275+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491992+0000","last_became_peered":"2024-01-20T11:07:32.491992+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:21:36.093817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390038+0000","last_change":"2024-01-20T11:07:31.495203+0000","last_active":"2024-01-20T11:07:34.390038+0000","last_peered":"2024-01-20T11:07:34.390038+0000","last_clean":"2024-01-20T11:07:34.390038+0000","last_became_active":"2024-01-20T11:07:31.494906+0000","last_became_peered":"2024-01-20T11:07:31.494906+0000","last_unstale":"2024-01-20T11:07:34.390038+0000","last_undegraded":"2024-01-20T11:07:34.390038+0000","last_fullsized":"2024-01-20T11:07:34.390038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502013+0000","last_change":"2024-01-20T11:07:32.517083+0000","last_active":"2024-01-20T11:07:33.502013+0000","last_peered":"2024-01-20T11:07:33.502013+0000","last_clean":"2024-01-20T11:07:33.502013+0000","last_became_active":"2024-01-20T11:07:32.516815+0000","last_became_peered":"2024-01-20T11:07:32.516815+0000","last_unstale":"2024-01-20T11:07:33.502013+0000","last_undegraded":"2024-01-20T11:07:33.502013+0000","last_fullsized":"2024-01-20T11:07:33.502013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502340+0000","last_change":"2024-01-20T11:07:31.497490+0000","last_active":"2024-01-20T11:07:33.502340+0000","last_peered":"2024-01-20T11:07:33.502340+0000","last_clean":"2024-01-20T11:07:33.502340+0000","last_became_active":"2024-01-20T11:07:31.497068+0000","last_became_peered":"2024-01-20T11:07:31.497068+0000","last_unstale":"2024-01-20T11:07:33.502340+0000","last_undegraded":"2024-01-20T11:07:33.502340+0000","last_fullsized":"2024-01-20T11:07:33.502340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.515177+0000","last_change":"2024-01-20T11:07:32.508883+0000","last_active":"2024-01-20T11:07:32.515177+0000","last_peered":"2024-01-20T11:07:32.515177+0000","last_clean":"2024-01-20T11:07:32.515177+0000","last_became_active":"2024-01-20T11:07:32.508389+0000","last_became_peered":"2024-01-20T11:07:32.508389+0000","last_unstale":"2024-01-20T11:07:32.515177+0000","last_undegraded":"2024-01-20T11:07:32.515177+0000","last_fullsized":"2024-01-20T11:07:32.515177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:16:13.928547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160453+0000","last_change":"2024-01-20T11:07:31.487647+0000","last_active":"2024-01-20T11:07:34.160453+0000","last_peered":"2024-01-20T11:07:34.160453+0000","last_clean":"2024-01-20T11:07:34.160453+0000","last_became_active":"2024-01-20T11:07:31.487411+0000","last_became_peered":"2024-01-20T11:07:31.487411+0000","last_unstale":"2024-01-20T11:07:34.160453+0000","last_undegraded":"2024-01-20T11:07:34.160453+0000","last_fullsized":"2024-01-20T11:07:34.160453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:41.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.519187+0000","last_change":"2024-01-20T11:07:32.511836+0000","last_active":"2024-01-20T11:07:32.519187+0000","last_peered":"2024-01-20T11:07:32.519187+0000","last_clean":"2024-01-20T11:07:32.519187+0000","last_became_active":"2024-01-20T11:07:32.510548+0000","last_became_peered":"2024-01-20T11:07:32.510548+0000","last_unstale":"2024-01-20T11:07:32.519187+0000","last_undegraded":"2024-01-20T11:07:32.519187+0000","last_fullsized":"2024-01-20T11:07:32.519187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:08.039450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389476+0000","last_change":"2024-01-20T11:07:31.492414+0000","last_active":"2024-01-20T11:07:34.389476+0000","last_peered":"2024-01-20T11:07:34.389476+0000","last_clean":"2024-01-20T11:07:34.389476+0000","last_became_active":"2024-01-20T11:07:31.491799+0000","last_became_peered":"2024-01-20T11:07:31.491799+0000","last_unstale":"2024-01-20T11:07:34.389476+0000","last_undegraded":"2024-01-20T11:07:34.389476+0000","last_fullsized":"2024-01-20T11:07:34.389476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498912+0000","last_change":"2024-01-20T11:07:32.510180+0000","last_active":"2024-01-20T11:07:33.498912+0000","last_peered":"2024-01-20T11:07:33.498912+0000","last_clean":"2024-01-20T11:07:33.498912+0000","last_became_active":"2024-01-20T11:07:32.509697+0000","last_became_peered":"2024-01-20T11:07:32.509697+0000","last_unstale":"2024-01-20T11:07:33.498912+0000","last_undegraded":"2024-01-20T11:07:33.498912+0000","last_fullsized":"2024-01-20T11:07:33.498912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.519979+0000","last_change":"2024-01-20T11:07:31.482038+0000","last_active":"2024-01-20T11:07:32.519979+0000","last_peered":"2024-01-20T11:07:32.519979+0000","last_clean":"2024-01-20T11:07:32.519979+0000","last_became_active":"2024-01-20T11:07:31.480827+0000","last_became_peered":"2024-01-20T11:07:31.480827+0000","last_unstale":"2024-01-20T11:07:32.519979+0000","last_undegraded":"2024-01-20T11:07:32.519979+0000","last_fullsized":"2024-01-20T11:07:32.519979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:55:30.237540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.510164+0000","last_change":"2024-01-20T11:07:32.506977+0000","last_active":"2024-01-20T11:07:32.510164+0000","last_peered":"2024-01-20T11:07:32.510164+0000","last_clean":"2024-01-20T11:07:32.510164+0000","last_became_active":"2024-01-20T11:07:32.506670+0000","last_became_peered":"2024-01-20T11:07:32.506670+0000","last_unstale":"2024-01-20T11:07:32.510164+0000","last_undegraded":"2024-01-20T11:07:32.510164+0000","last_fullsized":"2024-01-20T11:07:32.510164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:35.261145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501345+0000","last_change":"2024-01-20T11:07:31.490601+0000","last_active":"2024-01-20T11:07:33.501345+0000","last_peered":"2024-01-20T11:07:33.501345+0000","last_clean":"2024-01-20T11:07:33.501345+0000","last_became_active":"2024-01-20T11:07:31.490325+0000","last_became_peered":"2024-01-20T11:07:31.490325+0000","last_unstale":"2024-01-20T11:07:33.501345+0000","last_undegraded":"2024-01-20T11:07:33.501345+0000","last_fullsized":"2024-01-20T11:07:33.501345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499267+0000","last_change":"2024-01-20T11:07:32.511343+0000","last_active":"2024-01-20T11:07:33.499267+0000","last_peered":"2024-01-20T11:07:33.499267+0000","last_clean":"2024-01-20T11:07:33.499267+0000","last_became_active":"2024-01-20T11:07:32.510728+0000","last_became_peered":"2024-01-20T11:07:32.510728+0000","last_unstale":"2024-01-20T11:07:33.499267+0000","last_undegraded":"2024-01-20T11:07:33.499267+0000","last_fullsized":"2024-01-20T11:07:33.499267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389024+0000","last_change":"2024-01-20T11:07:31.498147+0000","last_active":"2024-01-20T11:07:34.389024+0000","last_peered":"2024-01-20T11:07:34.389024+0000","last_clean":"2024-01-20T11:07:34.389024+0000","last_became_active":"2024-01-20T11:07:31.497862+0000","last_became_peered":"2024-01-20T11:07:31.497862+0000","last_unstale":"2024-01-20T11:07:34.389024+0000","last_undegraded":"2024-01-20T11:07:34.389024+0000","last_fullsized":"2024-01-20T11:07:34.389024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389272+0000","last_change":"2024-01-20T11:07:32.488914+0000","last_active":"2024-01-20T11:07:34.389272+0000","last_peered":"2024-01-20T11:07:34.389272+0000","last_clean":"2024-01-20T11:07:34.389272+0000","last_became_active":"2024-01-20T11:07:32.488534+0000","last_became_peered":"2024-01-20T11:07:32.488534+0000","last_unstale":"2024-01-20T11:07:34.389272+0000","last_undegraded":"2024-01-20T11:07:34.389272+0000","last_fullsized":"2024-01-20T11:07:34.389272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497591+0000","last_change":"2024-01-20T11:07:31.478318+0000","last_active":"2024-01-20T11:07:33.497591+0000","last_peered":"2024-01-20T11:07:33.497591+0000","last_clean":"2024-01-20T11:07:33.497591+0000","last_became_active":"2024-01-20T11:07:31.477994+0000","last_became_peered":"2024-01-20T11:07:31.477994+0000","last_unstale":"2024-01-20T11:07:33.497591+0000","last_undegraded":"2024-01-20T11:07:33.497591+0000","last_fullsized":"2024-01-20T11:07:33.497591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:28:19.098438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498521+0000","last_change":"2024-01-20T11:07:32.513578+0000","last_active":"2024-01-20T11:07:33.498521+0000","last_peered":"2024-01-20T11:07:33.498521+0000","last_clean":"2024-01-20T11:07:33.498521+0000","last_became_active":"2024-01-20T11:07:32.512877+0000","last_became_peered":"2024-01-20T11:07:32.512877+0000","last_unstale":"2024-01-20T11:07:33.498521+0000","last_undegraded":"2024-01-20T11:07:33.498521+0000","last_fullsized":"2024-01-20T11:07:33.498521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.520065+0000","last_change":"2024-01-20T11:07:31.484253+0000","last_active":"2024-01-20T11:07:32.520065+0000","last_peered":"2024-01-20T11:07:32.520065+0000","last_clean":"2024-01-20T11:07:32.520065+0000","last_became_active":"2024-01-20T11:07:31.483906+0000","last_became_peered":"2024-01-20T11:07:31.483906+0000","last_unstale":"2024-01-20T11:07:32.520065+0000","last_undegraded":"2024-01-20T11:07:32.520065+0000","last_fullsized":"2024-01-20T11:07:32.520065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:36:56.507275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500008+0000","last_change":"2024-01-20T11:07:32.514965+0000","last_active":"2024-01-20T11:07:33.500008+0000","last_peered":"2024-01-20T11:07:33.500008+0000","last_clean":"2024-01-20T11:07:33.500008+0000","last_became_active":"2024-01-20T11:07:32.514653+0000","last_became_peered":"2024-01-20T11:07:32.514653+0000","last_unstale":"2024-01-20T11:07:33.500008+0000","last_undegraded":"2024-01-20T11:07:33.500008+0000","last_fullsized":"2024-01-20T11:07:33.500008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:57:36.226100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498288+0000","last_change":"2024-01-20T11:07:31.483149+0000","last_active":"2024-01-20T11:07:33.498288+0000","last_peered":"2024-01-20T11:07:33.498288+0000","last_clean":"2024-01-20T11:07:33.498288+0000","last_became_active":"2024-01-20T11:07:31.482857+0000","last_became_peered":"2024-01-20T11:07:31.482857+0000","last_unstale":"2024-01-20T11:07:33.498288+0000","last_undegraded":"2024-01-20T11:07:33.498288+0000","last_fullsized":"2024-01-20T11:07:33.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499404+0000","last_change":"2024-01-20T11:07:32.511923+0000","last_active":"2024-01-20T11:07:33.499404+0000","last_peered":"2024-01-20T11:07:33.499404+0000","last_clean":"2024-01-20T11:07:33.499404+0000","last_became_active":"2024-01-20T11:07:32.511673+0000","last_became_peered":"2024-01-20T11:07:32.511673+0000","last_unstale":"2024-01-20T11:07:33.499404+0000","last_undegraded":"2024-01-20T11:07:33.499404+0000","last_fullsized":"2024-01-20T11:07:33.499404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:17.125662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160314+0000","last_change":"2024-01-20T11:07:31.483039+0000","last_active":"2024-01-20T11:07:34.160314+0000","last_peered":"2024-01-20T11:07:34.160314+0000","last_clean":"2024-01-20T11:07:34.160314+0000","last_became_active":"2024-01-20T11:07:31.482677+0000","last_became_peered":"2024-01-20T11:07:31.482677+0000","last_unstale":"2024-01-20T11:07:34.160314+0000","last_undegraded":"2024-01-20T11:07:34.160314+0000","last_fullsized":"2024-01-20T11:07:34.160314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:56.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502126+0000","last_change":"2024-01-20T11:07:32.507370+0000","last_active":"2024-01-20T11:07:33.502126+0000","last_peered":"2024-01-20T11:07:33.502126+0000","last_clean":"2024-01-20T11:07:33.502126+0000","last_became_active":"2024-01-20T11:07:32.505163+0000","last_became_peered":"2024-01-20T11:07:32.505163+0000","last_unstale":"2024-01-20T11:07:33.502126+0000","last_undegraded":"2024-01-20T11:07:33.502126+0000","last_fullsized":"2024-01-20T11:07:33.502126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497973+0000","last_change":"2024-01-20T11:07:31.487538+0000","last_active":"2024-01-20T11:07:33.497973+0000","last_peered":"2024-01-20T11:07:33.497973+0000","last_clean":"2024-01-20T11:07:33.497973+0000","last_became_active":"2024-01-20T11:07:31.487176+0000","last_became_peered":"2024-01-20T11:07:31.487176+0000","last_unstale":"2024-01-20T11:07:33.497973+0000","last_undegraded":"2024-01-20T11:07:33.497973+0000","last_fullsized":"2024-01-20T11:07:33.497973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:35.843485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499114+0000","last_change":"2024-01-20T11:07:32.523249+0000","last_active":"2024-01-20T11:07:33.499114+0000","last_peered":"2024-01-20T11:07:33.499114+0000","last_clean":"2024-01-20T11:07:33.499114+0000","last_became_active":"2024-01-20T11:07:32.523025+0000","last_became_peered":"2024-01-20T11:07:32.523025+0000","last_unstale":"2024-01-20T11:07:33.499114+0000","last_undegraded":"2024-01-20T11:07:33.499114+0000","last_fullsized":"2024-01-20T11:07:33.499114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.493831+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:07:32.493831+0000","last_peered":"2024-01-20T11:07:32.493831+0000","last_clean":"2024-01-20T11:07:32.493831+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:07:32.493831+0000","last_undegraded":"2024-01-20T11:07:32.493831+0000","last_fullsized":"2024-01-20T11:07:32.493831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500923+0000","last_change":"2024-01-20T11:07:31.485438+0000","last_active":"2024-01-20T11:07:33.500923+0000","last_peered":"2024-01-20T11:07:33.500923+0000","last_clean":"2024-01-20T11:07:33.500923+0000","last_became_active":"2024-01-20T11:07:31.485131+0000","last_became_peered":"2024-01-20T11:07:31.485131+0000","last_unstale":"2024-01-20T11:07:33.500923+0000","last_undegraded":"2024-01-20T11:07:33.500923+0000","last_fullsized":"2024-01-20T11:07:33.500923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307797+0000","last_change":"2024-01-20T11:07:32.503033+0000","last_active":"2024-01-20T11:07:34.307797+0000","last_peered":"2024-01-20T11:07:34.307797+0000","last_clean":"2024-01-20T11:07:34.307797+0000","last_became_active":"2024-01-20T11:07:32.502390+0000","last_became_peered":"2024-01-20T11:07:32.502390+0000","last_unstale":"2024-01-20T11:07:34.307797+0000","last_undegraded":"2024-01-20T11:07:34.307797+0000","last_fullsized":"2024-01-20T11:07:34.307797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497374+0000","last_change":"2024-01-20T11:07:31.493977+0000","last_active":"2024-01-20T11:07:33.497374+0000","last_peered":"2024-01-20T11:07:33.497374+0000","last_clean":"2024-01-20T11:07:33.497374+0000","last_became_active":"2024-01-20T11:07:31.493633+0000","last_became_peered":"2024-01-20T11:07:31.493633+0000","last_unstale":"2024-01-20T11:07:33.497374+0000","last_undegraded":"2024-01-20T11:07:33.497374+0000","last_fullsized":"2024-01-20T11:07:33.497374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.510502+0000","last_change":"2024-01-20T11:07:32.506901+0000","last_active":"2024-01-20T11:07:32.510502+0000","last_peered":"2024-01-20T11:07:32.510502+0000","last_clean":"2024-01-20T11:07:32.510502+0000","last_became_active":"2024-01-20T11:07:32.506048+0000","last_became_peered":"2024-01-20T11:07:32.506048+0000","last_unstale":"2024-01-20T11:07:32.510502+0000","last_undegraded":"2024-01-20T11:07:32.510502+0000","last_fullsized":"2024-01-20T11:07:32.510502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:24.159242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497694+0000","last_change":"2024-01-20T11:07:31.489897+0000","last_active":"2024-01-20T11:07:33.497694+0000","last_peered":"2024-01-20T11:07:33.497694+0000","last_clean":"2024-01-20T11:07:33.497694+0000","last_became_active":"2024-01-20T11:07:31.489264+0000","last_became_peered":"2024-01-20T11:07:31.489264+0000","last_unstale":"2024-01-20T11:07:33.497694+0000","last_undegraded":"2024-01-20T11:07:33.497694+0000","last_fullsized":"2024-01-20T11:07:33.497694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159751+0000","last_change":"2024-01-20T11:07:32.489551+0000","last_active":"2024-01-20T11:07:34.159751+0000","last_peered":"2024-01-20T11:07:34.159751+0000","last_clean":"2024-01-20T11:07:34.159751+0000","last_became_active":"2024-01-20T11:07:32.489277+0000","last_became_peered":"2024-01-20T11:07:32.489277+0000","last_unstale":"2024-01-20T11:07:34.159751+0000","last_undegraded":"2024-01-20T11:07:34.159751+0000","last_fullsized":"2024-01-20T11:07:34.159751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:48.457758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501412+0000","last_change":"2024-01-20T11:07:31.483881+0000","last_active":"2024-01-20T11:07:33.501412+0000","last_peered":"2024-01-20T11:07:33.501412+0000","last_clean":"2024-01-20T11:07:33.501412+0000","last_became_active":"2024-01-20T11:07:31.483528+0000","last_became_peered":"2024-01-20T11:07:31.483528+0000","last_unstale":"2024-01-20T11:07:33.501412+0000","last_undegraded":"2024-01-20T11:07:33.501412+0000","last_fullsized":"2024-01-20T11:07:33.501412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.504240+0000","last_change":"2024-01-20T11:07:32.496285+0000","last_active":"2024-01-20T11:07:32.504240+0000","last_peered":"2024-01-20T11:07:32.504240+0000","last_clean":"2024-01-20T11:07:32.504240+0000","last_became_active":"2024-01-20T11:07:32.495112+0000","last_became_peered":"2024-01-20T11:07:32.495112+0000","last_unstale":"2024-01-20T11:07:32.504240+0000","last_undegraded":"2024-01-20T11:07:32.504240+0000","last_fullsized":"2024-01-20T11:07:32.504240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:28:20.137235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159900+0000","last_change":"2024-01-20T11:07:31.481611+0000","last_active":"2024-01-20T11:07:34.159900+0000","last_peered":"2024-01-20T11:07:34.159900+0000","last_clean":"2024-01-20T11:07:34.159900+0000","last_became_active":"2024-01-20T11:07:31.481322+0000","last_became_peered":"2024-01-20T11:07:31.481322+0000","last_unstale":"2024-01-20T11:07:34.159900+0000","last_undegraded":"2024-01-20T11:07:34.159900+0000","last_fullsized":"2024-01-20T11:07:34.159900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:49.040069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501882+0000","last_change":"2024-01-20T11:07:32.506000+0000","last_active":"2024-01-20T11:07:33.501882+0000","last_peered":"2024-01-20T11:07:33.501882+0000","last_clean":"2024-01-20T11:07:33.501882+0000","last_became_active":"2024-01-20T11:07:32.505039+0000","last_became_peered":"2024-01-20T11:07:32.505039+0000","last_unstale":"2024-01-20T11:07:33.501882+0000","last_undegraded":"2024-01-20T11:07:33.501882+0000","last_fullsized":"2024-01-20T11:07:33.501882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499473+0000","last_change":"2024-01-20T11:07:31.496162+0000","last_active":"2024-01-20T11:07:33.499473+0000","last_peered":"2024-01-20T11:07:33.499473+0000","last_clean":"2024-01-20T11:07:33.499473+0000","last_became_active":"2024-01-20T11:07:31.495742+0000","last_became_peered":"2024-01-20T11:07:31.495742+0000","last_unstale":"2024-01-20T11:07:33.499473+0000","last_undegraded":"2024-01-20T11:07:33.499473+0000","last_fullsized":"2024-01-20T11:07:33.499473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:37:17.428810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160078+0000","last_change":"2024-01-20T11:07:32.489292+0000","last_active":"2024-01-20T11:07:34.160078+0000","last_peered":"2024-01-20T11:07:34.160078+0000","last_clean":"2024-01-20T11:07:34.160078+0000","last_became_active":"2024-01-20T11:07:32.488833+0000","last_became_peered":"2024-01-20T11:07:32.488833+0000","last_unstale":"2024-01-20T11:07:34.160078+0000","last_undegraded":"2024-01-20T11:07:34.160078+0000","last_fullsized":"2024-01-20T11:07:34.160078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:03:48.348342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160582+0000","last_change":"2024-01-20T11:07:31.499423+0000","last_active":"2024-01-20T11:07:34.160582+0000","last_peered":"2024-01-20T11:07:34.160582+0000","last_clean":"2024-01-20T11:07:34.160582+0000","last_became_active":"2024-01-20T11:07:31.499207+0000","last_became_peered":"2024-01-20T11:07:31.499207+0000","last_unstale":"2024-01-20T11:07:34.160582+0000","last_undegraded":"2024-01-20T11:07:34.160582+0000","last_fullsized":"2024-01-20T11:07:34.160582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:38:53.823701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307987+0000","last_change":"2024-01-20T11:07:32.518826+0000","last_active":"2024-01-20T11:07:34.307987+0000","last_peered":"2024-01-20T11:07:34.307987+0000","last_clean":"2024-01-20T11:07:34.307987+0000","last_became_active":"2024-01-20T11:07:32.518540+0000","last_became_peered":"2024-01-20T11:07:32.518540+0000","last_unstale":"2024-01-20T11:07:34.307987+0000","last_undegraded":"2024-01-20T11:07:34.307987+0000","last_fullsized":"2024-01-20T11:07:34.307987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390151+0000","last_change":"2024-01-20T11:07:31.498846+0000","last_active":"2024-01-20T11:07:34.390151+0000","last_peered":"2024-01-20T11:07:34.390151+0000","last_clean":"2024-01-20T11:07:34.390151+0000","last_became_active":"2024-01-20T11:07:31.498477+0000","last_became_peered":"2024-01-20T11:07:31.498477+0000","last_unstale":"2024-01-20T11:07:34.390151+0000","last_undegraded":"2024-01-20T11:07:34.390151+0000","last_fullsized":"2024-01-20T11:07:34.390151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.500961+0000","last_change":"2024-01-20T11:07:32.495729+0000","last_active":"2024-01-20T11:07:32.500961+0000","last_peered":"2024-01-20T11:07:32.500961+0000","last_clean":"2024-01-20T11:07:32.500961+0000","last_became_active":"2024-01-20T11:07:32.493695+0000","last_became_peered":"2024-01-20T11:07:32.493695+0000","last_unstale":"2024-01-20T11:07:32.500961+0000","last_undegraded":"2024-01-20T11:07:32.500961+0000","last_fullsized":"2024-01-20T11:07:32.500961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:07.765390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497112+0000","last_change":"2024-01-20T11:07:31.495706+0000","last_active":"2024-01-20T11:07:33.497112+0000","last_peered":"2024-01-20T11:07:33.497112+0000","last_clean":"2024-01-20T11:07:33.497112+0000","last_became_active":"2024-01-20T11:07:31.495412+0000","last_became_peered":"2024-01-20T11:07:31.495412+0000","last_unstale":"2024-01-20T11:07:33.497112+0000","last_undegraded":"2024-01-20T11:07:33.497112+0000","last_fullsized":"2024-01-20T11:07:33.497112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.503781+0000","last_change":"2024-01-20T11:07:32.492080+0000","last_active":"2024-01-20T11:07:32.503781+0000","last_peered":"2024-01-20T11:07:32.503781+0000","last_clean":"2024-01-20T11:07:32.503781+0000","last_became_active":"2024-01-20T11:07:32.491063+0000","last_became_peered":"2024-01-20T11:07:32.491063+0000","last_unstale":"2024-01-20T11:07:32.503781+0000","last_undegraded":"2024-01-20T11:07:32.503781+0000","last_fullsized":"2024-01-20T11:07:32.503781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:09:15.949062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159828+0000","last_change":"2024-01-20T11:07:31.485898+0000","last_active":"2024-01-20T11:07:34.159828+0000","last_peered":"2024-01-20T11:07:34.159828+0000","last_clean":"2024-01-20T11:07:34.159828+0000","last_became_active":"2024-01-20T11:07:31.485601+0000","last_became_peered":"2024-01-20T11:07:31.485601+0000","last_unstale":"2024-01-20T11:07:34.159828+0000","last_undegraded":"2024-01-20T11:07:34.159828+0000","last_fullsized":"2024-01-20T11:07:34.159828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307529+0000","last_change":"2024-01-20T11:07:32.491885+0000","last_active":"2024-01-20T11:07:34.307529+0000","last_peered":"2024-01-20T11:07:34.307529+0000","last_clean":"2024-01-20T11:07:34.307529+0000","last_became_active":"2024-01-20T11:07:32.491603+0000","last_became_peered":"2024-01-20T11:07:32.491603+0000","last_unstale":"2024-01-20T11:07:34.307529+0000","last_undegraded":"2024-01-20T11:07:34.307529+0000","last_fullsized":"2024-01-20T11:07:34.307529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159878+0000","last_change":"2024-01-20T11:07:31.492532+0000","last_active":"2024-01-20T11:07:34.159878+0000","last_peered":"2024-01-20T11:07:34.159878+0000","last_clean":"2024-01-20T11:07:34.159878+0000","last_became_active":"2024-01-20T11:07:31.492086+0000","last_became_peered":"2024-01-20T11:07:31.492086+0000","last_unstale":"2024-01-20T11:07:34.159878+0000","last_undegraded":"2024-01-20T11:07:34.159878+0000","last_fullsized":"2024-01-20T11:07:34.159878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308413+0000","last_change":"2024-01-20T11:07:32.496745+0000","last_active":"2024-01-20T11:07:34.308413+0000","last_peered":"2024-01-20T11:07:34.308413+0000","last_clean":"2024-01-20T11:07:34.308413+0000","last_became_active":"2024-01-20T11:07:32.496476+0000","last_became_peered":"2024-01-20T11:07:32.496476+0000","last_unstale":"2024-01-20T11:07:34.308413+0000","last_undegraded":"2024-01-20T11:07:34.308413+0000","last_fullsized":"2024-01-20T11:07:34.308413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499806+0000","last_change":"2024-01-20T11:07:31.497898+0000","last_active":"2024-01-20T11:07:33.499806+0000","last_peered":"2024-01-20T11:07:33.499806+0000","last_clean":"2024-01-20T11:07:33.499806+0000","last_became_active":"2024-01-20T11:07:31.497633+0000","last_became_peered":"2024-01-20T11:07:31.497633+0000","last_unstale":"2024-01-20T11:07:33.499806+0000","last_undegraded":"2024-01-20T11:07:33.499806+0000","last_fullsized":"2024-01-20T11:07:33.499806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:16:12.889750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389455+0000","last_change":"2024-01-20T11:07:32.502048+0000","last_active":"2024-01-20T11:07:34.389455+0000","last_peered":"2024-01-20T11:07:34.389455+0000","last_clean":"2024-01-20T11:07:34.389455+0000","last_became_active":"2024-01-20T11:07:32.501771+0000","last_became_peered":"2024-01-20T11:07:32.501771+0000","last_unstale":"2024-01-20T11:07:34.389455+0000","last_undegraded":"2024-01-20T11:07:34.389455+0000","last_fullsized":"2024-01-20T11:07:34.389455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501677+0000","last_change":"2024-01-20T11:07:32.505630+0000","last_active":"2024-01-20T11:07:33.501677+0000","last_peered":"2024-01-20T11:07:33.501677+0000","last_clean":"2024-01-20T11:07:33.501677+0000","last_became_active":"2024-01-20T11:07:32.505349+0000","last_became_peered":"2024-01-20T11:07:32.505349+0000","last_unstale":"2024-01-20T11:07:33.501677+0000","last_undegraded":"2024-01-20T11:07:33.501677+0000","last_fullsized":"2024-01-20T11:07:33.501677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498700+0000","last_change":"2024-01-20T11:07:31.500045+0000","last_active":"2024-01-20T11:07:33.498700+0000","last_peered":"2024-01-20T11:07:33.498700+0000","last_clean":"2024-01-20T11:07:33.498700+0000","last_became_active":"2024-01-20T11:07:31.499737+0000","last_became_peered":"2024-01-20T11:07:31.499737+0000","last_unstale":"2024-01-20T11:07:33.498700+0000","last_undegraded":"2024-01-20T11:07:33.498700+0000","last_fullsized":"2024-01-20T11:07:33.498700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:34.222349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501807+0000","last_change":"2024-01-20T11:07:32.506908+0000","last_active":"2024-01-20T11:07:33.501807+0000","last_peered":"2024-01-20T11:07:33.501807+0000","last_clean":"2024-01-20T11:07:33.501807+0000","last_became_active":"2024-01-20T11:07:32.506541+0000","last_became_peered":"2024-01-20T11:07:32.506541+0000","last_unstale":"2024-01-20T11:07:33.501807+0000","last_undegraded":"2024-01-20T11:07:33.501807+0000","last_fullsized":"2024-01-20T11:07:33.501807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499153+0000","last_change":"2024-01-20T11:07:31.500669+0000","last_active":"2024-01-20T11:07:33.499153+0000","last_peered":"2024-01-20T11:07:33.499153+0000","last_clean":"2024-01-20T11:07:33.499153+0000","last_became_active":"2024-01-20T11:07:31.500354+0000","last_became_peered":"2024-01-20T11:07:31.500354+0000","last_unstale":"2024-01-20T11:07:33.499153+0000","last_undegraded":"2024-01-20T11:07:33.499153+0000","last_fullsized":"2024-01-20T11:07:33.499153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:21.904186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.515196+0000","last_change":"2024-01-20T11:07:32.509179+0000","last_active":"2024-01-20T11:07:32.515196+0000","last_peered":"2024-01-20T11:07:32.515196+0000","last_clean":"2024-01-20T11:07:32.515196+0000","last_became_active":"2024-01-20T11:07:32.508667+0000","last_became_peered":"2024-01-20T11:07:32.508667+0000","last_unstale":"2024-01-20T11:07:32.515196+0000","last_undegraded":"2024-01-20T11:07:32.515196+0000","last_fullsized":"2024-01-20T11:07:32.515196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:22.942983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308404+0000","last_change":"2024-01-20T11:07:31.487022+0000","last_active":"2024-01-20T11:07:34.308404+0000","last_peered":"2024-01-20T11:07:34.308404+0000","last_clean":"2024-01-20T11:07:34.308404+0000","last_became_active":"2024-01-20T11:07:31.485438+0000","last_became_peered":"2024-01-20T11:07:31.485438+0000","last_unstale":"2024-01-20T11:07:34.308404+0000","last_undegraded":"2024-01-20T11:07:34.308404+0000","last_fullsized":"2024-01-20T11:07:34.308404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308147+0000","last_change":"2024-01-20T11:07:32.498652+0000","last_active":"2024-01-20T11:07:34.308147+0000","last_peered":"2024-01-20T11:07:34.308147+0000","last_clean":"2024-01-20T11:07:34.308147+0000","last_became_active":"2024-01-20T11:07:32.498322+0000","last_became_peered":"2024-01-20T11:07:32.498322+0000","last_unstale":"2024-01-20T11:07:34.308147+0000","last_undegraded":"2024-01-20T11:07:34.308147+0000","last_fullsized":"2024-01-20T11:07:34.308147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.525761+0000","last_change":"2024-01-20T11:07:31.495529+0000","last_active":"2024-01-20T11:07:32.525761+0000","last_peered":"2024-01-20T11:07:32.525761+0000","last_clean":"2024-01-20T11:07:32.525761+0000","last_became_active":"2024-01-20T11:07:31.495233+0000","last_became_peered":"2024-01-20T11:07:31.495233+0000","last_unstale":"2024-01-20T11:07:32.525761+0000","last_undegraded":"2024-01-20T11:07:32.525761+0000","last_fullsized":"2024-01-20T11:07:32.525761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":823296,"data_stored":669678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":74040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4740000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":72554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.008}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":819200,"data_stored":663434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:07:37.437 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T11:07:37.437 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-20T11:07:37.437 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-20T11:07:37.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-20T11:07:37.438 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-20T11:07:37.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.682+0000 7f890c400640 1 Processor -- start 2024-01-20T11:07:37.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.682+0000 7f890c400640 1 -- start start 2024-01-20T11:07:37.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.683+0000 7f890c400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8904155a30 0x7f89040ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.683+0000 7f890c400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8904070b60 con 0x7f89040ae6b0 2024-01-20T11:07:37.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.683+0000 7f890c400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890415bc00 con 0x7f8904070630 2024-01-20T11:07:37.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.683+0000 7f890c400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890415ba10 con 0x7f8904155a30 2024-01-20T11:07:37.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f8909a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8904155a30 0x7f89040ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f890a400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f89040ae6b0 0x7f890406c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33636/0 (socket says 172.21.15.162:33636) 2024-01-20T11:07:37.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f8909a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8904155a30 0x7f89040ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41088/0 (socket says 172.21.15.162:41088) 2024-01-20T11:07:37.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f890a400640 1 -- 172.21.15.162:0/4048376060 learned_addr learned my addr 172.21.15.162:0/4048376060 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:37.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f8909a00640 1 -- 172.21.15.162:0/4048376060 >> v1:172.21.15.179:6789/0 conn(0x7f8904070630 legacy=0x7f89040adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:37.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f8909a00640 1 -- 172.21.15.162:0/4048376060 >> v1:172.21.15.162:6789/0 conn(0x7f89040ae6b0 legacy=0x7f890406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f8909a00640 1 -- 172.21.15.162:0/4048376060 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890415bee0 con 0x7f8904155a30 2024-01-20T11:07:37.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.684+0000 7f8903e00640 1 -- 172.21.15.162:0/4048376060 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184247474 0 0) 0x7f8904070b60 con 0x7f89040ae6b0 2024-01-20T11:07:37.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.685+0000 7f8909a00640 1 --2- 172.21.15.162:0/4048376060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904155a30 0x7f89040ce800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f88f40097a0 tx=0x7f88f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aec770bc958a32 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:37.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.685+0000 7f8903e00640 1 -- 172.21.15.162:0/4048376060 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f402e070 con 0x7f8904155a30 2024-01-20T11:07:37.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f8903e00640 1 -- 172.21.15.162:0/4048376060 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f40315a0 con 0x7f8904155a30 2024-01-20T11:07:37.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f8903e00640 1 -- 172.21.15.162:0/4048376060 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4031930 con 0x7f8904155a30 2024-01-20T11:07:37.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f890c400640 1 -- 172.21.15.162:0/4048376060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904155a30 msgr2=0x7f89040ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f890c400640 1 --2- 172.21.15.162:0/4048376060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904155a30 0x7f89040ce800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f88f40097a0 tx=0x7f88f402b840 comp rx=0 tx=0).stop 2024-01-20T11:07:37.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f890c400640 1 -- 172.21.15.162:0/4048376060 shutdown_connections 2024-01-20T11:07:37.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f890c400640 1 --2- 172.21.15.162:0/4048376060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904155a30 0x7f89040ce800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f890c400640 1 -- 172.21.15.162:0/4048376060 >> 172.21.15.162:0/4048376060 conn(0x7f89040b0cd0 msgr2=0x7f89040b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:37.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f890c400640 1 -- 172.21.15.162:0/4048376060 shutdown_connections 2024-01-20T11:07:37.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.686+0000 7f890c400640 1 -- 172.21.15.162:0/4048376060 wait complete. 2024-01-20T11:07:37.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.688+0000 7f890c400640 1 Processor -- start 2024-01-20T11:07:37.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.688+0000 7f890c400640 1 -- start start 2024-01-20T11:07:37.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f890c400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904070630 0x7f890415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f890c400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89040ae6b0 0x7f8904147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f890c400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8904155a30 0x7f890415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f890c400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890415ea40 con 0x7f8904070630 2024-01-20T11:07:37.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f890c400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890415e070 con 0x7f89040ae6b0 2024-01-20T11:07:37.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f890c400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890415d460 con 0x7f8904155a30 2024-01-20T11:07:37.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f8909a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904070630 0x7f890415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f8909a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904070630 0x7f890415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41098/0 (socket says 172.21.15.162:41098) 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.689+0000 7f8909a00640 1 -- 172.21.15.162:0/4066736846 learned_addr learned my addr 172.21.15.162:0/4066736846 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909000640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89040ae6b0 0x7f8904147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909a00640 1 -- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8904155a30 msgr2=0x7f890415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f890a400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8904155a30 0x7f890415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909a00640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8904155a30 0x7f890415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909a00640 1 -- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89040ae6b0 msgr2=0x7f8904147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909a00640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89040ae6b0 0x7f8904147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909a00640 1 -- 172.21.15.162:0/4066736846 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f4009400 con 0x7f8904070630 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909000640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89040ae6b0 0x7f8904147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:37.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f890a400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8904155a30 0x7f890415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:37.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8909a00640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904070630 0x7f890415cdf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f88f4034040 tx=0x7f88f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:37.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8901600640 1 -- 172.21.15.162:0/4066736846 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4032900 con 0x7f8904070630 2024-01-20T11:07:37.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8901600640 1 -- 172.21.15.162:0/4066736846 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4032a60 con 0x7f8904070630 2024-01-20T11:07:37.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.690+0000 7f8901600640 1 -- 172.21.15.162:0/4066736846 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4032e10 con 0x7f8904070630 2024-01-20T11:07:37.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.691+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890415d740 con 0x7f8904070630 2024-01-20T11:07:37.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.691+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890415dd00 con 0x7f8904070630 2024-01-20T11:07:37.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.692+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890415dec0 con 0x7f8904070630 2024-01-20T11:07:37.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.693+0000 7f8901600640 1 -- 172.21.15.162:0/4066736846 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f88f403b3f0 con 0x7f8904070630 2024-01-20T11:07:37.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.693+0000 7f8901600640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f88dc06aed0 0x7f88dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:37.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.694+0000 7f8901600640 1 -- 172.21.15.162:0/4066736846 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88f40ab750 con 0x7f8904070630 2024-01-20T11:07:37.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.694+0000 7f8909000640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f88dc06aed0 0x7f88dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:37.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.694+0000 7f8909000640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f88dc06aed0 0x7f88dc06d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89040cb810 tx=0x7f88ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:37.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.698+0000 7f8901600640 1 -- 172.21.15.162:0/4066736846 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f88f4076580 con 0x7f8904070630 2024-01-20T11:07:37.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.940+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f890404e970 con 0x7f8904070630 2024-01-20T11:07:37.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.949+0000 7f8901600640 1 -- 172.21.15.162:0/4066736846 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170774 (secure 0 0 0) 0x7f88f4079ba0 con 0x7f8904070630 2024-01-20T11:07:37.952 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:37.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.953+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f88dc06aed0 msgr2=0x7f88dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.953+0000 7f890c400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f88dc06aed0 0x7f88dc06d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89040cb810 tx=0x7f88ec009040 comp rx=0 tx=0).stop 2024-01-20T11:07:37.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904070630 msgr2=0x7f890415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:37.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904070630 0x7f890415cdf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f88f4034040 tx=0x7f88f40046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 shutdown_connections 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8904155a30 0x7f890415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f88dc06aed0 0x7f88dc06d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89040ae6b0 0x7f8904147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 --2- 172.21.15.162:0/4066736846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8904070630 0x7f890415cdf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 >> 172.21.15.162:0/4066736846 conn(0x7f89040b0cd0 msgr2=0x7f890415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 shutdown_connections 2024-01-20T11:07:37.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:37.954+0000 7f890c400640 1 -- 172.21.15.162:0/4066736846 wait complete. 2024-01-20T11:07:37.973 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":5,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1143721842},{"type":"v1","addr":"172.21.15.162:6833","nonce":1143721842}]},"active_addr":"172.21.15.162:6833/1143721842","active_change":"2024-01-20T11:07:17.554302+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":806835670}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":1750604577}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":492711098}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":3596995625}]}]} 2024-01-20T11:07:37.976 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-20T11:07:37.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-20T11:07:37.976 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:38.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.181+0000 7fae4a600640 1 Processor -- start 2024-01-20T11:07:38.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.181+0000 7fae4a600640 1 -- start start 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae4a600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fae44070630 0x7fae440adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae4a600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae4415c6e0 0x7fae440ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae4a600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae44070b60 con 0x7fae44155a30 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae4a600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4415ba10 con 0x7fae44070630 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae4a600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4415bc00 con 0x7fae4415c6e0 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae3a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fae44070630 0x7fae440adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae3a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fae44070630 0x7fae440adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41106/0 (socket says 172.21.15.162:41106) 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae3a800640 1 -- 172.21.15.162:0/735648428 learned_addr learned my addr 172.21.15.162:0/735648428 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae43e00640 1 --2- 172.21.15.162:0/735648428 >> v2:172.21.15.179:3300/0 conn(0x7fae4415c6e0 0x7fae440ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae3a800640 1 -- 172.21.15.162:0/735648428 >> v2:172.21.15.179:3300/0 conn(0x7fae4415c6e0 msgr2=0x7fae440ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:38.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae3a800640 1 --2- 172.21.15.162:0/735648428 >> v2:172.21.15.179:3300/0 conn(0x7fae4415c6e0 0x7fae440ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae3a800640 1 -- 172.21.15.162:0/735648428 >> v1:172.21.15.179:6789/0 conn(0x7fae44155a30 legacy=0x7fae440ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:38.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.183+0000 7fae3a800640 1 -- 172.21.15.162:0/735648428 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4415bee0 con 0x7fae44070630 2024-01-20T11:07:38.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.185+0000 7fae3a800640 1 --2- 172.21.15.162:0/735648428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44070630 0x7fae440adfa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae44071ba0 tx=0x7fae2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3c2233a2e2f01c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:38.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.185+0000 7fae42a00640 1 -- 172.21.15.162:0/735648428 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c031870 con 0x7fae44070630 2024-01-20T11:07:38.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.185+0000 7fae42a00640 1 -- 172.21.15.162:0/735648428 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c0319d0 con 0x7fae44070630 2024-01-20T11:07:38.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.185+0000 7fae42a00640 1 -- 172.21.15.162:0/735648428 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c031d60 con 0x7fae44070630 2024-01-20T11:07:38.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 -- 172.21.15.162:0/735648428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44070630 msgr2=0x7fae440adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 --2- 172.21.15.162:0/735648428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44070630 0x7fae440adfa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae44071ba0 tx=0x7fae2c02b910 comp rx=0 tx=0).stop 2024-01-20T11:07:38.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 -- 172.21.15.162:0/735648428 shutdown_connections 2024-01-20T11:07:38.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 --2- 172.21.15.162:0/735648428 >> v2:172.21.15.179:3300/0 conn(0x7fae4415c6e0 0x7fae440ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 --2- 172.21.15.162:0/735648428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44070630 0x7fae440adfa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 -- 172.21.15.162:0/735648428 >> 172.21.15.162:0/735648428 conn(0x7fae440b0cd0 msgr2=0x7fae440b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:38.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 -- 172.21.15.162:0/735648428 shutdown_connections 2024-01-20T11:07:38.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.186+0000 7fae4a600640 1 -- 172.21.15.162:0/735648428 wait complete. 2024-01-20T11:07:38.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.187+0000 7fae4a600640 1 Processor -- start 2024-01-20T11:07:38.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.188+0000 7fae4a600640 1 -- start start 2024-01-20T11:07:38.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.188+0000 7fae4a600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44070630 0x7fae441518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.188+0000 7fae4a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44155a30 0x7fae440af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.188+0000 7fae4a600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae4415c6e0 0x7fae440cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.188+0000 7fae4a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440b5080 con 0x7fae44155a30 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.188+0000 7fae4a600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440b1e30 con 0x7fae4415c6e0 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae4a600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae440ca7d0 con 0x7fae44070630 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44155a30 0x7fae440af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44155a30 0x7fae440af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41112/0 (socket says 172.21.15.162:41112) 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 -- 172.21.15.162:0/2067585268 learned_addr learned my addr 172.21.15.162:0/2067585268 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae43400640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44070630 0x7fae441518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae43e00640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae4415c6e0 0x7fae440cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 -- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44070630 msgr2=0x7fae441518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44070630 0x7fae441518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 -- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae4415c6e0 msgr2=0x7fae440cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae4415c6e0 0x7fae440cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 -- 172.21.15.162:0/2067585268 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0094d0 con 0x7fae44155a30 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.189+0000 7fae3a800640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44155a30 0x7fae440af820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae2c000c00 tx=0x7fae2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:38.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.190+0000 7fae3be00640 1 -- 172.21.15.162:0/2067585268 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c03abe0 con 0x7fae44155a30 2024-01-20T11:07:38.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.190+0000 7fae3be00640 1 -- 172.21.15.162:0/2067585268 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c03ad40 con 0x7fae44155a30 2024-01-20T11:07:38.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.190+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae44155f90 con 0x7fae44155a30 2024-01-20T11:07:38.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.190+0000 7fae3be00640 1 -- 172.21.15.162:0/2067585268 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c044610 con 0x7fae44155a30 2024-01-20T11:07:38.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.190+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae44151e30 con 0x7fae44155a30 2024-01-20T11:07:38.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.191+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4404e970 con 0x7fae44155a30 2024-01-20T11:07:38.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.192+0000 7fae3be00640 1 -- 172.21.15.162:0/2067585268 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fae2c04d450 con 0x7fae44155a30 2024-01-20T11:07:38.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.193+0000 7fae3be00640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fae1c06aed0 0x7fae1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.193+0000 7fae3be00640 1 -- 172.21.15.162:0/2067585268 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae2c02d040 con 0x7fae44155a30 2024-01-20T11:07:38.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.193+0000 7fae43400640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fae1c06aed0 0x7fae1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.194+0000 7fae43400640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fae1c06aed0 0x7fae1c06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae34004ea0 tx=0x7fae34009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:38.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.197+0000 7fae3be00640 1 -- 172.21.15.162:0/2067585268 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fae2c076b40 con 0x7fae44155a30 2024-01-20T11:07:38.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.376+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae440ca910 con 0x7fae44155a30 2024-01-20T11:07:38.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.378+0000 7fae3be00640 1 -- 172.21.15.162:0/2067585268 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fae2c035020 con 0x7fae44155a30 2024-01-20T11:07:38.379 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:38.379 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fae1c06aed0 msgr2=0x7fae1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fae1c06aed0 0x7fae1c06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae34004ea0 tx=0x7fae34009040 comp rx=0 tx=0).stop 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44155a30 msgr2=0x7fae440af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44155a30 0x7fae440af820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae2c000c00 tx=0x7fae2c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 shutdown_connections 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fae1c06aed0 0x7fae1c06d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae4415c6e0 0x7fae440cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae44155a30 0x7fae440af820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 --2- 172.21.15.162:0/2067585268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44070630 0x7fae441518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 >> 172.21.15.162:0/2067585268 conn(0x7fae440b0cd0 msgr2=0x7fae4406c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 shutdown_connections 2024-01-20T11:07:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.381+0000 7fae4a600640 1 -- 172.21.15.162:0/2067585268 wait complete. 2024-01-20T11:07:38.400 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-20T11:07:38.400 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:38.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.606+0000 7fd119000640 1 Processor -- start 2024-01-20T11:07:38.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.606+0000 7fd119000640 1 -- start start 2024-01-20T11:07:38.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.607+0000 7fd119000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd114070630 0x7fd1140adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.607+0000 7fd119000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd11415c6e0 0x7fd1140ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.607+0000 7fd119000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd114070b60 con 0x7fd114155a30 2024-01-20T11:07:38.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.607+0000 7fd119000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11415ba10 con 0x7fd114070630 2024-01-20T11:07:38.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.607+0000 7fd119000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11415bc00 con 0x7fd11415c6e0 2024-01-20T11:07:38.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd111400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd114070630 0x7fd1140adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd111400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd114070630 0x7fd1140adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41120/0 (socket says 172.21.15.162:41120) 2024-01-20T11:07:38.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd111400640 1 -- 172.21.15.162:0/2375116020 learned_addr learned my addr 172.21.15.162:0/2375116020 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:38.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd112800640 1 --2- 172.21.15.162:0/2375116020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd11415c6e0 0x7fd1140ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd111400640 1 -- 172.21.15.162:0/2375116020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd11415c6e0 msgr2=0x7fd1140ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:38.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd111400640 1 --2- 172.21.15.162:0/2375116020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd11415c6e0 0x7fd1140ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd111400640 1 -- 172.21.15.162:0/2375116020 >> v1:172.21.15.179:6789/0 conn(0x7fd114155a30 legacy=0x7fd1140ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:38.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.608+0000 7fd111400640 1 -- 172.21.15.162:0/2375116020 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11415bee0 con 0x7fd114070630 2024-01-20T11:07:38.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.609+0000 7fd111400640 1 --2- 172.21.15.162:0/2375116020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd114070630 0x7fd1140adfa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009e50 tx=0x7fd0fc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e103d5c20181c906 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:38.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd110a00640 1 -- 172.21.15.162:0/2375116020 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc02ca70 con 0x7fd114070630 2024-01-20T11:07:38.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd110a00640 1 -- 172.21.15.162:0/2375116020 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc02cbd0 con 0x7fd114070630 2024-01-20T11:07:38.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd110a00640 1 -- 172.21.15.162:0/2375116020 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0343f0 con 0x7fd114070630 2024-01-20T11:07:38.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 -- 172.21.15.162:0/2375116020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd114070630 msgr2=0x7fd1140adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 --2- 172.21.15.162:0/2375116020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd114070630 0x7fd1140adfa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009e50 tx=0x7fd0fc02bed0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 -- 172.21.15.162:0/2375116020 shutdown_connections 2024-01-20T11:07:38.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 --2- 172.21.15.162:0/2375116020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd11415c6e0 0x7fd1140ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 --2- 172.21.15.162:0/2375116020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd114070630 0x7fd1140adfa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 -- 172.21.15.162:0/2375116020 >> 172.21.15.162:0/2375116020 conn(0x7fd1140b0cd0 msgr2=0x7fd1140b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:38.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 -- 172.21.15.162:0/2375116020 shutdown_connections 2024-01-20T11:07:38.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.610+0000 7fd119000640 1 -- 172.21.15.162:0/2375116020 wait complete. 2024-01-20T11:07:38.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.612+0000 7fd119000640 1 Processor -- start 2024-01-20T11:07:38.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.612+0000 7fd119000640 1 -- start start 2024-01-20T11:07:38.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd119000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd114070630 0x7fd1140cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd119000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd114155a30 0x7fd11409c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd119000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd11415c6e0 0x7fd11409c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd119000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11409cd00 con 0x7fd11415c6e0 2024-01-20T11:07:38.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd119000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b4600 con 0x7fd114070630 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd119000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11414caa0 con 0x7fd114155a30 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd112800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd11415c6e0 0x7fd11409c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd112800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd11415c6e0 0x7fd11409c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41130/0 (socket says 172.21.15.162:41130) 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.613+0000 7fd112800640 1 -- 172.21.15.162:0/2070626222 learned_addr learned my addr 172.21.15.162:0/2070626222 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd111e00640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd114070630 0x7fd1140cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd112800640 1 -- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd114155a30 msgr2=0x7fd11409c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd112800640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd114155a30 0x7fd11409c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd112800640 1 -- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd114070630 msgr2=0x7fd1140cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd112800640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd114070630 0x7fd1140cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd112800640 1 -- 172.21.15.162:0/2070626222 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc009b30 con 0x7fd11415c6e0 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd111e00640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd114070630 0x7fd1140cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:38.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd112800640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd11415c6e0 0x7fd11409c6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00c550 tx=0x7fd10c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:38.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd10a000640 1 -- 172.21.15.162:0/2070626222 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c004220 con 0x7fd11415c6e0 2024-01-20T11:07:38.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd10a000640 1 -- 172.21.15.162:0/2070626222 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c004380 con 0x7fd11415c6e0 2024-01-20T11:07:38.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd10a000640 1 -- 172.21.15.162:0/2070626222 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c003850 con 0x7fd11415c6e0 2024-01-20T11:07:38.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.614+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd114155f90 con 0x7fd11415c6e0 2024-01-20T11:07:38.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.615+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1140b3fb0 con 0x7fd11415c6e0 2024-01-20T11:07:38.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.616+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11404e970 con 0x7fd11415c6e0 2024-01-20T11:07:38.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.617+0000 7fd10a000640 1 -- 172.21.15.162:0/2070626222 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd10c0039b0 con 0x7fd11415c6e0 2024-01-20T11:07:38.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.617+0000 7fd10a000640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd0ec06af20 0x7fd0ec06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:38.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.618+0000 7fd10a000640 1 -- 172.21.15.162:0/2070626222 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd10c089180 con 0x7fd11415c6e0 2024-01-20T11:07:38.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.618+0000 7fd111e00640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd0ec06af20 0x7fd0ec06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:38.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.618+0000 7fd111e00640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd0ec06af20 0x7fd0ec06d3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd104003eb0 tx=0x7fd104009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:38.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.622+0000 7fd10a000640 1 -- 172.21.15.162:0/2070626222 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd10c0541c0 con 0x7fd11415c6e0 2024-01-20T11:07:38.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.811+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd11406db40 con 0x7fd11415c6e0 2024-01-20T11:07:38.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.814+0000 7fd10a000640 1 -- 172.21.15.162:0/2070626222 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fd10c0577e0 con 0x7fd11415c6e0 2024-01-20T11:07:38.815 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:38.815 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:38.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd0ec06af20 msgr2=0x7fd0ec06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd0ec06af20 0x7fd0ec06d3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd104003eb0 tx=0x7fd104009040 comp rx=0 tx=0).stop 2024-01-20T11:07:38.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd11415c6e0 msgr2=0x7fd11409c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:38.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd11415c6e0 0x7fd11409c6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00c550 tx=0x7fd10c00ca10 comp rx=0 tx=0).stop 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 shutdown_connections 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd11415c6e0 0x7fd11409c6f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd114155a30 0x7fd11409c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd0ec06af20 0x7fd0ec06d3e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 --2- 172.21.15.162:0/2070626222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd114070630 0x7fd1140cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 >> 172.21.15.162:0/2070626222 conn(0x7fd1140b0cd0 msgr2=0x7fd1140cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 shutdown_connections 2024-01-20T11:07:38.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:38.817+0000 7fd119000640 1 -- 172.21.15.162:0/2070626222 wait complete. 2024-01-20T11:07:38.834 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-20T11:07:38.835 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-20T11:07:38.835 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-20T11:07:38.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-20T11:07:38.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-20T11:07:38.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-20T11:07:38.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-20T11:07:38.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-20T11:07:39.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.126+0000 7f0f2e800640 1 Processor -- start 2024-01-20T11:07:39.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.127+0000 7f0f2e800640 1 -- start start 2024-01-20T11:07:39.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7fe781c00640 1 Processor -- start 2024-01-20T11:07:39.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7fe781c00640 1 -- start start 2024-01-20T11:07:39.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7f0f2e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 0x7f0f280ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7f0f2e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0f280d3e90 0x7f0f280d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7f0f2e800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0f280d1870 0x7f0f280d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7f0f2e800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280cea90 con 0x7f0f280d3e90 2024-01-20T11:07:39.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7f0f2e800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280d2220 con 0x7f0f280d1870 2024-01-20T11:07:39.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.128+0000 7f0f2e800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2815d9f0 con 0x7f0f2815d610 2024-01-20T11:07:39.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7f0f2de00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0f280d1870 0x7f0f280d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7f0f2de00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0f280d1870 0x7f0f280d1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42356/0 (socket says 172.21.15.162:42356) 2024-01-20T11:07:39.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7f0f2de00640 1 -- 172.21.15.162:0/3942457134 learned_addr learned my addr 172.21.15.162:0/3942457134 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.131+0000 7f0f2d400640 1 --2- 172.21.15.162:0/3942457134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 0x7f0f280ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.131+0000 7f0f2ca00640 1 --2- 172.21.15.162:0/3942457134 >> v2:172.21.15.162:3300/0 conn(0x7f0f280d3e90 0x7f0f280d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7fe781c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7740ebb50 0x7fe774055300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7fe781c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe7740061a0 0x7fe774006610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7fe781c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe774057e30 con 0x7fe7740eb060 2024-01-20T11:07:39.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7fe781c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740ec000 con 0x7fe7740061a0 2024-01-20T11:07:39.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.130+0000 7fe781c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740579a0 con 0x7fe7740ebb50 2024-01-20T11:07:39.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.131+0000 7fe77be00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe7740eb060 0x7fe7740eb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48030/0 (socket says 172.21.15.162:48030) 2024-01-20T11:07:39.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.131+0000 7fe77be00640 1 -- 172.21.15.162:0/1836953045 learned_addr learned my addr 172.21.15.162:0/1836953045 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.131+0000 7fe77b400640 1 --2- 172.21.15.162:0/1836953045 >> v2:172.21.15.179:3300/0 conn(0x7fe7740ebb50 0x7fe774055300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.131+0000 7fe781200640 1 --2- 172.21.15.162:0/1836953045 >> v2:172.21.15.162:3300/0 conn(0x7fe7740061a0 0x7fe774006610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7f0f2ca00640 1 -- 172.21.15.162:0/3942457134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 msgr2=0x7f0f280ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7f0f2ca00640 1 --2- 172.21.15.162:0/3942457134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 0x7f0f280ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7f0f2ca00640 1 -- 172.21.15.162:0/3942457134 >> v2:172.21.15.179:3300/0 conn(0x7f0f280d1870 msgr2=0x7f0f280d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7f0f2ca00640 1 --2- 172.21.15.162:0/3942457134 >> v2:172.21.15.179:3300/0 conn(0x7f0f280d1870 0x7f0f280d1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7fe77aa00640 1 -- 172.21.15.162:0/1836953045 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753437494 0 0) 0x7fe774057e30 con 0x7fe7740eb060 2024-01-20T11:07:39.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7fe77aa00640 1 -- 172.21.15.162:0/1836953045 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe75c003520 con 0x7fe7740eb060 2024-01-20T11:07:39.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7fe781200640 1 -- 172.21.15.162:0/1836953045 >> v2:172.21.15.179:3300/0 conn(0x7fe7740ebb50 msgr2=0x7fe774055300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7fe781200640 1 --2- 172.21.15.162:0/1836953045 >> v2:172.21.15.179:3300/0 conn(0x7fe7740ebb50 0x7fe774055300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7fe781200640 1 -- 172.21.15.162:0/1836953045 >> v1:172.21.15.179:6789/0 conn(0x7fe7740eb060 legacy=0x7fe7740eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7fe781200640 1 -- 172.21.15.162:0/1836953045 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740387e0 con 0x7fe7740061a0 2024-01-20T11:07:39.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.132+0000 7f0f2ca00640 1 -- 172.21.15.162:0/3942457134 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280ce0f0 con 0x7f0f280d3e90 2024-01-20T11:07:39.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.133+0000 7f0f2de00640 1 --2- 172.21.15.162:0/3942457134 >> v2:172.21.15.179:3300/0 conn(0x7f0f280d1870 0x7f0f280d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.133+0000 7f50b4a00640 1 Processor -- start 2024-01-20T11:07:39.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.134+0000 7f50b4a00640 1 -- start start 2024-01-20T11:07:39.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.134+0000 7fe781200640 1 --2- 172.21.15.162:0/1836953045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740061a0 0x7fe774006610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe774012100 tx=0x7fe76c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a5299c900a7c36 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.135+0000 7fe77aa00640 1 -- 172.21.15.162:0/1836953045 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c031740 con 0x7fe7740061a0 2024-01-20T11:07:39.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.135+0000 7fe77aa00640 1 -- 172.21.15.162:0/1836953045 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c0318a0 con 0x7fe7740061a0 2024-01-20T11:07:39.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.135+0000 7fe77aa00640 1 -- 172.21.15.162:0/1836953045 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c031c30 con 0x7fe7740061a0 2024-01-20T11:07:39.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.135+0000 7f0f2ca00640 1 --2- 172.21.15.162:0/3942457134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d3e90 0x7f0f280d0e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f2808d360 tx=0x7f0f1002b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e854fabe24e3755f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7f0f27e00640 1 -- 172.21.15.162:0/3942457134 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10030710 con 0x7f0f280d3e90 2024-01-20T11:07:39.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7f0f27e00640 1 -- 172.21.15.162:0/3942457134 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1002e050 con 0x7f0f280d3e90 2024-01-20T11:07:39.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7fe781c00640 1 -- 172.21.15.162:0/1836953045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740061a0 msgr2=0x7fe774006610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7fe781c00640 1 --2- 172.21.15.162:0/1836953045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740061a0 0x7fe774006610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe774012100 tx=0x7fe76c02b7e0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7f0f27e00640 1 -- 172.21.15.162:0/3942457134 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10030a90 con 0x7f0f280d3e90 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7fe781c00640 1 -- 172.21.15.162:0/1836953045 shutdown_connections 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7fe781c00640 1 --2- 172.21.15.162:0/1836953045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740061a0 0x7fe774006610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7fe781c00640 1 --2- 172.21.15.162:0/1836953045 >> v2:172.21.15.179:3300/0 conn(0x7fe7740ebb50 0x7fe774055300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7fe781c00640 1 -- 172.21.15.162:0/1836953045 >> 172.21.15.162:0/1836953045 conn(0x7fe7740559e0 msgr2=0x7fe774055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7f50b4a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50a8005e90 0x7f50a80062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.136+0000 7f50b4a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8006810 0x7f50a8006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f50b4a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a8054330 con 0x7f50a80ead00 2024-01-20T11:07:39.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f50b4a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a8053720 con 0x7f50a8005e90 2024-01-20T11:07:39.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f50b4a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8053a00 con 0x7f50a8006810 2024-01-20T11:07:39.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f0f2e800640 1 -- 172.21.15.162:0/3942457134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d3e90 msgr2=0x7f0f280d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f0f2e800640 1 --2- 172.21.15.162:0/3942457134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d3e90 0x7f0f280d0e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f2808d360 tx=0x7f0f1002b700 comp rx=0 tx=0).stop 2024-01-20T11:07:39.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f0f2e800640 1 -- 172.21.15.162:0/3942457134 shutdown_connections 2024-01-20T11:07:39.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f0f2e800640 1 --2- 172.21.15.162:0/3942457134 >> v2:172.21.15.179:3300/0 conn(0x7f0f280d1870 0x7f0f280d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f0f2e800640 1 --2- 172.21.15.162:0/3942457134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d3e90 0x7f0f280d0e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f0f2e800640 1 --2- 172.21.15.162:0/3942457134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 0x7f0f280ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7f0f2e800640 1 -- 172.21.15.162:0/3942457134 >> 172.21.15.162:0/3942457134 conn(0x7f0f2809c5d0 msgr2=0x7f0f280d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7fe781c00640 1 -- 172.21.15.162:0/1836953045 shutdown_connections 2024-01-20T11:07:39.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.137+0000 7fe781c00640 1 -- 172.21.15.162:0/1836953045 wait complete. 2024-01-20T11:07:39.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.138+0000 7f50af400640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f50a80ead00 0x7f50a804fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48032/0 (socket says 172.21.15.162:48032) 2024-01-20T11:07:39.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.138+0000 7f50af400640 1 -- 172.21.15.162:0/3322356992 learned_addr learned my addr 172.21.15.162:0/3322356992 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.138+0000 7f50aea00640 1 --2- 172.21.15.162:0/3322356992 >> v2:172.21.15.179:3300/0 conn(0x7f50a8005e90 0x7f50a80062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.138+0000 7f50afe00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8006810 0x7f50a8006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.138+0000 7f0f2e800640 1 -- 172.21.15.162:0/3942457134 shutdown_connections 2024-01-20T11:07:39.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.139+0000 7fe781c00640 1 Processor -- start 2024-01-20T11:07:39.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.139+0000 7fe781c00640 1 -- start start 2024-01-20T11:07:39.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.139+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187282532 0 0) 0x7f50a8054330 con 0x7f50a80ead00 2024-01-20T11:07:39.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.138+0000 7f3610c00640 1 Processor -- start 2024-01-20T11:07:39.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.139+0000 7f3610c00640 1 -- start start 2024-01-20T11:07:39.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5090003520 con 0x7f50a80ead00 2024-01-20T11:07:39.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7fe781c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7740061a0 0x7fe7740db1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7fe781c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7740eb060 0x7fe7740cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7f3610c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f360403e840 0x7f3604053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7f3610c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3604054130 0x7f36040068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7f0f2e800640 1 -- 172.21.15.162:0/3942457134 wait complete. 2024-01-20T11:07:39.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7fe781c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740ebb50 0x7fe7740cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3888753749 0 0) 0x7f5090003520 con 0x7f50a80ead00 2024-01-20T11:07:39.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.140+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8006810 msgr2=0x7f50a8006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f360aa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f360403e840 0x7f3604053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f360aa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f360403e840 0x7f3604053bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42394/0 (socket says 172.21.15.162:42394) 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7fe781c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77404e3f0 con 0x7fe7740ebb50 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7fe781c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740dc420 con 0x7fe7740061a0 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7fe781c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77404ec50 con 0x7fe7740eb060 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7fe77be00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7740061a0 0x7fe7740db1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8006810 0x7f50a8006ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 >> v2:172.21.15.179:3300/0 conn(0x7f50a8005e90 msgr2=0x7f50a80062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 --2- 172.21.15.162:0/3322356992 >> v2:172.21.15.179:3300/0 conn(0x7f50a8005e90 0x7f50a80062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8053ce0 con 0x7f50a80ead00 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f5098001670 con 0x7f50a80ead00 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 >> v1:172.21.15.179:6789/0 conn(0x7f50a80ead00 legacy=0x7f50a804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090003970 0x7f5090003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900047c0 0x7f5090004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5090005180 0x7f509000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8053720 con 0x7f5090003970 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8053a00 con 0x7f5090005180 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509000bf70 con 0x7f50900047c0 2024-01-20T11:07:39.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f360b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f36040e30c0 0x7f3604057d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33642/0 (socket says 172.21.15.162:33642) 2024-01-20T11:07:39.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.141+0000 7f50af400640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090003970 0x7f5090003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7f50afe00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8006810 0x7f50a8006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7f50aea00640 1 --2- 172.21.15.162:0/3322356992 >> v2:172.21.15.179:3300/0 conn(0x7f50a8005e90 0x7f50a80062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7fe77b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7740eb060 0x7fe7740cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7fe77b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7740eb060 0x7fe7740cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34246/0 (socket says 172.21.15.162:34246) 2024-01-20T11:07:39.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7fe77b400640 1 -- 172.21.15.162:0/290200464 learned_addr learned my addr 172.21.15.162:0/290200464 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7fe781200640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740ebb50 0x7fe7740cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7f3610c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3604058570 con 0x7f36040e30c0 2024-01-20T11:07:39.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7f3610c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36040061a0 con 0x7f3604054130 2024-01-20T11:07:39.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7f3610c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36040545a0 con 0x7f360403e840 2024-01-20T11:07:39.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.142+0000 7f50afe00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5090005180 0x7f509000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7f360aa00640 1 -- 172.21.15.162:0/2547944375 learned_addr learned my addr 172.21.15.162:0/2547944375 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7f50afe00640 1 -- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900047c0 msgr2=0x7f5090004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7fe781200640 1 -- 172.21.15.162:0/290200464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7740eb060 msgr2=0x7fe7740cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7fe781200640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7740eb060 0x7fe7740cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7fe781200640 1 -- 172.21.15.162:0/290200464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7740061a0 msgr2=0x7fe7740db1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7fe781200640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7740061a0 0x7fe7740db1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7fe781200640 1 -- 172.21.15.162:0/290200464 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c009400 con 0x7fe7740ebb50 2024-01-20T11:07:39.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f360aa00640 1 -- 172.21.15.162:0/2547944375 >> v2:172.21.15.162:3300/0 conn(0x7f3604054130 msgr2=0x7f36040068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7f50aea00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900047c0 0x7f5090004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.143+0000 7f50afe00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900047c0 0x7f5090004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f50afe00640 1 -- 172.21.15.162:0/3322356992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090003970 msgr2=0x7f5090003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f50afe00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090003970 0x7f5090003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f50afe00640 1 -- 172.21.15.162:0/3322356992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090003520 con 0x7f5090005180 2024-01-20T11:07:39.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f50af400640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090003970 0x7f5090003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:39.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f360aa00640 1 --2- 172.21.15.162:0/2547944375 >> v2:172.21.15.162:3300/0 conn(0x7f3604054130 0x7f36040068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f360aa00640 1 -- 172.21.15.162:0/2547944375 >> v1:172.21.15.162:6789/0 conn(0x7f36040e30c0 legacy=0x7f3604057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f0f2e800640 1 Processor -- start 2024-01-20T11:07:39.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f360aa00640 1 -- 172.21.15.162:0/2547944375 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604058850 con 0x7f360403e840 2024-01-20T11:07:39.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.144+0000 7f0f2e800640 1 -- start start 2024-01-20T11:07:39.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.145+0000 7fe781200640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740ebb50 0x7fe7740cd8b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe76c033000 tx=0x7fe76c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.145+0000 7f360aa00640 1 --2- 172.21.15.162:0/2547944375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f3604053bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3604008680 tx=0x7f35f402ba60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd28aa36bcdecc3e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c033900 con 0x7fe7740ebb50 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c033a60 con 0x7fe7740ebb50 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c033df0 con 0x7fe7740ebb50 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740dc140 con 0x7fe7740ebb50 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d1870 0x7f0f2815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2e800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f280d3e90 0x7f0f280cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 0x7f0f28147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2814caa0 con 0x7f0f280d1870 2024-01-20T11:07:39.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2e800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2814be90 con 0x7f0f280d3e90 2024-01-20T11:07:39.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2e800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2814c170 con 0x7f0f2815d610 2024-01-20T11:07:39.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f50afe00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5090005180 0x7f509000b980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006bf0 tx=0x7f50900057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed215acc9d1ea9fc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f360a000640 1 -- 172.21.15.162:0/2547944375 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402d820 con 0x7f360403e840 2024-01-20T11:07:39.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f360a000640 1 -- 172.21.15.162:0/2547944375 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f402d980 con 0x7f360403e840 2024-01-20T11:07:39.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7fbf22000640 1 Processor -- start 2024-01-20T11:07:39.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d1870 0x7f0f2815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d1870 0x7f0f2815c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41176/0 (socket says 172.21.15.162:41176) 2024-01-20T11:07:39.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2ca00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f280d3e90 0x7f0f280cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7f0f2d400640 1 -- 172.21.15.162:0/1523341835 learned_addr learned my addr 172.21.15.162:0/1523341835 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f360a000640 1 -- 172.21.15.162:0/2547944375 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402dd10 con 0x7f360403e840 2024-01-20T11:07:39.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0004030 con 0x7f5090005180 2024-01-20T11:07:39.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a0004190 con 0x7f5090005180 2024-01-20T11:07:39.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f0f2d400640 1 -- 172.21.15.162:0/1523341835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 msgr2=0x7f0f28147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f0f2d400640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f2815d610 0x7f0f28147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f0f2d400640 1 -- 172.21.15.162:0/1523341835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f280d3e90 msgr2=0x7f0f280cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f0f2d400640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f280d3e90 0x7f0f280cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7f0f2d400640 1 -- 172.21.15.162:0/1523341835 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f20009b30 con 0x7f0f280d1870 2024-01-20T11:07:39.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.147+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77404e8e0 con 0x7fe7740ebb50 2024-01-20T11:07:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.146+0000 7fbf22000640 1 -- start start 2024-01-20T11:07:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f0f2d400640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d1870 0x7f0f2815c7c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e870 tx=0x7f0f1800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f50ae000640 1 -- 172.21.15.162:0/3322356992 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0004500 con 0x7f5090005180 2024-01-20T11:07:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f3610c00640 1 -- 172.21.15.162:0/2547944375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 msgr2=0x7f3604053bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f3610c00640 1 --2- 172.21.15.162:0/2547944375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f3604053bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3604008680 tx=0x7f35f402ba60 comp rx=0 tx=0).stop 2024-01-20T11:07:39.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f3610c00640 1 -- 172.21.15.162:0/2547944375 shutdown_connections 2024-01-20T11:07:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f3610c00640 1 --2- 172.21.15.162:0/2547944375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f3604053bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f3610c00640 1 --2- 172.21.15.162:0/2547944375 >> v2:172.21.15.162:3300/0 conn(0x7f3604054130 0x7f36040068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f3610c00640 1 -- 172.21.15.162:0/2547944375 >> 172.21.15.162:0/2547944375 conn(0x7f36040559e0 msgr2=0x7f3604055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f3610c00640 1 -- 172.21.15.162:0/2547944375 shutdown_connections 2024-01-20T11:07:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f50b4a00640 1 -- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5090005180 msgr2=0x7f509000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f50b4a00640 1 --2- 172.21.15.162:0/3322356992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5090005180 0x7f509000b980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006bf0 tx=0x7f50900057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe774057350 con 0x7fe7740ebb50 2024-01-20T11:07:39.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f50afe00640 1 -- 172.21.15.162:0/3322356992 reap_dead start 2024-01-20T11:07:39.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f557be00640 1 Processor -- start 2024-01-20T11:07:39.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f557be00640 1 -- start start 2024-01-20T11:07:39.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f50b4a00640 1 -- 172.21.15.162:0/3322356992 shutdown_connections 2024-01-20T11:07:39.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.148+0000 7f50b4a00640 1 -- 172.21.15.162:0/3322356992 >> 172.21.15.162:0/3322356992 conn(0x7f50a8009fb0 msgr2=0x7f50a800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.149+0000 7f50b4a00640 1 -- 172.21.15.162:0/3322356992 shutdown_connections 2024-01-20T11:07:39.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.149+0000 7f3610c00640 1 -- 172.21.15.162:0/2547944375 wait complete. 2024-01-20T11:07:39.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.149+0000 7f50b4a00640 1 -- 172.21.15.162:0/3322356992 wait complete. 2024-01-20T11:07:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.149+0000 7fbf22000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf1c15a420 0x7fbf1c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.149+0000 7fbf22000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0ceea0 con 0x7fbf1c0b2040 2024-01-20T11:07:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.149+0000 7fbf22000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0ce8e0 con 0x7fbf1c06c3b0 2024-01-20T11:07:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.149+0000 7fbf22000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c15a000 con 0x7fbf1c15a420 2024-01-20T11:07:39.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7fbf1aa00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbf1c0b2040 0x7fbf1c0cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33650/0 (socket says 172.21.15.162:33650) 2024-01-20T11:07:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7fbf1aa00640 1 -- 172.21.15.162:0/1492927549 learned_addr learned my addr 172.21.15.162:0/1492927549 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f180094f0 con 0x7f0f280d1870 2024-01-20T11:07:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1800c8c0 con 0x7f0f280d1870 2024-01-20T11:07:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800cc50 con 0x7f0f280d1870 2024-01-20T11:07:39.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7fbf1be00640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf1c15a420 0x7fbf1c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7f3610c00640 1 Processor -- start 2024-01-20T11:07:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745286549 0 0) 0x7fbf1c0ce8e0 con 0x7fbf1c06c3b0 2024-01-20T11:07:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbefc003520 con 0x7fbf1c06c3b0 2024-01-20T11:07:39.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626082960 0 0) 0x7fbf1c0ceea0 con 0x7fbf1c0b2040 2024-01-20T11:07:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf1c0ce8e0 con 0x7fbf1c0b2040 2024-01-20T11:07:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7f3610c00640 1 -- start start 2024-01-20T11:07:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f10009400 con 0x7f0f280d1870 2024-01-20T11:07:39.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2814c730 con 0x7f0f280d1870 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7f50b4a00640 1 Processor -- start 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f557be00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f557c0d37c0 0x7f557c0b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f557be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f557be00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c0b3f30 con 0x7f557c0d1100 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f557be00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c0c6910 con 0x7f557c0d37c0 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.150+0000 7f557be00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b3110 con 0x7f557c0d1f60 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7f557aa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f557c0d37c0 0x7f557c0b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7f557aa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f557c0d37c0 0x7f557c0b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42416/0 (socket says 172.21.15.162:42416) 2024-01-20T11:07:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7f557aa00640 1 -- 172.21.15.162:0/3650274838 learned_addr learned my addr 172.21.15.162:0/3650274838 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.151+0000 7f557b400640 1 --2- 172.21.15.162:0/3650274838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725416322 0 0) 0x7fbf1c0ce8e0 con 0x7fbf1c0b2040 2024-01-20T11:07:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf1c15a420 msgr2=0x7fbf1c15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf1c15a420 0x7fbf1c15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 >> v1:172.21.15.179:6789/0 conn(0x7fbf1c06c3b0 legacy=0x7fbf1c06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0cebc0 con 0x7fbf1c0b2040 2024-01-20T11:07:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7f50b4a00640 1 -- start start 2024-01-20T11:07:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7f557b400640 1 -- 172.21.15.162:0/3650274838 >> v2:172.21.15.179:3300/0 conn(0x7f557c0d37c0 msgr2=0x7f557c0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7f557b400640 1 --2- 172.21.15.162:0/3650274838 >> v2:172.21.15.179:3300/0 conn(0x7f557c0d37c0 0x7f557c0b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7f557b400640 1 -- 172.21.15.162:0/3650274838 >> v1:172.21.15.162:6789/0 conn(0x7f557c0d1100 legacy=0x7f557c0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fbf0c001670 con 0x7fbf1c0b2040 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 >> v1:172.21.15.162:6789/0 conn(0x7fbf1c0b2040 legacy=0x7fbf1c0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbefc003b60 0x7fbefc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc0047c0 0x7fbefc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbefc00fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04001230 con 0x7fbefc0047c0 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c15a000 con 0x7fbefc003b60 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.152+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc010540 con 0x7fbefc0051f0 2024-01-20T11:07:39.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.153+0000 7fbf1b400640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbefc003b60 0x7fbefc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.153+0000 7f557b400640 1 -- 172.21.15.162:0/3650274838 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0b3320 con 0x7f557c0d1f60 2024-01-20T11:07:39.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.153+0000 7f3610c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f36040da030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.153+0000 7f3610c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3604054130 0x7f36040dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.153+0000 7f3610c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36040e30c0 0x7f36040de590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f3610c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36040ddb40 con 0x7f36040e30c0 2024-01-20T11:07:39.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f3610c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36040d63a0 con 0x7f360403e840 2024-01-20T11:07:39.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f3610c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36040d6680 con 0x7f3604054130 2024-01-20T11:07:39.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f360be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36040e30c0 0x7f36040de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f50b4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090005180 0x7f50a804e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.153+0000 7fbf1aa00640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc0047c0 0x7fbefc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.153+0000 7fbf1be00640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbefc00fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f50b4a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50a80deb30 0x7f50a8044470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f50b4a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8033c70 0x7f50a80355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f50b4a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8044050 con 0x7f5090005180 2024-01-20T11:07:39.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f50b4a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a804e790 con 0x7f50a80deb30 2024-01-20T11:07:39.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7f50b4a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80df3b0 con 0x7f50a8033c70 2024-01-20T11:07:39.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.154+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe76c03a050 con 0x7fe7740ebb50 2024-01-20T11:07:39.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f50af400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090005180 0x7f50a804e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f50af400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090005180 0x7f50a804e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41200/0 (socket says 172.21.15.162:41200) 2024-01-20T11:07:39.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f50af400640 1 -- 172.21.15.162:0/1784619498 learned_addr learned my addr 172.21.15.162:0/1784619498 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f360be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36040e30c0 0x7f36040de590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41188/0 (socket says 172.21.15.162:41188) 2024-01-20T11:07:39.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f360b400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f36040da030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7fbf1be00640 1 -- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbefc003b60 msgr2=0x7fbefc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7fbf1be00640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbefc003b60 0x7fbefc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7fbf1be00640 1 -- 172.21.15.162:0/1492927549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc0047c0 msgr2=0x7fbefc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7fbf1be00640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc0047c0 0x7fbefc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7fbf1be00640 1 -- 172.21.15.162:0/1492927549 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0ce8e0 con 0x7fbefc0051f0 2024-01-20T11:07:39.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f50aea00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50a80deb30 0x7f50a8044470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f280cdda0 con 0x7f0f280d1870 2024-01-20T11:07:39.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f50afe00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8033c70 0x7f50a80355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f360b400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f36040da030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42444/0 (socket says 172.21.15.162:42444) 2024-01-20T11:07:39.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f360b400640 1 -- 172.21.15.162:0/4070956672 learned_addr learned my addr 172.21.15.162:0/4070956672 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f360aa00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3604054130 0x7f36040dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.155+0000 7f557b400640 1 --2- 172.21.15.162:0/3650274838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c0aff00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5574009d90 tx=0x7f557402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=154b8a3ecf948ab5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7fe773e00640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe75406afa0 0x7fe75406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f5579600640 1 -- 172.21.15.162:0/3650274838 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557402cc80 con 0x7f557c0d1f60 2024-01-20T11:07:39.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f5579600640 1 -- 172.21.15.162:0/3650274838 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557402cde0 con 0x7f557c0d1f60 2024-01-20T11:07:39.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f5579600640 1 -- 172.21.15.162:0/3650274838 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574034660 con 0x7f557c0d1f60 2024-01-20T11:07:39.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f360b400640 1 -- 172.21.15.162:0/4070956672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3604054130 msgr2=0x7f36040dc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe76c0ab770 con 0x7fe7740ebb50 2024-01-20T11:07:39.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7fe773e00640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7fe7540731c0 0x7fe7540755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 --> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe754075c90 con 0x7fe7540731c0 2024-01-20T11:07:39.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe76c0abb20 con 0x7fe7740ebb50 2024-01-20T11:07:39.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f360b400640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3604054130 0x7f36040dc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f360b400640 1 -- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36040e30c0 msgr2=0x7f36040de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 -- 172.21.15.162:0/3650274838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 msgr2=0x7f557c0aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f360b400640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36040e30c0 0x7f36040de590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.156+0000 7f360b400640 1 -- 172.21.15.162:0/4070956672 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40094d0 con 0x7f360403e840 2024-01-20T11:07:39.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f360b400640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f36040da030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00c400 tx=0x7f35fc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 --2- 172.21.15.162:0/3650274838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c0aff00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5574009d90 tx=0x7f557402bed0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f50aea00640 1 -- 172.21.15.162:0/1784619498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8033c70 msgr2=0x7f50a80355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f50aea00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50a8033c70 0x7f50a80355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f50aea00640 1 -- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090005180 msgr2=0x7f50a804e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f50aea00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5090005180 0x7f50a804e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f50aea00640 1 -- 172.21.15.162:0/1784619498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8043720 con 0x7f50a80deb30 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7fe77be00640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe75406afa0 0x7fe75406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 -- 172.21.15.162:0/3650274838 shutdown_connections 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 --2- 172.21.15.162:0/3650274838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c0aff00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 --2- 172.21.15.162:0/3650274838 >> v2:172.21.15.179:3300/0 conn(0x7f557c0d37c0 0x7f557c0b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 -- 172.21.15.162:0/3650274838 >> 172.21.15.162:0/3650274838 conn(0x7f557c08cc80 msgr2=0x7f557c09c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7fb032000640 1 Processor -- start 2024-01-20T11:07:39.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0074e0 con 0x7f360403e840 2024-01-20T11:07:39.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 -- 172.21.15.162:0/3650274838 shutdown_connections 2024-01-20T11:07:39.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f50aea00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50a80deb30 0x7f50a8044470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f50b0064100 tx=0x7f50b006b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36040ddd90 con 0x7f360403e840 2024-01-20T11:07:39.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.157+0000 7f557be00640 1 -- 172.21.15.162:0/3650274838 wait complete. 2024-01-20T11:07:39.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7fbf1be00640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbefc00fd90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c15a800 tx=0x7fbefc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c59ca9ea4a65ae2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36040d4bd0 con 0x7f360403e840 2024-01-20T11:07:39.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc007640 con 0x7f360403e840 2024-01-20T11:07:39.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1402ce20 con 0x7fbefc0051f0 2024-01-20T11:07:39.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0049e0 con 0x7f360403e840 2024-01-20T11:07:39.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1400a0d0 con 0x7fbefc0051f0 2024-01-20T11:07:39.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7fbf1a000640 1 -- 172.21.15.162:0/1492927549 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1400a460 con 0x7fbefc0051f0 2024-01-20T11:07:39.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7fa489e00640 1 Processor -- start 2024-01-20T11:07:39.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7fa489e00640 1 -- start start 2024-01-20T11:07:39.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b008f070 con 0x7f50a80deb30 2024-01-20T11:07:39.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0094420 con 0x7f50a80deb30 2024-01-20T11:07:39.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0094790 con 0x7f50a80deb30 2024-01-20T11:07:39.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a8043990 con 0x7f50a80deb30 2024-01-20T11:07:39.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7fe77b400640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7fe7540731c0 0x7fe7540755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0f18013470 con 0x7f0f280d1870 2024-01-20T11:07:39.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35dc001030 con 0x7f360403e840 2024-01-20T11:07:39.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7fbf22000640 1 -- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 msgr2=0x7fbefc00fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7fbf22000640 1 --2- 172.21.15.162:0/1492927549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbefc00fd90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c15a800 tx=0x7fbefc0057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7fbf1be00640 1 -- 172.21.15.162:0/1492927549 reap_dead start 2024-01-20T11:07:39.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.158+0000 7fb032000640 1 -- start start 2024-01-20T11:07:39.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7fbf22000640 1 -- 172.21.15.162:0/1492927549 shutdown_connections 2024-01-20T11:07:39.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7fbf22000640 1 -- 172.21.15.162:0/1492927549 >> 172.21.15.162:0/1492927549 conn(0x7fbf1c0cf0d0 msgr2=0x7fbf1c0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.159+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a80340f0 con 0x7f50a80deb30 2024-01-20T11:07:39.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7fa489e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 0x7fa4840d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7fa489e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840cf3b0 con 0x7fa4840cfd10 2024-01-20T11:07:39.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7fa489e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840cedf0 con 0x7fa4841609b0 2024-01-20T11:07:39.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7fa489e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406bdd0 con 0x7fa4840d2050 2024-01-20T11:07:39.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50a8004cf0 con 0x7f50a80deb30 2024-01-20T11:07:39.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7fe77be00640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe75406afa0 0x7fe75406d460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe77c000b60 tx=0x7fe77c073270 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7f0f25600640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0f0006afa0 0x7f0f0006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.160+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f18089670 con 0x7f0f280d1870 2024-01-20T11:07:39.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7fe77b400640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7fe7540731c0 0x7fe7540755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7f0f2ca00640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0f0006afa0 0x7f0f0006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7f557be00640 1 Processor -- start 2024-01-20T11:07:39.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7f557be00640 1 -- start start 2024-01-20T11:07:39.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fbf22000640 1 -- 172.21.15.162:0/1492927549 shutdown_connections 2024-01-20T11:07:39.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7fa482000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa4840cfd10 0x7fa4840d1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33680/0 (socket says 172.21.15.162:33680) 2024-01-20T11:07:39.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7fa482000640 1 -- 172.21.15.162:0/3655449908 learned_addr learned my addr 172.21.15.162:0/3655449908 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158599743 0 0) 0x7fa4840cf3b0 con 0x7fa4840cfd10 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa464003520 con 0x7fa4840cfd10 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.161+0000 7fa483400640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 0x7fa4840d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3143347724 0 0) 0x7fa464003520 con 0x7fa4840cfd10 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 msgr2=0x7fa4840d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 0x7fa4840d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 >> v1:172.21.15.179:6789/0 conn(0x7fa4841609b0 legacy=0x7fa48406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840cf0d0 con 0x7fa4840cfd10 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fa46c001670 con 0x7fa4840cfd10 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 >> v1:172.21.15.162:6789/0 conn(0x7fa4840cfd10 legacy=0x7fa4840d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4640039a0 0x7fa464003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa464004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 0x7fa46400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406bdd0 con 0x7fa4640039a0 2024-01-20T11:07:39.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640054e0 con 0x7fa4640047c0 2024-01-20T11:07:39.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46400bec0 con 0x7fa4840d2050 2024-01-20T11:07:39.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7fb032000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb02c161b80 0x7fb02c071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f557be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f557c0d1100 0x7f557c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f557be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== osd.0 v2:172.21.15.162:6800/4175730261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe754075c90 con 0x7fe7540731c0 2024-01-20T11:07:39.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f557be00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d37c0 0x7f557c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7fb032000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0b3560 con 0x7fb02c165690 2024-01-20T11:07:39.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f557be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c14c560 con 0x7f557c0d1100 2024-01-20T11:07:39.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f557be00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b2190 con 0x7f557c0d37c0 2024-01-20T11:07:39.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f557be00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0c6b00 con 0x7f557c0d1f60 2024-01-20T11:07:39.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7fb032000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c161f60 con 0x7fb02c0cefe0 2024-01-20T11:07:39.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7fb032000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c072830 con 0x7fb02c161b80 2024-01-20T11:07:39.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f0f2ca00640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0f0006afa0 0x7f0f0006d460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f10034000 tx=0x7f0f10008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7fb02b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb02c161b80 0x7fb02c071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7fa483400640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 0x7fa46400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7fa482000640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa464004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7fa482a00640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4640039a0 0x7fa464003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7fb02b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb02c161b80 0x7fb02c071d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41234/0 (socket says 172.21.15.162:41234) 2024-01-20T11:07:39.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7fb02b400640 1 -- 172.21.15.162:0/449245853 learned_addr learned my addr 172.21.15.162:0/449245853 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f557a000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f557a000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34342/0 (socket says 172.21.15.162:34342) 2024-01-20T11:07:39.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f0f25600640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f0f000731c0 0x7f0f000755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 --> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f00075c90 con 0x7f0f000731c0 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f1808bc90 con 0x7f0f280d1870 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.162+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f50b00948f0 con 0x7f50a80deb30 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f50a7400640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f508806afa0 0x7f508806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50b0103a00 con 0x7f50a80deb30 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f50a7400640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f50880731c0 0x7f50880755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 --> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5088075c90 con 0x7f50880731c0 2024-01-20T11:07:39.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b0103db0 con 0x7f50a80deb30 2024-01-20T11:07:39.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.163+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f35fc004b40 con 0x7f360403e840 2024-01-20T11:07:39.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f3603400640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35e406aed0 0x7f35e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35fc0899f0 con 0x7f360403e840 2024-01-20T11:07:39.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f3603400640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7f35e4073070 0x7f35e4075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 --> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35e4075b40 con 0x7f35e4073070 2024-01-20T11:07:39.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35fc089da0 con 0x7f360403e840 2024-01-20T11:07:39.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7fa482000640 1 -- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 msgr2=0x7fa46400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7fa482000640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840d2050 0x7fa46400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7fa482000640 1 -- 172.21.15.162:0/3655449908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4640039a0 msgr2=0x7fa464003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7fbf22000640 1 -- 172.21.15.162:0/1492927549 wait complete. 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f557a000640 1 -- 172.21.15.162:0/3722304041 learned_addr learned my addr 172.21.15.162:0/3722304041 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f557aa00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f557c0d1100 0x7f557c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.164+0000 7f557b400640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d37c0 0x7f557c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7f557a000640 1 -- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d37c0 msgr2=0x7f557c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7f557a000640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d37c0 0x7f557c15bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7f557a000640 1 -- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f557c0d1100 msgr2=0x7f557c14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7f360aa00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35e406aed0 0x7f35e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7f0f2de00640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f0f000731c0 0x7f0f000755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7fa482000640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4640039a0 0x7fa464003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7fa482000640 1 -- 172.21.15.162:0/3655449908 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840cf0d0 con 0x7fa4640047c0 2024-01-20T11:07:39.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7fb02b400640 1 -- 172.21.15.162:0/449245853 >> v1:172.21.15.179:6789/0 conn(0x7fb02c0cefe0 legacy=0x7fb02c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7fa482a00640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4640039a0 0x7fa464003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7f50af400640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f508806afa0 0x7f508806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.166+0000 7f360be00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7f35e4073070 0x7f35e4075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.166+0000 7f50afe00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f50880731c0 0x7f50880755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7fbf22000640 1 Processor -- start 2024-01-20T11:07:39.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f50af400640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f508806afa0 0x7f508806d460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5098001eb0 tx=0x7f5098007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7fb02b400640 1 -- 172.21.15.162:0/449245853 >> v1:172.21.15.162:6789/0 conn(0x7fb02c165690 legacy=0x7fb02c165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.165+0000 7fb02b400640 1 -- 172.21.15.162:0/449245853 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0b3de0 con 0x7fb02c161b80 2024-01-20T11:07:39.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f557a000640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f557c0d1100 0x7f557c14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f557a000640 1 -- 172.21.15.162:0/3722304041 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574009a70 con 0x7f557c0d1f60 2024-01-20T11:07:39.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f557aa00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f557c0d1100 0x7f557c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7fb02b400640 1 --2- 172.21.15.162:0/449245853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c161b80 0x7fb02c071d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097f0 tx=0x7fb01c02b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67350dda7b6e82c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f50afe00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f50880731c0 0x7f50880755e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7fbf22000640 1 -- start start 2024-01-20T11:07:39.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f557a000640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c15b5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c400 tx=0x7f556c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7fb02a000640 1 -- 172.21.15.162:0/449245853 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c030710 con 0x7fb02c161b80 2024-01-20T11:07:39.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f0f2de00640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f0f000731c0 0x7f0f000755e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7fb02a000640 1 -- 172.21.15.162:0/449245853 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c02e050 con 0x7fb02c161b80 2024-01-20T11:07:39.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7fb02a000640 1 -- 172.21.15.162:0/449245853 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c030a90 con 0x7fb02c161b80 2024-01-20T11:07:39.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== osd.2 v2:172.21.15.162:6818/1945956166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5088075c90 con 0x7f50880731c0 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f360be00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7f35e4073070 0x7f35e4075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.167+0000 7f360aa00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35e406aed0 0x7f35e406d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35f4036000 tx=0x7f35f4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== osd.3 v2:172.21.15.162:6807/6791816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f360c096a50 con 0x7f35e4073070 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c0052d0 con 0x7f557c0d1f60 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c005430 con 0x7f557c0d1f60 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c003830 con 0x7f557c0d1f60 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7f557be00640 1 -- 172.21.15.162:0/3722304041 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c0c6de0 con 0x7f557c0d1f60 2024-01-20T11:07:39.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.168+0000 7f557be00640 1 -- 172.21.15.162:0/3722304041 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c0c73a0 con 0x7f557c0d1f60 2024-01-20T11:07:39.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fa482000640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa464004c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00c1b0 tx=0x7fa4640057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c8227857800270 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== osd.1 v2:172.21.15.162:6816/1182855875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0f00075c90 con 0x7f0f000731c0 2024-01-20T11:07:39.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf22000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbf1c1fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf22000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf1c0c3fb0 0x7fbf1c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf22000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf1c14ee00 0x7fbf1c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf22000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c1fc2b0 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf22000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c14e970 con 0x7fbf1c14ee00 2024-01-20T11:07:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf22000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0c4440 con 0x7fbefc0051f0 2024-01-20T11:07:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf1b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbf1c1fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c005ad0 con 0x7fa4640047c0 2024-01-20T11:07:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c005c50 con 0x7fa4640047c0 2024-01-20T11:07:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf1b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbf1c1fbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34348/0 (socket says 172.21.15.162:34348) 2024-01-20T11:07:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fbf1b400640 1 -- 172.21.15.162:0/830537155 learned_addr learned my addr 172.21.15.162:0/830537155 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fb032000640 1 -- 172.21.15.162:0/449245853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c161b80 msgr2=0x7fb02c071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.169+0000 7fb032000640 1 --2- 172.21.15.162:0/449245853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c161b80 0x7fb02c071d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097f0 tx=0x7fb01c02b6d0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.170+0000 7fb032000640 1 -- 172.21.15.162:0/449245853 shutdown_connections 2024-01-20T11:07:39.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.170+0000 7fb032000640 1 --2- 172.21.15.162:0/449245853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c161b80 0x7fb02c071d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.170+0000 7fa481600640 1 -- 172.21.15.162:0/3655449908 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c02c810 con 0x7fa4640047c0 2024-01-20T11:07:39.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.170+0000 7fb032000640 1 -- 172.21.15.162:0/449245853 >> 172.21.15.162:0/449245853 conn(0x7fb02c06a600 msgr2=0x7fb02c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.170+0000 7fbf1be00640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf1c14ee00 0x7fbf1c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.170+0000 7fa489e00640 1 -- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 msgr2=0x7fa464004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.170+0000 7fa489e00640 1 --2- 172.21.15.162:0/3655449908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa464004c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00c1b0 tx=0x7fa4640057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fa483400640 1 -- 172.21.15.162:0/3655449908 reap_dead start 2024-01-20T11:07:39.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fa489e00640 1 -- 172.21.15.162:0/3655449908 shutdown_connections 2024-01-20T11:07:39.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fa489e00640 1 -- 172.21.15.162:0/3655449908 >> 172.21.15.162:0/3655449908 conn(0x7fa48409c7d0 msgr2=0x7fa4840d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fbf1aa00640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf1c0c3fb0 0x7fbf1c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fbf1aa00640 1 -- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 msgr2=0x7fbf1c1fbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fbf1aa00640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbefc0051f0 0x7fbf1c1fbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fbf1aa00640 1 -- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf1c14ee00 msgr2=0x7fbf1c14f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fbf1aa00640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf1c14ee00 0x7fbf1c14f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.171+0000 7fbf1aa00640 1 -- 172.21.15.162:0/830537155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0c4720 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.172+0000 7fbf1aa00640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf1c0c3fb0 0x7fbf1c1550f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0072c0 tx=0x7fbf0c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.172+0000 7f557be00640 1 -- 172.21.15.162:0/3722304041 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f557c0b3bc0 con 0x7f557c0d1f60 2024-01-20T11:07:39.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.172+0000 7fa489e00640 1 -- 172.21.15.162:0/3655449908 shutdown_connections 2024-01-20T11:07:39.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.172+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00f940 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.173+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00faa0 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.173+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00fe30 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.173+0000 7fa489e00640 1 -- 172.21.15.162:0/3655449908 wait complete. 2024-01-20T11:07:39.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.173+0000 7fb032000640 1 -- 172.21.15.162:0/449245853 shutdown_connections 2024-01-20T11:07:39.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.173+0000 7fb032000640 1 -- 172.21.15.162:0/449245853 wait complete. 2024-01-20T11:07:39.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.174+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c0c4a00 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.174+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c14f7f0 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.175+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf1c15a890 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.175+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f556c003990 con 0x7f557c0d1f60 2024-01-20T11:07:39.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.176+0000 7f5572a00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f555406afa0 0x7f555406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.176+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f556c088ba0 con 0x7f557c0d1f60 2024-01-20T11:07:39.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7f5572a00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7f5554073140 0x7f5554075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 --> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5554075c10 con 0x7f5554073140 2024-01-20T11:07:39.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fb032000640 1 Processor -- start 2024-01-20T11:07:39.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f556c001140 con 0x7f557c0d1f60 2024-01-20T11:07:39.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fb032000640 1 -- start start 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7f557b400640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7f5554073140 0x7f5554075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.175+0000 7fa489e00640 1 Processor -- start 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.175+0000 7fa489e00640 1 -- start start 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fa489e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa4840702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fa489e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840707e0 0x7fa48406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fa489e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa48406ebf0 0x7fa48406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fa489e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406fe10 con 0x7fa48406ebf0 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fa489e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406f200 con 0x7fa4640047c0 2024-01-20T11:07:39.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7fa489e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406f4e0 con 0x7fa4840707e0 2024-01-20T11:07:39.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.177+0000 7f557aa00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f555406afa0 0x7f555406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7f557b400640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7f5554073140 0x7f5554075560 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.178+0000 7fa482a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa4840702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fb032000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c0cefe0 0x7fb02c153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fa482000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840707e0 0x7fa48406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.178+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbf0c01d460 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fb032000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c161b80 0x7fb02c0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fb032000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c165690 0x7fb02c1faf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fb032000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1544d0 con 0x7fb02c0cefe0 2024-01-20T11:07:39.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fb032000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1fb7d0 con 0x7fb02c161b80 2024-01-20T11:07:39.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fb032000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1fbab0 con 0x7fb02c165690 2024-01-20T11:07:39.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fbf13400640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbef406afa0 0x7fbef406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fa483400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa48406ebf0 0x7fa48406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fa482a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa4840702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42480/0 (socket says 172.21.15.162:42480) 2024-01-20T11:07:39.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.179+0000 7fa482a00640 1 -- 172.21.15.162:0/3033233508 learned_addr learned my addr 172.21.15.162:0/3033233508 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.180+0000 7fb02b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c0cefe0 0x7fb02c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.180+0000 7fb02b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c0cefe0 0x7fb02c153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41260/0 (socket says 172.21.15.162:41260) 2024-01-20T11:07:39.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.180+0000 7fb02b400640 1 -- 172.21.15.162:0/4224563345 learned_addr learned my addr 172.21.15.162:0/4224563345 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.180+0000 7fb02aa00640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c161b80 0x7fb02c0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.180+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c089f60 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.180+0000 7fb02be00640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c165690 0x7fb02c1faf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.180+0000 7fbf1b400640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbef406afa0 0x7fbef406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fb02b400640 1 -- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c165690 msgr2=0x7fb02c1faf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fbf13400640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fbef40731c0 0x7fbef40755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 --> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbef4075c90 con 0x7fbef40731c0 2024-01-20T11:07:39.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf0c08a310 con 0x7fbf1c0c3fb0 2024-01-20T11:07:39.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fa483400640 1 -- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840707e0 msgr2=0x7fa48406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fa483400640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4840707e0 0x7fa48406e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fb02b400640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c165690 0x7fb02c1faf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fb02b400640 1 -- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c161b80 msgr2=0x7fb02c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fa483400640 1 -- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 msgr2=0x7fa4840702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fa483400640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4640047c0 0x7fa4840702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fb02b400640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c161b80 0x7fb02c0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fb02b400640 1 -- 172.21.15.162:0/4224563345 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0094d0 con 0x7fb02c0cefe0 2024-01-20T11:07:39.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fb02aa00640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c161b80 0x7fb02c0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fa483400640 1 -- 172.21.15.162:0/3033233508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48406f7c0 con 0x7fa48406ebf0 2024-01-20T11:07:39.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.181+0000 7fbf1b400640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbef406afa0 0x7fbef406d460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf040010e0 tx=0x7fbf040077a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fa483400640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa48406ebf0 0x7fa48406bf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa464003970 tx=0x7fa47c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fbf1be00640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fbef40731c0 0x7fbef40755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7f557aa00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f555406afa0 0x7f555406d460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ea0 tx=0x7f5564009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0048a0 con 0x7fa48406ebf0 2024-01-20T11:07:39.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c007ce0 con 0x7fa48406ebf0 2024-01-20T11:07:39.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c015660 con 0x7fa48406ebf0 2024-01-20T11:07:39.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48406faa0 con 0x7fa48406ebf0 2024-01-20T11:07:39.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.183+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== osd.4 v2:172.21.15.179:6806/4012736393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5554075c10 con 0x7f5554073140 2024-01-20T11:07:39.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.184+0000 7fbf1be00640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fbef40731c0 0x7fbef40755e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48406c490 con 0x7fa48406ebf0 2024-01-20T11:07:39.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.184+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4840d1420 con 0x7fa48406ebf0 2024-01-20T11:07:39.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.182+0000 7fb02b400640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c0cefe0 0x7fb02c153810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097f0 tx=0x7fb01c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.185+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c03c940 con 0x7fb02c0cefe0 2024-01-20T11:07:39.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.185+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c03caa0 con 0x7fb02c0cefe0 2024-01-20T11:07:39.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.185+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c03ce50 con 0x7fb02c0cefe0 2024-01-20T11:07:39.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.185+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c1fbd90 con 0x7fb02c0cefe0 2024-01-20T11:07:39.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.185+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c1fb4c0 con 0x7fb02c0cefe0 2024-01-20T11:07:39.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.188+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== osd.5 v2:172.21.15.179:6805/2271063545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbef4075c90 con 0x7fbef40731c0 2024-01-20T11:07:39.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.189+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa47c0157c0 con 0x7fa48406ebf0 2024-01-20T11:07:39.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.190+0000 7fa47b400640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa45c06aed0 0x7fa45c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.190+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa47c08a4b0 con 0x7fa48406ebf0 2024-01-20T11:07:39.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.187+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb02c1fbc20 con 0x7fb02c0cefe0 2024-01-20T11:07:39.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.191+0000 7fa47b400640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7fa45c0730f0 0x7fa45c075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.191+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 --> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa45c075bc0 con 0x7fa45c0730f0 2024-01-20T11:07:39.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.191+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa47c08a860 con 0x7fa48406ebf0 2024-01-20T11:07:39.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.191+0000 7fa482000640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7fa45c0730f0 0x7fa45c075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.191+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb01c039040 con 0x7fb02c0cefe0 2024-01-20T11:07:39.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.193+0000 7fa482000640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7fa45c0730f0 0x7fa45c075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.193+0000 7fb023400640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb00406afa0 0x7fb00406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.193+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01c0ab0d0 con 0x7fb02c0cefe0 2024-01-20T11:07:39.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.193+0000 7fb023400640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7fb004073140 0x7fb004075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.193+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 --> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb004075c10 con 0x7fb004073140 2024-01-20T11:07:39.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.194+0000 7fa482a00640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa45c06aed0 0x7fa45c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.194+0000 7fb02aa00640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb00406afa0 0x7fb00406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.194+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb01c076030 con 0x7fb02c0cefe0 2024-01-20T11:07:39.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.195+0000 7fb02be00640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7fb004073140 0x7fb004075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.196+0000 7fa482a00640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa45c06aed0 0x7fa45c06d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4740019c0 tx=0x7fa474009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.196+0000 7fb02be00640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7fb004073140 0x7fb004075560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.196+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== osd.6 v2:172.21.15.179:6800/1904262509 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa45c075bc0 con 0x7fa45c0730f0 2024-01-20T11:07:39.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.197+0000 7fb02aa00640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb00406afa0 0x7fb00406d460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb02c156400 tx=0x7fb014009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.197+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 --> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50a80449b0 con 0x7f50880731c0 2024-01-20T11:07:39.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.197+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 --> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35dc002d30 con 0x7f35e4073070 2024-01-20T11:07:39.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.198+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 --> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe774057070 con 0x7fe7540731c0 2024-01-20T11:07:39.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.198+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== osd.7 v2:172.21.15.179:6824/3678721212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb004075c10 con 0x7fb004073140 2024-01-20T11:07:39.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.198+0000 7f3603400640 1 -- 172.21.15.162:0/4070956672 <== osd.3 v2:172.21.15.162:6807/6791816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35dc002d30 con 0x7f35e4073070 2024-01-20T11:07:39.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.198+0000 7f50a7400640 1 -- 172.21.15.162:0/1784619498 <== osd.2 v2:172.21.15.162:6818/1945956166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50a0004300 con 0x7f50880731c0 2024-01-20T11:07:39.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7fe773e00640 1 -- 172.21.15.162:0/290200464 <== osd.0 v2:172.21.15.162:6800/4175730261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7640097b0 con 0x7fe7540731c0 2024-01-20T11:07:39.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7f35e4073070 msgr2=0x7f35e4075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f3610c00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7f35e4073070 0x7f35e4075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f50880731c0 msgr2=0x7f50880755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f50b4a00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f50880731c0 0x7f50880755e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7fe7540731c0 msgr2=0x7fe7540755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f508806afa0 msgr2=0x7f508806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f50b4a00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f508806afa0 0x7f508806d460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5098001eb0 tx=0x7f5098007040 comp rx=0 tx=0).stop 2024-01-20T11:07:39.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50a80deb30 msgr2=0x7f50a8044470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f50b4a00640 1 --2- 172.21.15.162:0/1784619498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50a80deb30 0x7f50a8044470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f50b0064100 tx=0x7f50b006b9e0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35e406aed0 msgr2=0x7f35e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f3610c00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35e406aed0 0x7f35e406d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35f4036000 tx=0x7f35f4008030 comp rx=0 tx=0).stop 2024-01-20T11:07:39.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 msgr2=0x7f36040da030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.199+0000 7f3610c00640 1 --2- 172.21.15.162:0/4070956672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f360403e840 0x7f36040da030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00c400 tx=0x7f35fc00c8c0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f360be00640 1 -- 172.21.15.162:0/4070956672 reap_dead start 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 shutdown_connections 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 >> 172.21.15.162:0/4070956672 conn(0x7f36040559e0 msgr2=0x7f3604039990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7fe781c00640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7fe7540731c0 0x7fe7540755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe75406afa0 msgr2=0x7fe75406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7fe781c00640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe75406afa0 0x7fe75406d460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe77c000b60 tx=0x7fe77c073270 comp rx=0 tx=0).stop 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740ebb50 msgr2=0x7fe7740cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7fe781c00640 1 --2- 172.21.15.162:0/290200464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7740ebb50 0x7fe7740cd8b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe76c033000 tx=0x7fe76c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7fe781200640 1 -- 172.21.15.162:0/290200464 reap_dead start 2024-01-20T11:07:39.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.200+0000 7f50afe00640 1 -- 172.21.15.162:0/1784619498 reap_dead start 2024-01-20T11:07:39.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.201+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 shutdown_connections 2024-01-20T11:07:39.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.201+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 >> 172.21.15.162:0/290200464 conn(0x7fe7740559e0 msgr2=0x7fe774006580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.201+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 shutdown_connections 2024-01-20T11:07:39.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.201+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 shutdown_connections 2024-01-20T11:07:39.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.202+0000 7fe781c00640 1 -- 172.21.15.162:0/290200464 wait complete. 2024-01-20T11:07:39.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.201+0000 7f3610c00640 1 -- 172.21.15.162:0/4070956672 wait complete. 2024-01-20T11:07:39.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.204+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 shutdown_connections 2024-01-20T11:07:39.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.204+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 >> 172.21.15.162:0/1784619498 conn(0x7f50a8009fb0 msgr2=0x7f50a8039840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.204+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 --> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f280ce6b0 con 0x7f0f000731c0 2024-01-20T11:07:39.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.206+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 shutdown_connections 2024-01-20T11:07:39.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.206+0000 7f50b4a00640 1 -- 172.21.15.162:0/1784619498 wait complete. 2024-01-20T11:07:39.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.209+0000 7f0f25600640 1 -- 172.21.15.162:0/1523341835 <== osd.1 v2:172.21.15.162:6816/1182855875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f00075c90 con 0x7f0f000731c0 2024-01-20T11:07:39.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.209+0000 7f557be00640 1 -- 172.21.15.162:0/3722304041 --> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f557c0b7080 con 0x7f5554073140 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.209+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f0f000731c0 msgr2=0x7f0f000755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.209+0000 7f0f2e800640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f0f000731c0 0x7f0f000755e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0f0006afa0 msgr2=0x7f0f0006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f0f2e800640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0f0006afa0 0x7f0f0006d460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f10034000 tx=0x7f0f10008030 comp rx=0 tx=0).stop 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d1870 msgr2=0x7f0f2815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f0f2e800640 1 --2- 172.21.15.162:0/1523341835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280d1870 0x7f0f2815c7c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e870 tx=0x7f0f1800ed30 comp rx=0 tx=0).stop 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f0f2de00640 1 -- 172.21.15.162:0/1523341835 reap_dead start 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f5572a00640 1 -- 172.21.15.162:0/3722304041 <== osd.4 v2:172.21.15.179:6806/4012736393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f557c0b7080 con 0x7f5554073140 2024-01-20T11:07:39.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 shutdown_connections 2024-01-20T11:07:39.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 >> 172.21.15.162:0/1523341835 conn(0x7f0f2809c5d0 msgr2=0x7f0f2815f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.210+0000 7f556be00640 1 -- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7f5554073140 msgr2=0x7f5554075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.211+0000 7f556be00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7f5554073140 0x7f5554075560 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f556be00640 1 -- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f555406afa0 msgr2=0x7f555406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f556be00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f555406afa0 0x7f555406d460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ea0 tx=0x7f5564009240 comp rx=0 tx=0).stop 2024-01-20T11:07:39.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f556be00640 1 -- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 msgr2=0x7f557c15b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f556be00640 1 --2- 172.21.15.162:0/3722304041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0d1f60 0x7f557c15b5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c400 tx=0x7f556c00c8c0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 shutdown_connections 2024-01-20T11:07:39.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f557b400640 1 -- 172.21.15.162:0/3722304041 reap_dead start 2024-01-20T11:07:39.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f0f2e800640 1 -- 172.21.15.162:0/1523341835 wait complete. 2024-01-20T11:07:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f556be00640 1 -- 172.21.15.162:0/3722304041 shutdown_connections 2024-01-20T11:07:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f556be00640 1 -- 172.21.15.162:0/3722304041 >> 172.21.15.162:0/3722304041 conn(0x7f557c08cc80 msgr2=0x7f557c158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.213+0000 7f556be00640 1 -- 172.21.15.162:0/3722304041 shutdown_connections 2024-01-20T11:07:39.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.214+0000 7f556be00640 1 -- 172.21.15.162:0/3722304041 wait complete. 2024-01-20T11:07:39.253 INFO:teuthology.orchestra.run.smithi162.stdout:60129542149 2024-01-20T11:07:39.253 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-20T11:07:39.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.223+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 --> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf1c04e970 con 0x7fbef40731c0 2024-01-20T11:07:39.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.224+0000 7fbf13400640 1 -- 172.21.15.162:0/830537155 <== osd.5 v2:172.21.15.179:6805/2271063545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf1c04e970 con 0x7fbef40731c0 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.225+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fbef40731c0 msgr2=0x7fbef40755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.225+0000 7fbf22000640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fbef40731c0 0x7fbef40755e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.226+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbef406afa0 msgr2=0x7fbef406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.226+0000 7fbf22000640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbef406afa0 0x7fbef406d460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf040010e0 tx=0x7fbf040077a0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.226+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf1c0c3fb0 msgr2=0x7fbf1c1550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.226+0000 7fbf22000640 1 --2- 172.21.15.162:0/830537155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf1c0c3fb0 0x7fbf1c1550f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0072c0 tx=0x7fbf0c007780 comp rx=0 tx=0).stop 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.226+0000 7fbf1be00640 1 -- 172.21.15.162:0/830537155 reap_dead start 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.226+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 shutdown_connections 2024-01-20T11:07:39.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.226+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 >> 172.21.15.162:0/830537155 conn(0x7fbf1c0cf0d0 msgr2=0x7fbf1c071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.256 INFO:teuthology.orchestra.run.smithi162.stdout:60129542150 2024-01-20T11:07:39.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.227+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 shutdown_connections 2024-01-20T11:07:39.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-20T11:07:39.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.227+0000 7fbf22000640 1 -- 172.21.15.162:0/830537155 wait complete. 2024-01-20T11:07:39.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.229+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 --> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa48404e970 con 0x7fa45c0730f0 2024-01-20T11:07:39.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.229+0000 7fa47b400640 1 -- 172.21.15.162:0/3033233508 <== osd.6 v2:172.21.15.179:6800/1904262509 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa48404e970 con 0x7fa45c0730f0 2024-01-20T11:07:39.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.230+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7fa45c0730f0 msgr2=0x7fa45c075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.230+0000 7fa489e00640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7fa45c0730f0 0x7fa45c075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.230+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa45c06aed0 msgr2=0x7fa45c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.230+0000 7fa489e00640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa45c06aed0 0x7fa45c06d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4740019c0 tx=0x7fa474009040 comp rx=0 tx=0).stop 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.230+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa48406ebf0 msgr2=0x7fa48406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.230+0000 7fa489e00640 1 --2- 172.21.15.162:0/3033233508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa48406ebf0 0x7fa48406bf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa464003970 tx=0x7fa47c007700 comp rx=0 tx=0).stop 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.230+0000 7fa483400640 1 -- 172.21.15.162:0/3033233508 reap_dead start 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.231+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 shutdown_connections 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.231+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 >> 172.21.15.162:0/3033233508 conn(0x7fa48409c7d0 msgr2=0x7fa4840b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.231+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 shutdown_connections 2024-01-20T11:07:39.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.231+0000 7fa489e00640 1 -- 172.21.15.162:0/3033233508 wait complete. 2024-01-20T11:07:39.260 INFO:teuthology.orchestra.run.smithi162.stdout:60129542149 2024-01-20T11:07:39.260 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-20T11:07:39.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.234+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 --> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb02c15bbd0 con 0x7fb004073140 2024-01-20T11:07:39.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.235+0000 7fb023400640 1 -- 172.21.15.162:0/4224563345 <== osd.7 v2:172.21.15.179:6824/3678721212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb02c15bbd0 con 0x7fb004073140 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7fb004073140 msgr2=0x7fb004075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7fb004073140 0x7fb004075560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb00406afa0 msgr2=0x7fb00406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb00406afa0 0x7fb00406d460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb02c156400 tx=0x7fb014009040 comp rx=0 tx=0).stop 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c0cefe0 msgr2=0x7fb02c153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 --2- 172.21.15.162:0/4224563345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c0cefe0 0x7fb02c153810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097f0 tx=0x7fb01c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb02be00640 1 -- 172.21.15.162:0/4224563345 reap_dead start 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 shutdown_connections 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 >> 172.21.15.162:0/4224563345 conn(0x7fb02c06a600 msgr2=0x7fb02c164330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 shutdown_connections 2024-01-20T11:07:39.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.236+0000 7fb032000640 1 -- 172.21.15.162:0/4224563345 wait complete. 2024-01-20T11:07:39.263 INFO:teuthology.orchestra.run.smithi162.stdout:60129542149 2024-01-20T11:07:39.263 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-20T11:07:39.264 INFO:teuthology.orchestra.run.smithi162.stdout:60129542148 2024-01-20T11:07:39.264 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-20T11:07:39.265 INFO:teuthology.orchestra.run.smithi162.stdout:60129542151 2024-01-20T11:07:39.265 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-20T11:07:39.266 INFO:teuthology.orchestra.run.smithi162.stdout:60129542150 2024-01-20T11:07:39.266 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-20T11:07:39.267 INFO:teuthology.orchestra.run.smithi162.stdout:60129542149 2024-01-20T11:07:39.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-20T11:07:39.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.588+0000 7f15eac00640 1 Processor -- start 2024-01-20T11:07:39.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.589+0000 7f15eac00640 1 -- start start 2024-01-20T11:07:39.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.589+0000 7fc707400640 1 Processor -- start 2024-01-20T11:07:39.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.589+0000 7fc707400640 1 -- start start 2024-01-20T11:07:39.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7fc707400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc70016eb80 0x7fc7000b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7fc707400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7000b43a0 con 0x7fc70016a5c0 2024-01-20T11:07:39.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7fc707400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70016e0a0 con 0x7fc7000ceb30 2024-01-20T11:07:39.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7fc707400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70016e380 con 0x7fc70016eb80 2024-01-20T11:07:39.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7f15eac00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15e40b2040 0x7f15e40cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7f15eac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40ceea0 con 0x7f15e415a420 2024-01-20T11:07:39.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7f15eac00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40ce8e0 con 0x7f15e406c3b0 2024-01-20T11:07:39.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.591+0000 7f15eac00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e415a000 con 0x7f15e40b2040 2024-01-20T11:07:39.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.592+0000 7f15e3400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15e40b2040 0x7f15e40cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.592+0000 7f15e3400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15e40b2040 0x7f15e40cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42496/0 (socket says 172.21.15.162:42496) 2024-01-20T11:07:39.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.592+0000 7f15e3400640 1 -- 172.21.15.162:0/1072016111 learned_addr learned my addr 172.21.15.162:0/1072016111 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.592+0000 7fc6ffe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc70016a5c0 0x7fc7000ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33708/0 (socket says 172.21.15.162:33708) 2024-01-20T11:07:39.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.592+0000 7fc6ffe00640 1 -- 172.21.15.162:0/757515200 learned_addr learned my addr 172.21.15.162:0/757515200 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.592+0000 7fc704a00640 1 --2- 172.21.15.162:0/757515200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc70016eb80 0x7fc7000b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7f15e3400640 1 -- 172.21.15.162:0/1072016111 >> v1:172.21.15.179:6789/0 conn(0x7f15e406c3b0 legacy=0x7f15e406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7f15e3400640 1 -- 172.21.15.162:0/1072016111 >> v1:172.21.15.162:6789/0 conn(0x7f15e415a420 legacy=0x7f15e415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7f15e3400640 1 -- 172.21.15.162:0/1072016111 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40cebc0 con 0x7f15e40b2040 2024-01-20T11:07:39.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7f109fe00640 1 Processor -- start 2024-01-20T11:07:39.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7fc6ff400640 1 -- 172.21.15.162:0/757515200 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611028022 0 0) 0x7fc6f0004900 con 0x7fc70016a5c0 2024-01-20T11:07:39.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7fc6ff400640 1 -- 172.21.15.162:0/757515200 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e0003520 con 0x7fc70016a5c0 2024-01-20T11:07:39.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7fc704a00640 1 -- 172.21.15.162:0/757515200 >> v1:172.21.15.179:6789/0 conn(0x7fc7000ceb30 legacy=0x7fc70006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7fc704a00640 1 -- 172.21.15.162:0/757515200 >> v1:172.21.15.162:6789/0 conn(0x7fc70016a5c0 legacy=0x7fc7000ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.593+0000 7fc704a00640 1 -- 172.21.15.162:0/757515200 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70016e660 con 0x7fc70016eb80 2024-01-20T11:07:39.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.594+0000 7f109fe00640 1 -- start start 2024-01-20T11:07:39.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.594+0000 7f7ef8600640 1 Processor -- start 2024-01-20T11:07:39.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.595+0000 7f7ef8600640 1 -- start start 2024-01-20T11:07:39.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.595+0000 7f15e3400640 1 --2- 172.21.15.162:0/1072016111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e40b2040 0x7f15e40cb230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009730 tx=0x7f15dc02e4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d56306a9db0c5683 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.595+0000 7f15e2a00640 1 -- 172.21.15.162:0/1072016111 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc035600 con 0x7f15e40b2040 2024-01-20T11:07:39.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f109fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f10a00b1730 0x7f10a0156e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f109fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a0071280 con 0x7f10a015a1a0 2024-01-20T11:07:39.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f109fe00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00cb590 con 0x7f10a006d5c0 2024-01-20T11:07:39.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f109fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a01573b0 con 0x7f10a00b1730 2024-01-20T11:07:39.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f15e2a00640 1 -- 172.21.15.162:0/1072016111 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc031050 con 0x7f15e40b2040 2024-01-20T11:07:39.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f15e2a00640 1 -- 172.21.15.162:0/1072016111 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc035980 con 0x7f15e40b2040 2024-01-20T11:07:39.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7fc704a00640 1 --2- 172.21.15.162:0/757515200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc70016eb80 0x7fc7000b3540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80097d0 tx=0x7fc6e802cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=588313ac28f656c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f109e000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f10a015a1a0 0x7f10a015cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33722/0 (socket says 172.21.15.162:33722) 2024-01-20T11:07:39.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7f109e000640 1 -- 172.21.15.162:0/1497726594 learned_addr learned my addr 172.21.15.162:0/1497726594 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.596+0000 7fc6ff400640 1 -- 172.21.15.162:0/757515200 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e802e870 con 0x7fc70016eb80 2024-01-20T11:07:39.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7fc6ff400640 1 -- 172.21.15.162:0/757515200 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e802e9d0 con 0x7fc70016eb80 2024-01-20T11:07:39.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7fc6ff400640 1 -- 172.21.15.162:0/757515200 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e802ed40 con 0x7fc70016eb80 2024-01-20T11:07:39.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f7ef8600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ef015d630 0x7f7ef00cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f7ef8600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ef00b21b0 0x7f7ef00d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f7ef8600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00d1890 0x7f7ef00d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f15eac00640 1 -- 172.21.15.162:0/1072016111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e40b2040 msgr2=0x7f15e40cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f7ef5c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ef015d630 0x7f7ef00cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f109ea00640 1 --2- 172.21.15.162:0/1497726594 >> v2:172.21.15.162:3300/0 conn(0x7f10a00b1730 0x7f10a0156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562466848 0 0) 0x7f10a00cb590 con 0x7f10a006d5c0 2024-01-20T11:07:39.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1080003520 con 0x7f10a006d5c0 2024-01-20T11:07:39.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178796296 0 0) 0x7f10a0071280 con 0x7f10a015a1a0 2024-01-20T11:07:39.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f7ef8600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef00d2260 con 0x7f7ef00b21b0 2024-01-20T11:07:39.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f7ef8600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef00d1350 con 0x7f7ef015d630 2024-01-20T11:07:39.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.597+0000 7f7ef8600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00cde30 con 0x7f7ef00d1890 2024-01-20T11:07:39.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f7ef5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ef00b21b0 0x7f7ef00d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f7ef5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ef00b21b0 0x7f7ef00d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41286/0 (socket says 172.21.15.162:41286) 2024-01-20T11:07:39.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f7ef5200640 1 -- 172.21.15.162:0/3934589375 learned_addr learned my addr 172.21.15.162:0/3934589375 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7fc707400640 1 -- 172.21.15.162:0/757515200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc70016eb80 msgr2=0x7fc7000b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7fc707400640 1 --2- 172.21.15.162:0/757515200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc70016eb80 0x7fc7000b3540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80097d0 tx=0x7fc6e802cab0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a00cb590 con 0x7f10a015a1a0 2024-01-20T11:07:39.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f15eac00640 1 --2- 172.21.15.162:0/1072016111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e40b2040 0x7f15e40cb230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009730 tx=0x7f15dc02e4f0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3110333953 0 0) 0x7f10a00cb590 con 0x7f10a015a1a0 2024-01-20T11:07:39.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7fc707400640 1 -- 172.21.15.162:0/757515200 shutdown_connections 2024-01-20T11:07:39.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7fc707400640 1 --2- 172.21.15.162:0/757515200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc70016eb80 0x7fc7000b3540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7fc707400640 1 -- 172.21.15.162:0/757515200 >> 172.21.15.162:0/757515200 conn(0x7fc7000cf0d0 msgr2=0x7fc7000cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f7ef6600640 1 --2- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00d1890 0x7f7ef00d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f15eac00640 1 -- 172.21.15.162:0/1072016111 shutdown_connections 2024-01-20T11:07:39.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 >> v2:172.21.15.162:3300/0 conn(0x7f10a00b1730 msgr2=0x7f10a0156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 --2- 172.21.15.162:0/1497726594 >> v2:172.21.15.162:3300/0 conn(0x7f10a00b1730 0x7f10a0156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 >> v1:172.21.15.179:6789/0 conn(0x7f10a006d5c0 legacy=0x7f10a015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00714d0 con 0x7f10a015a1a0 2024-01-20T11:07:39.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f1090001670 con 0x7f10a015a1a0 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 >> v1:172.21.15.162:6789/0 conn(0x7f10a015a1a0 legacy=0x7f10a015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080003b00 0x7f1080003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10800047c0 0x7f1080004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800052a0 0x7f108000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a01573b0 con 0x7f10800047c0 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108000c1a0 con 0x7f10800052a0 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.598+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108000c360 con 0x7f1080003b00 2024-01-20T11:07:39.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7fc707400640 1 -- 172.21.15.162:0/757515200 shutdown_connections 2024-01-20T11:07:39.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f15eac00640 1 --2- 172.21.15.162:0/1072016111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e40b2040 0x7f15e40cb230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f15eac00640 1 -- 172.21.15.162:0/1072016111 >> 172.21.15.162:0/1072016111 conn(0x7f15e40cf0d0 msgr2=0x7f15e40cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7fc707400640 1 -- 172.21.15.162:0/757515200 wait complete. 2024-01-20T11:07:39.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f15eac00640 1 -- 172.21.15.162:0/1072016111 shutdown_connections 2024-01-20T11:07:39.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f109e000640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10800047c0 0x7f1080004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f7ef5c00640 1 -- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00d1890 msgr2=0x7f7ef00d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f7ef5c00640 1 --2- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00d1890 0x7f7ef00d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f7ef5c00640 1 -- 172.21.15.162:0/3934589375 >> v2:172.21.15.162:3300/0 conn(0x7f7ef00b21b0 msgr2=0x7f7ef00d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f109f400640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800052a0 0x7f108000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.600+0000 7f109ea00640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080003b00 0x7f1080003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.599+0000 7f15eac00640 1 -- 172.21.15.162:0/1072016111 wait complete. 2024-01-20T11:07:39.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.600+0000 7f7ef5c00640 1 --2- 172.21.15.162:0/3934589375 >> v2:172.21.15.162:3300/0 conn(0x7f7ef00b21b0 0x7f7ef00d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.600+0000 7f7ef5c00640 1 -- 172.21.15.162:0/3934589375 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00ce0d0 con 0x7f7ef015d630 2024-01-20T11:07:39.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.600+0000 7f7ef5200640 1 --2- 172.21.15.162:0/3934589375 >> v2:172.21.15.162:3300/0 conn(0x7f7ef00b21b0 0x7f7ef00d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.602+0000 7f6a61e00640 1 Processor -- start 2024-01-20T11:07:39.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.602+0000 7f15eac00640 1 Processor -- start 2024-01-20T11:07:39.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.602+0000 7f6a61e00640 1 -- start start 2024-01-20T11:07:39.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.602+0000 7f16b1600640 1 Processor -- start 2024-01-20T11:07:39.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.602+0000 7f7ef5c00640 1 --2- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef015d630 0x7f7ef00cee90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ef008ca20 tx=0x7f7ee002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b43dbc8db40319 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f7eefe00640 1 -- 172.21.15.162:0/3934589375 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee002e070 con 0x7f7ef015d630 2024-01-20T11:07:39.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f7eefe00640 1 -- 172.21.15.162:0/3934589375 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee00315a0 con 0x7f7ef015d630 2024-01-20T11:07:39.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f7eefe00640 1 -- 172.21.15.162:0/3934589375 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0031930 con 0x7f7ef015d630 2024-01-20T11:07:39.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.601+0000 7f109e000640 1 -- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080003b00 msgr2=0x7f1080003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.601+0000 7f109e000640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080003b00 0x7f1080003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.601+0000 7f109e000640 1 -- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800052a0 msgr2=0x7f108000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.601+0000 7f109e000640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800052a0 0x7f108000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.601+0000 7f109e000640 1 -- 172.21.15.162:0/1497726594 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00714d0 con 0x7f10800047c0 2024-01-20T11:07:39.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.602+0000 7f109f400640 1 -- 172.21.15.162:0/1497726594 reap_dead start 2024-01-20T11:07:39.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f109e000640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10800047c0 0x7f1080004c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1090001050 tx=0x7f10800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829a982c5c90d23a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7fc707400640 1 Processor -- start 2024-01-20T11:07:39.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f7ef8600640 1 -- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef015d630 msgr2=0x7f7ef00cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f7ef8600640 1 --2- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef015d630 0x7f7ef00cee90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ef008ca20 tx=0x7f7ee002b840 comp rx=0 tx=0).stop 2024-01-20T11:07:39.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f7ef8600640 1 -- 172.21.15.162:0/3934589375 shutdown_connections 2024-01-20T11:07:39.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f7ef8600640 1 --2- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00d1890 0x7f7ef00d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f7ef8600640 1 --2- 172.21.15.162:0/3934589375 >> v2:172.21.15.162:3300/0 conn(0x7f7ef00b21b0 0x7f7ef00d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f7ef8600640 1 --2- 172.21.15.162:0/3934589375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef015d630 0x7f7ef00cee90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f7ef8600640 1 -- 172.21.15.162:0/3934589375 >> 172.21.15.162:0/3934589375 conn(0x7f7ef009c5f0 msgr2=0x7f7ef00d32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f16b1600640 1 -- start start 2024-01-20T11:07:39.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7fc707400640 1 -- start start 2024-01-20T11:07:39.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090030d90 con 0x7f10800047c0 2024-01-20T11:07:39.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f7ef8600640 1 -- 172.21.15.162:0/3934589375 shutdown_connections 2024-01-20T11:07:39.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f6a61e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a5c15d5a0 0x7f6a5c0b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10900058d0 con 0x7f10800047c0 2024-01-20T11:07:39.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.603+0000 7f15eac00640 1 -- start start 2024-01-20T11:07:39.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f15eac00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e406c3b0 0x7f15e414b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f15eac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e40b2040 0x7f15e41e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f15eac00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e415a420 0x7f15e415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f15eac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41f8cd0 con 0x7f15e40b2040 2024-01-20T11:07:39.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f15eac00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41f8f20 con 0x7f15e415a420 2024-01-20T11:07:39.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f15eac00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41f9200 con 0x7f15e406c3b0 2024-01-20T11:07:39.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f109d600640 1 -- 172.21.15.162:0/1497726594 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090005d20 con 0x7f10800047c0 2024-01-20T11:07:39.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f15e3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e40b2040 0x7f15e41e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f15e3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e40b2040 0x7f15e41e6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41304/0 (socket says 172.21.15.162:41304) 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f15e3400640 1 -- 172.21.15.162:0/273916520 learned_addr learned my addr 172.21.15.162:0/273916520 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f15e8c00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e415a420 0x7f15e415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f15e3e00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e406c3b0 0x7f15e414b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f6a61e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0d2250 0x7f6a5c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f6a5aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a5c15d5a0 0x7f6a5c0b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f6a61e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0d2730 con 0x7f6a5c0d0400 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f6a61e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0d2a10 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f6a61e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0d2cf0 con 0x7f6a5c0d2250 2024-01-20T11:07:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f6a5aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a5c15d5a0 0x7f6a5c0b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41316/0 (socket says 172.21.15.162:41316) 2024-01-20T11:07:39.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f6a5aa00640 1 -- 172.21.15.162:0/2693376597 learned_addr learned my addr 172.21.15.162:0/2693376597 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f16b1600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f16a4005e90 0x7f16a40062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f16b1600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a4006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f16b1600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a4054330 con 0x7f16a40ead00 2024-01-20T11:07:39.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f16b1600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a4053720 con 0x7f16a4005e90 2024-01-20T11:07:39.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.605+0000 7f16b1600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4053a00 con 0x7f16a4006810 2024-01-20T11:07:39.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f6a5a000640 1 --2- 172.21.15.162:0/2693376597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0d2250 0x7f6a5c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f16abe00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f16a40ead00 0x7f16a404fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48108/0 (socket says 172.21.15.162:48108) 2024-01-20T11:07:39.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f16abe00640 1 -- 172.21.15.162:0/864541499 learned_addr learned my addr 172.21.15.162:0/864541499 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f16b0c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a4006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f109fe00640 1 -- 172.21.15.162:0/1497726594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10800047c0 msgr2=0x7f1080004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f109fe00640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10800047c0 0x7f1080004c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1090001050 tx=0x7f10800057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f16ab400640 1 --2- 172.21.15.162:0/864541499 >> v2:172.21.15.179:3300/0 conn(0x7f16a4005e90 0x7f16a40062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f15e3400640 1 -- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e406c3b0 msgr2=0x7f15e414b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f15e3400640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e406c3b0 0x7f15e414b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f109fe00640 1 -- 172.21.15.162:0/1497726594 shutdown_connections 2024-01-20T11:07:39.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f109fe00640 1 --2- 172.21.15.162:0/1497726594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10800047c0 0x7f1080004c40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f109fe00640 1 -- 172.21.15.162:0/1497726594 >> 172.21.15.162:0/1497726594 conn(0x7f10a00b0c40 msgr2=0x7f10a00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f15e3400640 1 -- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e415a420 msgr2=0x7f15e415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f15e3400640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e415a420 0x7f15e415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f109fe00640 1 -- 172.21.15.162:0/1497726594 shutdown_connections 2024-01-20T11:07:39.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.606+0000 7f15e3400640 1 -- 172.21.15.162:0/273916520 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc00c3d0 con 0x7f15e40b2040 2024-01-20T11:07:39.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f15e3400640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e40b2040 0x7f15e41e6e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009730 tx=0x7f15dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7fc707400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7000ceb30 0x7fc700161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc707400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc70016a5c0 0x7fc70016b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc707400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc70016eb80 0x7fc7000afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc707400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70016c9a0 con 0x7fc70016eb80 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc707400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70015f540 con 0x7fc70016a5c0 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc707400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70016be20 con 0x7fc7000ceb30 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc704a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7000ceb30 0x7fc700161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc704a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7000ceb30 0x7fc700161590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34448/0 (socket says 172.21.15.162:34448) 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc704a00640 1 -- 172.21.15.162:0/1018761481 learned_addr learned my addr 172.21.15.162:0/1018761481 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc705400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc70016eb80 0x7fc7000afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.608+0000 7fc6ffe00640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc70016a5c0 0x7fc70016b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f109fe00640 1 -- 172.21.15.162:0/1497726594 wait complete. 2024-01-20T11:07:39.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.604+0000 7f7ef8600640 1 -- 172.21.15.162:0/3934589375 wait complete. 2024-01-20T11:07:39.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f7ef8600640 1 Processor -- start 2024-01-20T11:07:39.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f7ef8600640 1 -- start start 2024-01-20T11:07:39.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f6a5aa00640 1 -- 172.21.15.162:0/2693376597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0d2250 msgr2=0x7f6a5c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f6a5aa00640 1 --2- 172.21.15.162:0/2693376597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0d2250 0x7f6a5c0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f6a5aa00640 1 -- 172.21.15.162:0/2693376597 >> v1:172.21.15.179:6789/0 conn(0x7f6a5c0d0400 legacy=0x7f6a5c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f6a5aa00640 1 -- 172.21.15.162:0/2693376597 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0d2fd0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f16ab400640 1 -- 172.21.15.162:0/864541499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 msgr2=0x7f16a4006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f16ab400640 1 --2- 172.21.15.162:0/864541499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a4006ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7fc705400640 1 -- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7000ceb30 msgr2=0x7fc700161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7fc705400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7000ceb30 0x7fc700161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f16ab400640 1 -- 172.21.15.162:0/864541499 >> v1:172.21.15.179:6789/0 conn(0x7f16a40ead00 legacy=0x7f16a404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.607+0000 7f16ab400640 1 -- 172.21.15.162:0/864541499 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a4053ce0 con 0x7f16a4005e90 2024-01-20T11:07:39.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7fc705400640 1 -- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc70016a5c0 msgr2=0x7fc70016b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7fc705400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc70016a5c0 0x7fc70016b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7fc705400640 1 -- 172.21.15.162:0/1018761481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e8009400 con 0x7fc70016eb80 2024-01-20T11:07:39.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7f7ef8600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00b21b0 0x7f7ef01fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7fc704a00640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7000ceb30 0x7fc700161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.609+0000 7f6a5aa00640 1 --2- 172.21.15.162:0/2693376597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c15d5a0 0x7f6a5c0b6650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009870 tx=0x7f6a4c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6debc8e96e2d995 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7fc705400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc70016eb80 0x7fc7000afb10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800be00 tx=0x7fc6f800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef8600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef00d1890 0x7f7ef0202da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef8600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef015d630 0x7f7ef02032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef5c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00b21b0 0x7f7ef01fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef8600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00c97a0 con 0x7f7ef015d630 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef8600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef02009f0 con 0x7f7ef00d1890 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef8600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0200cd0 con 0x7f7ef00b21b0 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef015d630 0x7f7ef02032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef015d630 0x7f7ef02032e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41334/0 (socket says 172.21.15.162:41334) 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef6600640 1 -- 172.21.15.162:0/2866387188 learned_addr learned my addr 172.21.15.162:0/2866387188 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f7ef5200640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef00d1890 0x7f7ef0202da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef6600640 1 -- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00b21b0 msgr2=0x7f7ef01fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef6600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00b21b0 0x7f7ef01fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef6600640 1 -- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef00d1890 msgr2=0x7f7ef0202da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef6600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef00d1890 0x7f7ef0202da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef6600640 1 -- 172.21.15.162:0/2866387188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80094d0 con 0x7f7ef015d630 2024-01-20T11:07:39.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7fc6fcc00640 1 -- 172.21.15.162:0/1018761481 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800ce70 con 0x7fc70016eb80 2024-01-20T11:07:39.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef5200640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef00d1890 0x7f7ef0202da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:39.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef6600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef015d630 0x7f7ef02032e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8007f70 tx=0x7f7ee800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7fc6fcc00640 1 -- 172.21.15.162:0/1018761481 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8003970 con 0x7fc70016eb80 2024-01-20T11:07:39.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7fc6fcc00640 1 -- 172.21.15.162:0/1018761481 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8003d60 con 0x7fc70016eb80 2024-01-20T11:07:39.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7ef5c00640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00b21b0 0x7f7ef01fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:39.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f109fe00640 1 Processor -- start 2024-01-20T11:07:39.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.610+0000 7f109fe00640 1 -- start start 2024-01-20T11:07:39.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f6a59600640 1 -- 172.21.15.162:0/2693376597 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c031640 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f6a59600640 1 -- 172.21.15.162:0/2693376597 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c0317a0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f6a59600640 1 -- 172.21.15.162:0/2693376597 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c031b30 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70016c100 con 0x7fc70016eb80 2024-01-20T11:07:39.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7eed600640 1 -- 172.21.15.162:0/2866387188 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee801b580 con 0x7f7ef015d630 2024-01-20T11:07:39.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7eed600640 1 -- 172.21.15.162:0/2866387188 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8017070 con 0x7f7ef015d630 2024-01-20T11:07:39.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f7eed600640 1 -- 172.21.15.162:0/2866387188 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee801b920 con 0x7f7ef015d630 2024-01-20T11:07:39.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70016c6c0 con 0x7fc70016eb80 2024-01-20T11:07:39.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee0009400 con 0x7f7ef015d630 2024-01-20T11:07:39.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef0201290 con 0x7f7ef015d630 2024-01-20T11:07:39.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7f6a61e00640 1 -- 172.21.15.162:0/2693376597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c15d5a0 msgr2=0x7f6a5c0b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7f6a61e00640 1 --2- 172.21.15.162:0/2693376597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c15d5a0 0x7f6a5c0b6650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009870 tx=0x7f6a4c02b8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f3783c00640 1 Processor -- start 2024-01-20T11:07:39.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f15dbe00640 1 -- 172.21.15.162:0/273916520 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc009510 con 0x7f15e40b2040 2024-01-20T11:07:39.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f15dbe00640 1 -- 172.21.15.162:0/273916520 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc040470 con 0x7f15e40b2040 2024-01-20T11:07:39.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f15dbe00640 1 -- 172.21.15.162:0/273916520 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc040820 con 0x7f15e40b2040 2024-01-20T11:07:39.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f222fe00640 1 Processor -- start 2024-01-20T11:07:39.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f222fe00640 1 -- start start 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e41f94e0 con 0x7f15e40b2040 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e41f9aa0 con 0x7f15e40b2040 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f109fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0158fe0 0x7f10a0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f109fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10a01593c0 0x7f10a0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.611+0000 7f109fe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00cbba0 0x7f10a01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7f109fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0154790 con 0x7f10a01593c0 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7f109fe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0154a30 con 0x7f10a0158fe0 2024-01-20T11:07:39.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.612+0000 7f109fe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0154d10 con 0x7f10a00cbba0 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f109ea00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0158fe0 0x7f10a0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f6a61e00640 1 -- 172.21.15.162:0/2693376597 shutdown_connections 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f6a61e00640 1 --2- 172.21.15.162:0/2693376597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0d2250 0x7f6a5c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f6a61e00640 1 --2- 172.21.15.162:0/2693376597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c15d5a0 0x7f6a5c0b6650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f6a61e00640 1 -- 172.21.15.162:0/2693376597 >> 172.21.15.162:0/2693376597 conn(0x7f6a5c066760 msgr2=0x7f6a5c066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f109ea00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0158fe0 0x7f10a0155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42566/0 (socket says 172.21.15.162:42566) 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f109ea00640 1 -- 172.21.15.162:0/3905377497 learned_addr learned my addr 172.21.15.162:0/3905377497 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f109e000640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10a01593c0 0x7f10a0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.613+0000 7f109f400640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00cbba0 0x7f10a01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f222fe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280cfde0 0x7f22280d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f222fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f22280ced20 0x7f22280cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f222fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22280d0780 con 0x7f22280b25e0 2024-01-20T11:07:39.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f222fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222806bdd0 con 0x7f22280ced20 2024-01-20T11:07:39.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f222fe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280cdfe0 con 0x7f22280cfde0 2024-01-20T11:07:39.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.615+0000 7f7eed600640 1 -- 172.21.15.162:0/2866387188 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7ee801ba80 con 0x7f7ef015d630 2024-01-20T11:07:39.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.615+0000 7f222d400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f22280b25e0 0x7f222806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33736/0 (socket says 172.21.15.162:33736) 2024-01-20T11:07:39.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.615+0000 7f222d400640 1 -- 172.21.15.162:0/3312394174 learned_addr learned my addr 172.21.15.162:0/3312394174 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:39.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7fc6fcc00640 1 -- 172.21.15.162:0/1018761481 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc6f8003ec0 con 0x7fc70016eb80 2024-01-20T11:07:39.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.615+0000 7fc6fcc00640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc6d806aed0 0x7fc6d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.615+0000 7fc6fcc00640 1 -- 172.21.15.162:0/1018761481 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6f80896b0 con 0x7fc70016eb80 2024-01-20T11:07:39.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f7eed600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7ec806af20 0x7f7ec806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7fc704a00640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc6d806aed0 0x7fc6d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f7eed600640 1 -- 172.21.15.162:0/2866387188 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ee8089c30 con 0x7f7ef015d630 2024-01-20T11:07:39.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f109ea00640 1 -- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00cbba0 msgr2=0x7f10a01511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f109ea00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00cbba0 0x7f10a01511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f109ea00640 1 -- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10a01593c0 msgr2=0x7f10a0150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f7ef5c00640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7ec806af20 0x7f7ec806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f109ea00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10a01593c0 0x7f10a0150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f109ea00640 1 -- 172.21.15.162:0/3905377497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0154ff0 con 0x7f10a0158fe0 2024-01-20T11:07:39.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f109e000640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10a01593c0 0x7f10a0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.617+0000 7fc704a00640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc6d806aed0 0x7fc6d806d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80091d0 tx=0x7fc6e803a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.614+0000 7f3783c00640 1 -- start start 2024-01-20T11:07:39.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.617+0000 7f6a61e00640 1 -- 172.21.15.162:0/2693376597 shutdown_connections 2024-01-20T11:07:39.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.617+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e41f9cc0 con 0x7f15e40b2040 2024-01-20T11:07:39.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3783c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f377c159b50 0x7f377c0ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3783c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cf960 0x7f377c0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3783c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f377c0cbf50 0x7f377c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.617+0000 7f7ef5c00640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7ec806af20 0x7f7ec806d3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0036000 tx=0x7f7ee003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3783c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0cc3e0 con 0x7f377c159b50 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3783c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c15e000 con 0x7f377c0cbf50 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3783c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0b41e0 con 0x7f377c0cf960 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f377c159b50 0x7f377c0ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f377c159b50 0x7f377c0ce960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41344/0 (socket says 172.21.15.162:41344) 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 -- 172.21.15.162:0/2841462239 learned_addr learned my addr 172.21.15.162:0/2841462239 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 -- 172.21.15.162:0/2841462239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cf960 msgr2=0x7f377c0cba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 --2- 172.21.15.162:0/2841462239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cf960 0x7f377c0cba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 -- 172.21.15.162:0/2841462239 >> v2:172.21.15.179:3300/0 conn(0x7f377c0cbf50 msgr2=0x7f377c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 --2- 172.21.15.162:0/2841462239 >> v2:172.21.15.179:3300/0 conn(0x7f377c0cbf50 0x7f377c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.616+0000 7f3781200640 1 -- 172.21.15.162:0/2841462239 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c159f30 con 0x7f377c159b50 2024-01-20T11:07:39.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f3781200640 1 --2- 172.21.15.162:0/2841462239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c0ce960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b44c0 tx=0x7f376c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc8b4a14675aa05 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f222ca00640 1 --2- 172.21.15.162:0/3312394174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280cfde0 0x7f22280d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.617+0000 7f6a61e00640 1 -- 172.21.15.162:0/2693376597 wait complete. 2024-01-20T11:07:39.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f222de00640 1 --2- 172.21.15.162:0/3312394174 >> v2:172.21.15.162:3300/0 conn(0x7f22280ced20 0x7f22280cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70015f740 con 0x7fc70016eb80 2024-01-20T11:07:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f377b400640 1 -- 172.21.15.162:0/2841462239 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c030800 con 0x7f377c159b50 2024-01-20T11:07:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f2227e00640 1 -- 172.21.15.162:0/3312394174 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628751073 0 0) 0x7f22280d0780 con 0x7f22280b25e0 2024-01-20T11:07:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f2227e00640 1 -- 172.21.15.162:0/3312394174 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2208003520 con 0x7f22280b25e0 2024-01-20T11:07:39.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f16ab400640 1 --2- 172.21.15.162:0/864541499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a4005e90 0x7f16a40062d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16940097a0 tx=0x7f169402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbfdcdc837ade37b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f377b400640 1 -- 172.21.15.162:0/2841462239 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c030960 con 0x7f377c159b50 2024-01-20T11:07:39.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f222ca00640 1 -- 172.21.15.162:0/3312394174 >> v2:172.21.15.162:3300/0 conn(0x7f22280ced20 msgr2=0x7f22280cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:39.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f222ca00640 1 --2- 172.21.15.162:0/3312394174 >> v2:172.21.15.162:3300/0 conn(0x7f22280ced20 0x7f22280cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f222ca00640 1 -- 172.21.15.162:0/3312394174 >> v1:172.21.15.162:6789/0 conn(0x7f22280b25e0 legacy=0x7f222806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f222ca00640 1 -- 172.21.15.162:0/3312394174 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280ce280 con 0x7f22280cfde0 2024-01-20T11:07:39.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef02014b0 con 0x7f7ef015d630 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.618+0000 7f109ea00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0158fe0 0x7f10a0155f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f108800f760 tx=0x7f108800fb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.619+0000 7f1096a00640 1 -- 172.21.15.162:0/3905377497 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800d9a0 con 0x7f10a0158fe0 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.619+0000 7f1096a00640 1 -- 172.21.15.162:0/3905377497 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800c040 con 0x7f10a0158fe0 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.619+0000 7f1096a00640 1 -- 172.21.15.162:0/3905377497 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800dd40 con 0x7f10a0158fe0 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.619+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a01552d0 con 0x7f10a0158fe0 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.619+0000 7f3783c00640 1 -- 172.21.15.162:0/2841462239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 msgr2=0x7f377c0ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.619+0000 7f3783c00640 1 --2- 172.21.15.162:0/2841462239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c0ce960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b44c0 tx=0x7f376c02b940 comp rx=0 tx=0).stop 2024-01-20T11:07:39.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.619+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a01564d0 con 0x7f10a0158fe0 2024-01-20T11:07:39.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f3783c00640 1 -- 172.21.15.162:0/2841462239 shutdown_connections 2024-01-20T11:07:39.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f3783c00640 1 --2- 172.21.15.162:0/2841462239 >> v2:172.21.15.179:3300/0 conn(0x7f377c0cbf50 0x7f377c0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f6a61e00640 1 Processor -- start 2024-01-20T11:07:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f3783c00640 1 --2- 172.21.15.162:0/2841462239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cf960 0x7f377c0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f3783c00640 1 --2- 172.21.15.162:0/2841462239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c0ce960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f3783c00640 1 -- 172.21.15.162:0/2841462239 >> 172.21.15.162:0/2841462239 conn(0x7f377c06a600 msgr2=0x7f377c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f3783c00640 1 -- 172.21.15.162:0/2841462239 shutdown_connections 2024-01-20T11:07:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.620+0000 7f3783c00640 1 -- 172.21.15.162:0/2841462239 wait complete. 2024-01-20T11:07:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.621+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0074a30 con 0x7f10a0158fe0 2024-01-20T11:07:39.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.621+0000 7f6a61e00640 1 -- start start 2024-01-20T11:07:39.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.621+0000 7f222ca00640 1 --2- 172.21.15.162:0/3312394174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280cfde0 0x7f22280d0240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22100097a0 tx=0x7f221002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77984ee90269cd45 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f2227e00640 1 -- 172.21.15.162:0/3312394174 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210031830 con 0x7f22280cfde0 2024-01-20T11:07:39.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f6a61e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0d0400 0x7f6a5c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f2227e00640 1 -- 172.21.15.162:0/3312394174 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210031990 con 0x7f22280cfde0 2024-01-20T11:07:39.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f2227e00640 1 -- 172.21.15.162:0/3312394174 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210031d60 con 0x7f22280cfde0 2024-01-20T11:07:39.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f6a61e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c0d2250 0x7f6a5c1f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f3783c00640 1 Processor -- start 2024-01-20T11:07:39.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f6a61e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c15d5a0 0x7f6a5c1fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f6a61e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1f9330 con 0x7f6a5c0d2250 2024-01-20T11:07:39.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.623+0000 7f3783c00640 1 -- start start 2024-01-20T11:07:39.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f6a61e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1f8960 con 0x7f6a5c0d0400 2024-01-20T11:07:39.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.622+0000 7f6a61e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1fc7f0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.623+0000 7f6a5b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c15d5a0 0x7f6a5c1fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.623+0000 7f6a5b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c15d5a0 0x7f6a5c1fc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34490/0 (socket says 172.21.15.162:34490) 2024-01-20T11:07:39.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.623+0000 7f6a5b400640 1 -- 172.21.15.162:0/1334176670 learned_addr learned my addr 172.21.15.162:0/1334176670 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.623+0000 7f6a5aa00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0d0400 0x7f6a5c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.623+0000 7f222fe00640 1 -- 172.21.15.162:0/3312394174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280cfde0 msgr2=0x7f22280d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.623+0000 7f222fe00640 1 --2- 172.21.15.162:0/3312394174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280cfde0 0x7f22280d0240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22100097a0 tx=0x7f221002b8d0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f6a5b400640 1 -- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0d0400 msgr2=0x7f6a5c157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f6a5b400640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0d0400 0x7f6a5c157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f6a5b400640 1 -- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c0d2250 msgr2=0x7f6a5c1f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f6a5b400640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c0d2250 0x7f6a5c1f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f6a5b400640 1 -- 172.21.15.162:0/1334176670 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0094d0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f15dbe00640 1 -- 172.21.15.162:0/273916520 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f15dc03c070 con 0x7f15e40b2040 2024-01-20T11:07:39.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f3783c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cbf50 0x7f377c146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f3783c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f377c0cf960 0x7f377c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f16aaa00640 1 -- 172.21.15.162:0/864541499 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694031640 con 0x7f16a4005e90 2024-01-20T11:07:39.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f6a5b400640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c15d5a0 0x7f6a5c1fc2b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c410 tx=0x7f6a4400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f3783c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f3783c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c15b050 con 0x7f377c159b50 2024-01-20T11:07:39.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f3783c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c1472d0 con 0x7f377c0cf960 2024-01-20T11:07:39.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f3783c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c1507b0 con 0x7f377c0cbf50 2024-01-20T11:07:39.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f222fe00640 1 -- 172.21.15.162:0/3312394174 shutdown_connections 2024-01-20T11:07:39.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f222fe00640 1 --2- 172.21.15.162:0/3312394174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280cfde0 0x7f22280d0240 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f222fe00640 1 --2- 172.21.15.162:0/3312394174 >> v2:172.21.15.162:3300/0 conn(0x7f22280ced20 0x7f22280cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.624+0000 7f222fe00640 1 -- 172.21.15.162:0/3312394174 >> 172.21.15.162:0/3312394174 conn(0x7f222809c7d0 msgr2=0x7f22280d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f3781200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cbf50 0x7f377c146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f6a53400640 1 -- 172.21.15.162:0/1334176670 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44005230 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f6a53400640 1 -- 172.21.15.162:0/1334176670 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44005390 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f6a53400640 1 -- 172.21.15.162:0/1334176670 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44011870 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f222fe00640 1 -- 172.21.15.162:0/3312394174 shutdown_connections 2024-01-20T11:07:39.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f377be00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f377c0cf960 0x7f377c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f377be00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f377c0cf960 0x7f377c15b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42592/0 (socket says 172.21.15.162:42592) 2024-01-20T11:07:39.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f377be00640 1 -- 172.21.15.162:0/56137379 learned_addr learned my addr 172.21.15.162:0/56137379 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f16aaa00640 1 -- 172.21.15.162:0/864541499 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940317a0 con 0x7f16a4005e90 2024-01-20T11:07:39.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c071460 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f16aaa00640 1 -- 172.21.15.162:0/864541499 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694031b70 con 0x7f16a4005e90 2024-01-20T11:07:39.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f3781c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f1096a00640 1 -- 172.21.15.162:0/3905377497 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1088005990 con 0x7f10a0158fe0 2024-01-20T11:07:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f377be00640 1 -- 172.21.15.162:0/56137379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cbf50 msgr2=0x7f377c146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f377be00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cbf50 0x7f377c146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f377be00640 1 -- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 msgr2=0x7f377c15c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c1f85f0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f377be00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c15c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f377be00640 1 -- 172.21.15.162:0/56137379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0094d0 con 0x7f377c0cf960 2024-01-20T11:07:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f3781c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c15c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f15dbe00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f15bc06af20 0x7f15bc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f15dbe00640 1 -- 172.21.15.162:0/273916520 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15dc0ac7e0 con 0x7f15e40b2040 2024-01-20T11:07:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f15e3e00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f15bc06af20 0x7f15bc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.625+0000 7f222fe00640 1 -- 172.21.15.162:0/3312394174 wait complete. 2024-01-20T11:07:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.626+0000 7f1096a00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f107806af00 0x7f107806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 -- 172.21.15.162:0/864541499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a4005e90 msgr2=0x7f16a40062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 --2- 172.21.15.162:0/864541499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a4005e90 0x7f16a40062d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16940097a0 tx=0x7f169402b8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 -- 172.21.15.162:0/864541499 shutdown_connections 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 --2- 172.21.15.162:0/864541499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a4006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 --2- 172.21.15.162:0/864541499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a4005e90 0x7f16a40062d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 -- 172.21.15.162:0/864541499 >> 172.21.15.162:0/864541499 conn(0x7f16a4009fb0 msgr2=0x7f16a400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 -- 172.21.15.162:0/864541499 shutdown_connections 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f15e3e00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f15bc06af20 0x7f15bc06d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000f60 tx=0x7f15cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7fc6fcc00640 1 -- 172.21.15.162:0/1018761481 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc70015f740 con 0x7fc70016eb80 2024-01-20T11:07:39.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f1096a00640 1 -- 172.21.15.162:0/3905377497 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1088089fe0 con 0x7f10a0158fe0 2024-01-20T11:07:39.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.628+0000 7f109e000640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f107806af00 0x7f107806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.627+0000 7f16b1600640 1 -- 172.21.15.162:0/864541499 wait complete. 2024-01-20T11:07:39.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.628+0000 7f222fe00640 1 Processor -- start 2024-01-20T11:07:39.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.628+0000 7f222fe00640 1 -- start start 2024-01-20T11:07:39.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.628+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c1f8af0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f109e000640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f107806af00 0x7f107806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1090038000 tx=0x7f1090009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f377be00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f377c0cf960 0x7f377c15b4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f376400b450 tx=0x7f376400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f222fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280b25e0 0x7f22281606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f222fe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280ced20 0x7f22280c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f222fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22280cfde0 0x7f22280c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f222fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22280c6f50 con 0x7f22280b25e0 2024-01-20T11:07:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f222fe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228160c30 con 0x7f22280cfde0 2024-01-20T11:07:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f222fe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280c7160 con 0x7f22280ced20 2024-01-20T11:07:39.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f6a53400640 1 -- 172.21.15.162:0/1334176670 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6a440119d0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.629+0000 7f222d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280b25e0 0x7f22281606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.630+0000 7f222d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280b25e0 0x7f22281606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41370/0 (socket says 172.21.15.162:41370) 2024-01-20T11:07:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.630+0000 7f222d400640 1 -- 172.21.15.162:0/2227753100 learned_addr learned my addr 172.21.15.162:0/2227753100 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.630+0000 7f6a53400640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6a3406aed0 0x7f6a3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.630+0000 7f222de00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22280cfde0 0x7f22280c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.630+0000 7f6a53400640 1 -- 172.21.15.162:0/1334176670 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a44088a30 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f16b1600640 1 Processor -- start 2024-01-20T11:07:39.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f222d400640 1 -- 172.21.15.162:0/2227753100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280ced20 msgr2=0x7f22280c8d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-20T11:07:39.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f222d400640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280ced20 0x7f22280c8d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f222d400640 1 -- 172.21.15.162:0/2227753100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22280cfde0 msgr2=0x7f22280c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f222d400640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22280cfde0 0x7f22280c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f222d400640 1 -- 172.21.15.162:0/2227753100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210009400 con 0x7f22280b25e0 2024-01-20T11:07:39.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f16b1600640 1 -- start start 2024-01-20T11:07:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.631+0000 7f222d400640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280b25e0 0x7f22281606f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f222000cb40 tx=0x7f222000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.632+0000 7f6a5aa00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6a3406aed0 0x7f6a3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16b1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16a4005e90 0x7f16a40dc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f6a5aa00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6a3406aed0 0x7f6a3406d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c036000 tx=0x7f6a4c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16b1600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a40dc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16abe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16a4005e90 0x7f16a40dc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16b1600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a40ead00 0x7f16a4045150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16b1600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a404e390 con 0x7f16a4005e90 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16b1600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4044b90 con 0x7f16a40ead00 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16b1600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a404ddd0 con 0x7f16a4006810 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16abe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16a4005e90 0x7f16a40dc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41376/0 (socket says 172.21.15.162:41376) 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16abe00640 1 -- 172.21.15.162:0/2844121949 learned_addr learned my addr 172.21.15.162:0/2844121949 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.633+0000 7f16ab400640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a40dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.634+0000 7f16abe00640 1 -- 172.21.15.162:0/2844121949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 msgr2=0x7f16a40dc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:39.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.634+0000 7f16abe00640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a40dc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.634+0000 7f16abe00640 1 -- 172.21.15.162:0/2844121949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a40ead00 msgr2=0x7f16a4045150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-20T11:07:39.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.634+0000 7f16abe00640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a40ead00 0x7f16a4045150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:39.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.634+0000 7f16abe00640 1 -- 172.21.15.162:0/2844121949 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009400 con 0x7f16a4005e90 2024-01-20T11:07:39.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.634+0000 7f16abe00640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16a4005e90 0x7f16a40dc160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c4a0 tx=0x7f169c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.635+0000 7f7eed600640 1 -- 172.21.15.162:0/2866387188 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7ee8021080 con 0x7f7ef015d630 2024-01-20T11:07:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.639+0000 7f3778c00640 1 -- 172.21.15.162:0/56137379 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764011890 con 0x7f377c0cf960 2024-01-20T11:07:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.639+0000 7f3778c00640 1 -- 172.21.15.162:0/56137379 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764011a10 con 0x7f377c0cf960 2024-01-20T11:07:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.639+0000 7f3778c00640 1 -- 172.21.15.162:0/56137379 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764011dc0 con 0x7f377c0cf960 2024-01-20T11:07:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.639+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c150a90 con 0x7f377c0cf960 2024-01-20T11:07:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.639+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c15ba20 con 0x7f377c0cf960 2024-01-20T11:07:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.640+0000 7f1096a00640 1 -- 172.21.15.162:0/3905377497 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1088054ed0 con 0x7f10a0158fe0 2024-01-20T11:07:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.641+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c150cd0 con 0x7f377c0cf960 2024-01-20T11:07:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.642+0000 7f3778c00640 1 -- 172.21.15.162:0/56137379 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f376401a400 con 0x7f377c0cf960 2024-01-20T11:07:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f16a3e00640 1 -- 172.21.15.162:0/2844121949 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c005ce0 con 0x7f16a4005e90 2024-01-20T11:07:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f16a3e00640 1 -- 172.21.15.162:0/2844121949 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c005e40 con 0x7f16a4005e90 2024-01-20T11:07:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f16a3e00640 1 -- 172.21.15.162:0/2844121949 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c007270 con 0x7f16a4005e90 2024-01-20T11:07:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.642+0000 7f2225600640 1 -- 172.21.15.162:0/2227753100 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000aca0 con 0x7f22280b25e0 2024-01-20T11:07:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.642+0000 7f2225600640 1 -- 172.21.15.162:0/2227753100 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222000ae00 con 0x7f22280b25e0 2024-01-20T11:07:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.642+0000 7f2225600640 1 -- 172.21.15.162:0/2227753100 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220012600 con 0x7f22280b25e0 2024-01-20T11:07:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22280c7440 con 0x7f22280b25e0 2024-01-20T11:07:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22280c7a00 con 0x7f22280b25e0 2024-01-20T11:07:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f3778c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f375406af20 0x7f375406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.644+0000 7f3778c00640 1 -- 172.21.15.162:0/56137379 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3764089d70 con 0x7f377c0cf960 2024-01-20T11:07:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a404e0b0 con 0x7f16a4005e90 2024-01-20T11:07:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.643+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a40dce40 con 0x7f16a4005e90 2024-01-20T11:07:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.644+0000 7f15dbe00640 1 -- 172.21.15.162:0/273916520 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f15dc0777c0 con 0x7f15e40b2040 2024-01-20T11:07:39.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.645+0000 7f3781200640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f375406af20 0x7f375406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.644+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222804e970 con 0x7f22280b25e0 2024-01-20T11:07:39.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.646+0000 7f2225600640 1 -- 172.21.15.162:0/2227753100 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2220007070 con 0x7f22280b25e0 2024-01-20T11:07:39.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.646+0000 7f3781200640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f375406af20 0x7f375406d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f376c036000 tx=0x7f376c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.647+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c005290 con 0x7f16a4005e90 2024-01-20T11:07:39.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.647+0000 7f2225600640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f220006af50 0x7f220006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.647+0000 7f2225600640 1 -- 172.21.15.162:0/2227753100 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22200895e0 con 0x7f22280b25e0 2024-01-20T11:07:39.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.648+0000 7f6a53400640 1 -- 172.21.15.162:0/1334176670 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6a440539a0 con 0x7f6a5c15d5a0 2024-01-20T11:07:39.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.648+0000 7f222ca00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f220006af50 0x7f220006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.649+0000 7f16a3e00640 1 -- 172.21.15.162:0/2844121949 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f169c007490 con 0x7f16a4005e90 2024-01-20T11:07:39.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.650+0000 7f222ca00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f220006af50 0x7f220006d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.651+0000 7f16a3e00640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f168406af20 0x7f168406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:39.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.651+0000 7f16a3e00640 1 -- 172.21.15.162:0/2844121949 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f169c088a30 con 0x7f16a4005e90 2024-01-20T11:07:39.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.651+0000 7f16ab400640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f168406af20 0x7f168406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:39.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.653+0000 7f16ab400640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f168406af20 0x7f168406d3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1694036000 tx=0x7f169403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:39.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.654+0000 7f2225600640 1 -- 172.21.15.162:0/2227753100 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2220054590 con 0x7f22280b25e0 2024-01-20T11:07:39.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.659+0000 7f3778c00640 1 -- 172.21.15.162:0/56137379 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3764054cd0 con 0x7f377c0cf960 2024-01-20T11:07:39.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:39.663+0000 7f16a3e00640 1 -- 172.21.15.162:0/2844121949 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f169c053a90 con 0x7f16a4005e90 2024-01-20T11:07:40.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.045+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc70015f740 con 0x7fc70016eb80 2024-01-20T11:07:40.047 INFO:teuthology.orchestra.run.smithi162.stdout:60129542149 2024-01-20T11:07:40.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.046+0000 7fc6fcc00640 1 -- 172.21.15.162:0/1018761481 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc70015f740 con 0x7fc70016eb80 2024-01-20T11:07:40.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.049+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc6d806aed0 msgr2=0x7fc6d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.049+0000 7fc707400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc6d806aed0 0x7fc6d806d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80091d0 tx=0x7fc6e803a040 comp rx=0 tx=0).stop 2024-01-20T11:07:40.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.049+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc70016eb80 msgr2=0x7fc7000afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.049+0000 7fc707400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc70016eb80 0x7fc7000afb10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800be00 tx=0x7fc6f800bef0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 shutdown_connections 2024-01-20T11:07:40.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc70016eb80 0x7fc7000afb10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc6d806aed0 0x7fc6d806d390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc70016a5c0 0x7fc70016b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 --2- 172.21.15.162:0/1018761481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7000ceb30 0x7fc700161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 >> 172.21.15.162:0/1018761481 conn(0x7fc7000cf0d0 msgr2=0x7fc70006ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 shutdown_connections 2024-01-20T11:07:40.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.051+0000 7fc707400640 1 -- 172.21.15.162:0/1018761481 wait complete. 2024-01-20T11:07:40.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.052+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7ef0074a30 con 0x7f7ef015d630 2024-01-20T11:07:40.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.053+0000 7f7eed600640 1 -- 172.21.15.162:0/2866387188 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ee8054b70 con 0x7f7ef015d630 2024-01-20T11:07:40.055 INFO:teuthology.orchestra.run.smithi162.stdout:60129542148 2024-01-20T11:07:40.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.057+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7ec806af20 msgr2=0x7f7ec806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.057+0000 7f7ef8600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7ec806af20 0x7f7ec806d3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0036000 tx=0x7f7ee003d040 comp rx=0 tx=0).stop 2024-01-20T11:07:40.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.057+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef015d630 msgr2=0x7f7ef02032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.057+0000 7f7ef8600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef015d630 0x7f7ef02032e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8007f70 tx=0x7f7ee800d560 comp rx=0 tx=0).stop 2024-01-20T11:07:40.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.058+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 shutdown_connections 2024-01-20T11:07:40.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.058+0000 7f7ef8600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ef015d630 0x7f7ef02032e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.058+0000 7f7ef8600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7ec806af20 0x7f7ec806d3e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.058+0000 7f7ef8600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ef00d1890 0x7f7ef0202da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.058+0000 7f7ef8600640 1 --2- 172.21.15.162:0/2866387188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ef00b21b0 0x7f7ef01fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.058+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 >> 172.21.15.162:0/2866387188 conn(0x7f7ef009c5f0 msgr2=0x7f7ef00b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.059+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 shutdown_connections 2024-01-20T11:07:40.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.059+0000 7f7ef8600640 1 -- 172.21.15.162:0/2866387188 wait complete. 2024-01-20T11:07:40.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.061+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a5c04e970 con 0x7f6a5c15d5a0 2024-01-20T11:07:40.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.062+0000 7f6a53400640 1 -- 172.21.15.162:0/1334176670 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a44017020 con 0x7f6a5c15d5a0 2024-01-20T11:07:40.063 INFO:teuthology.orchestra.run.smithi162.stdout:60129542147 2024-01-20T11:07:40.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.063+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10a0152360 con 0x7f10a0158fe0 2024-01-20T11:07:40.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.064+0000 7f1096a00640 1 -- 172.21.15.162:0/3905377497 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1088020020 con 0x7f10a0158fe0 2024-01-20T11:07:40.066 INFO:teuthology.orchestra.run.smithi162.stdout:60129542148 2024-01-20T11:07:40.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.066+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6a3406aed0 msgr2=0x7f6a3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6a3406aed0 0x7f6a3406d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c036000 tx=0x7f6a4c03c040 comp rx=0 tx=0).stop 2024-01-20T11:07:40.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c15d5a0 msgr2=0x7f6a5c1fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c15d5a0 0x7f6a5c1fc2b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c410 tx=0x7f6a4400c8d0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 shutdown_connections 2024-01-20T11:07:40.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c15d5a0 0x7f6a5c1fc2b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5c0d2250 0x7f6a5c1f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6a3406aed0 0x7f6a3406d390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 --2- 172.21.15.162:0/1334176670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0d0400 0x7f6a5c157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.067+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 >> 172.21.15.162:0/1334176670 conn(0x7f6a5c066760 msgr2=0x7f6a5c160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 shutdown_connections 2024-01-20T11:07:40.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f6a61e00640 1 -- 172.21.15.162:0/1334176670 wait complete. 2024-01-20T11:07:40.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f107806af00 msgr2=0x7f107806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f107806af00 0x7f107806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1090038000 tx=0x7f1090009030 comp rx=0 tx=0).stop 2024-01-20T11:07:40.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0158fe0 msgr2=0x7f10a0155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0158fe0 0x7f10a0155f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f108800f760 tx=0x7f108800fb60 comp rx=0 tx=0).stop 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 shutdown_connections 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00cbba0 0x7f10a01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10a01593c0 0x7f10a0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f107806af00 0x7f107806d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.068+0000 7f109fe00640 1 --2- 172.21.15.162:0/3905377497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0158fe0 0x7f10a0155f90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.069+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 >> 172.21.15.162:0/3905377497 conn(0x7f10a00b0c40 msgr2=0x7f10a01e4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.069+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 shutdown_connections 2024-01-20T11:07:40.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.069+0000 7f109fe00640 1 -- 172.21.15.162:0/3905377497 wait complete. 2024-01-20T11:07:40.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.069+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15e404e970 con 0x7f15e40b2040 2024-01-20T11:07:40.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.070+0000 7f15dbe00640 1 -- 172.21.15.162:0/273916520 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15dc03a020 con 0x7f15e40b2040 2024-01-20T11:07:40.074 INFO:teuthology.orchestra.run.smithi162.stdout:60129542148 2024-01-20T11:07:40.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.074+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f15bc06af20 msgr2=0x7f15bc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.074+0000 7f15eac00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f15bc06af20 0x7f15bc06d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000f60 tx=0x7f15cc009040 comp rx=0 tx=0).stop 2024-01-20T11:07:40.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.075+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e40b2040 msgr2=0x7f15e41e6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.075+0000 7f15eac00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e40b2040 0x7f15e41e6e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009730 tx=0x7f15dc004a40 comp rx=0 tx=0).stop 2024-01-20T11:07:40.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.076+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 shutdown_connections 2024-01-20T11:07:40.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.076+0000 7f15eac00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f15bc06af20 0x7f15bc06d3e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.076+0000 7f15eac00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e415a420 0x7f15e415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.076+0000 7f15eac00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15e40b2040 0x7f15e41e6e70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.076+0000 7f15eac00640 1 --2- 172.21.15.162:0/273916520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e406c3b0 0x7f15e414b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.076+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 >> 172.21.15.162:0/273916520 conn(0x7f15e40cf0d0 msgr2=0x7f15e4070630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.078+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f22280d0ba0 con 0x7f22280b25e0 2024-01-20T11:07:40.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.078+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 shutdown_connections 2024-01-20T11:07:40.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2024-01-20T11:07:40.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.078+0000 7f15eac00640 1 -- 172.21.15.162:0/273916520 wait complete. 2024-01-20T11:07:40.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.079+0000 7f2225600640 1 -- 172.21.15.162:0/2227753100 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2220057bb0 con 0x7f22280b25e0 2024-01-20T11:07:40.080 INFO:teuthology.orchestra.run.smithi162.stdout:60129542148 2024-01-20T11:07:40.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.079+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f377c150cd0 con 0x7f377c0cf960 2024-01-20T11:07:40.082 INFO:teuthology.orchestra.run.smithi162.stdout:60129542149 2024-01-20T11:07:40.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.080+0000 7f3778c00640 1 -- 172.21.15.162:0/56137379 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f377c150cd0 con 0x7f377c0cf960 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.082+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f220006af50 msgr2=0x7f220006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f220006af50 0x7f220006d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210008030 comp rx=0 tx=0).stop 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280b25e0 msgr2=0x7f22281606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280b25e0 0x7f22281606f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f222000cb40 tx=0x7f222000a060 comp rx=0 tx=0).stop 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 shutdown_connections 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f220006af50 0x7f220006d410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22280cfde0 0x7f22280c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22280ced20 0x7f22280c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 --2- 172.21.15.162:0/2227753100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280b25e0 0x7f22281606f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 >> 172.21.15.162:0/2227753100 conn(0x7f222809c7d0 msgr2=0x7f222806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 shutdown_connections 2024-01-20T11:07:40.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.083+0000 7f222fe00640 1 -- 172.21.15.162:0/2227753100 wait complete. 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f375406af20 msgr2=0x7f375406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f375406af20 0x7f375406d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f376c036000 tx=0x7f376c008030 comp rx=0 tx=0).stop 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f377c0cf960 msgr2=0x7f377c15b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f377c0cf960 0x7f377c15b4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f376400b450 tx=0x7f376400b910 comp rx=0 tx=0).stop 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 shutdown_connections 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f377c159b50 0x7f377c15c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f375406af20 0x7f375406d3e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f377c0cf960 0x7f377c15b4e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 --2- 172.21.15.162:0/56137379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377c0cbf50 0x7f377c146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 >> 172.21.15.162:0/56137379 conn(0x7f377c06a600 msgr2=0x7f377c14d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.085+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 shutdown_connections 2024-01-20T11:07:40.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.086+0000 7f3783c00640 1 -- 172.21.15.162:0/56137379 wait complete. 2024-01-20T11:07:40.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-01-20T11:07:40.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.087+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f167c005810 con 0x7f16a4005e90 2024-01-20T11:07:40.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.088+0000 7f16a3e00640 1 -- 172.21.15.162:0/2844121949 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f169c0570b0 con 0x7f16a4005e90 2024-01-20T11:07:40.089 INFO:teuthology.orchestra.run.smithi162.stdout:60129542150 2024-01-20T11:07:40.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f168406af20 msgr2=0x7f168406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f168406af20 0x7f168406d3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1694036000 tx=0x7f169403c040 comp rx=0 tx=0).stop 2024-01-20T11:07:40.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16a4005e90 msgr2=0x7f16a40dc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:40.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16a4005e90 0x7f16a40dc160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c4a0 tx=0x7f169c00c960 comp rx=0 tx=0).stop 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 shutdown_connections 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f168406af20 0x7f168406d3e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16a40ead00 0x7f16a4045150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16a4006810 0x7f16a40dc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 --2- 172.21.15.162:0/2844121949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16a4005e90 0x7f16a40dc160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 >> 172.21.15.162:0/2844121949 conn(0x7f16a4009fb0 msgr2=0x7f16a40495c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 shutdown_connections 2024-01-20T11:07:40.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:40.092+0000 7f16b1600640 1 -- 172.21.15.162:0/2844121949 wait complete. 2024-01-20T11:07:40.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-01-20T11:07:40.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-01-20T11:07:40.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-01-20T11:07:40.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-01-20T11:07:40.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-01-20T11:07:40.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2024-01-20T11:07:41.080 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-20T11:07:41.088 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-20T11:07:41.097 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-20T11:07:41.097 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-20T11:07:41.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-20T11:07:41.108 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-20T11:07:41.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-20T11:07:41.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-20T11:07:41.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.362+0000 7f4c06600640 1 Processor -- start 2024-01-20T11:07:41.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.363+0000 7f4c06600640 1 -- start start 2024-01-20T11:07:41.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.365+0000 7f4c06600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c000b5690 0x7f4c0006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.365+0000 7f4c06600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c000d1fc0 0x7f4c0006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.365+0000 7f4bfea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c000b5690 0x7f4c0006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.365+0000 7f4bfea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c000b5690 0x7f4c0006c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41382/0 (socket says 172.21.15.162:41382) 2024-01-20T11:07:41.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.365+0000 7f4bfea00640 1 -- 172.21.15.162:0/546111064 learned_addr learned my addr 172.21.15.162:0/546111064 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.366+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0006bc70 con 0x7f4c0015d800 2024-01-20T11:07:41.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.366+0000 7f4bffe00640 1 --2- 172.21.15.162:0/546111064 >> v2:172.21.15.179:3300/0 conn(0x7f4c000d1fc0 0x7f4c0006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.366+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000b2df0 con 0x7f4c000b5690 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.366+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0015dbe0 con 0x7f4c000d1fc0 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.367+0000 7f4bfea00640 1 -- 172.21.15.162:0/546111064 >> v2:172.21.15.179:3300/0 conn(0x7f4c000d1fc0 msgr2=0x7f4c0006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.367+0000 7f4bfea00640 1 --2- 172.21.15.162:0/546111064 >> v2:172.21.15.179:3300/0 conn(0x7f4c000d1fc0 0x7f4c0006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.367+0000 7f4bfea00640 1 -- 172.21.15.162:0/546111064 >> v1:172.21.15.162:6789/0 conn(0x7f4c0015d800 legacy=0x7f4c000b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.367+0000 7f4bfea00640 1 -- 172.21.15.162:0/546111064 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000d2510 con 0x7f4c000b5690 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.369+0000 7f4bffe00640 1 --2- 172.21.15.162:0/546111064 >> v2:172.21.15.179:3300/0 conn(0x7f4c000d1fc0 0x7f4c0006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:41.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.370+0000 7f4bfea00640 1 --2- 172.21.15.162:0/546111064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c000b5690 0x7f4c0006c100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c0008bc70 tx=0x7f4bf0034140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83290a7bea3c8c47 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.371+0000 7f4bfe000640 1 -- 172.21.15.162:0/546111064 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf003c440 con 0x7f4c000b5690 2024-01-20T11:07:41.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.371+0000 7f4bfe000640 1 -- 172.21.15.162:0/546111064 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf003c5a0 con 0x7f4c000b5690 2024-01-20T11:07:41.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.372+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c000b5690 msgr2=0x7f4c0006c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.372+0000 7f4c06600640 1 --2- 172.21.15.162:0/546111064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c000b5690 0x7f4c0006c100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c0008bc70 tx=0x7f4bf0034140 comp rx=0 tx=0).stop 2024-01-20T11:07:41.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.373+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 shutdown_connections 2024-01-20T11:07:41.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.373+0000 7f4c06600640 1 --2- 172.21.15.162:0/546111064 >> v2:172.21.15.179:3300/0 conn(0x7f4c000d1fc0 0x7f4c0006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.373+0000 7f4c06600640 1 --2- 172.21.15.162:0/546111064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c000b5690 0x7f4c0006c100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.373+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 >> 172.21.15.162:0/546111064 conn(0x7f4c0009c7b0 msgr2=0x7f4c000d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.374+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 shutdown_connections 2024-01-20T11:07:41.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.374+0000 7f4c06600640 1 -- 172.21.15.162:0/546111064 wait complete. 2024-01-20T11:07:41.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.377+0000 7f4c06600640 1 Processor -- start 2024-01-20T11:07:41.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.377+0000 7f4c06600640 1 -- start start 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.379+0000 7f4c06600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c000b5690 0x7f4c002030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.379+0000 7f4c06600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c000d1fc0 0x7f4c000b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.379+0000 7f4c06600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c0015d800 0x7f4c00156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4bff400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c000b5690 0x7f4c002030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4bff400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c000b5690 0x7f4c002030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42636/0 (socket says 172.21.15.162:42636) 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4bfea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c000d1fc0 0x7f4c000b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4bfea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c000d1fc0 0x7f4c000b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34524/0 (socket says 172.21.15.162:34524) 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4bff400640 1 -- 172.21.15.162:0/1958374498 learned_addr learned my addr 172.21.15.162:0/1958374498 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001587d0 con 0x7f4c0015d800 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001569d0 con 0x7f4c000b5690 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00158d00 con 0x7f4c000d1fc0 2024-01-20T11:07:41.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.380+0000 7f4bffe00640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c0015d800 0x7f4c00156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.381+0000 7f4bffe00640 1 -- 172.21.15.162:0/1958374498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c000d1fc0 msgr2=0x7f4c000b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.381+0000 7f4bffe00640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c000d1fc0 0x7f4c000b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.381+0000 7f4bffe00640 1 -- 172.21.15.162:0/1958374498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c000b5690 msgr2=0x7f4c002030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.381+0000 7f4bffe00640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c000b5690 0x7f4c002030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.382+0000 7f4bffe00640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf00094d0 con 0x7f4c0015d800 2024-01-20T11:07:41.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.383+0000 7f4bffe00640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c0015d800 0x7f4c00156e60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c5c0 tx=0x7f4be800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.383+0000 7f4bf7400640 1 -- 172.21.15.162:0/1958374498 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8011800 con 0x7f4c0015d800 2024-01-20T11:07:41.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.384+0000 7f4bf7400640 1 -- 172.21.15.162:0/1958374498 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8011960 con 0x7f4c0015d800 2024-01-20T11:07:41.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.384+0000 7f4bf7400640 1 -- 172.21.15.162:0/1958374498 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8011d50 con 0x7f4c0015d800 2024-01-20T11:07:41.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.384+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c000c6f20 con 0x7f4c0015d800 2024-01-20T11:07:41.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.388+0000 7f4bf7400640 1 -- 172.21.15.162:0/1958374498 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4be8018360 con 0x7f4c0015d800 2024-01-20T11:07:41.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.388+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00158a20 con 0x7f4c0015d800 2024-01-20T11:07:41.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.390+0000 7f4bf7400640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4bd806aed0 0x7f4bd806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.391+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c000d4650 con 0x7f4c0015d800 2024-01-20T11:07:41.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.399+0000 7f4bff400640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4bd806aed0 0x7f4bd806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.399+0000 7f4bf7400640 1 -- 172.21.15.162:0/1958374498 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4be8057d80 con 0x7f4c0015d800 2024-01-20T11:07:41.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.402+0000 7f4bff400640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4bd806aed0 0x7f4bd806d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8007fd0 tx=0x7f4bf8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.403+0000 7f4bf7400640 1 -- 172.21.15.162:0/1958374498 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4be808e060 con 0x7f4c0015d800 2024-01-20T11:07:41.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.416+0000 7fbe73000640 1 Processor -- start 2024-01-20T11:07:41.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.416+0000 7fbe73000640 1 -- start start 2024-01-20T11:07:41.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.418+0000 7fbe73000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe640ead00 0x7fbe6404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.418+0000 7fbe73000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe64006ea0 0x7fbe64007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.418+0000 7fbe73000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe64054330 con 0x7fbe6404ffd0 2024-01-20T11:07:41.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.418+0000 7fbe73000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe64007850 con 0x7fbe640ead00 2024-01-20T11:07:41.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.418+0000 7fbe73000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe64053720 con 0x7fbe64006ea0 2024-01-20T11:07:41.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.419+0000 7fbe71200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbe6404ffd0 0x7fbe64037bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33762/0 (socket says 172.21.15.162:33762) 2024-01-20T11:07:41.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.419+0000 7fbe71200640 1 -- 172.21.15.162:0/2804836226 learned_addr learned my addr 172.21.15.162:0/2804836226 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:41.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.420+0000 7fbe72600640 1 --2- 172.21.15.162:0/2804836226 >> v2:172.21.15.179:3300/0 conn(0x7fbe64006ea0 0x7fbe64007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.421+0000 7fbe6be00640 1 -- 172.21.15.162:0/2804836226 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333916914 0 0) 0x7fbe64054330 con 0x7fbe6404ffd0 2024-01-20T11:07:41.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.421+0000 7fbe71c00640 1 --2- 172.21.15.162:0/2804836226 >> v2:172.21.15.162:3300/0 conn(0x7fbe640ead00 0x7fbe6404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.424+0000 7fbe6be00640 1 -- 172.21.15.162:0/2804836226 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe4c003520 con 0x7fbe6404ffd0 2024-01-20T11:07:41.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.424+0000 7fbe72600640 1 -- 172.21.15.162:0/2804836226 >> v2:172.21.15.162:3300/0 conn(0x7fbe640ead00 msgr2=0x7fbe6404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.424+0000 7fbe72600640 1 --2- 172.21.15.162:0/2804836226 >> v2:172.21.15.162:3300/0 conn(0x7fbe640ead00 0x7fbe6404fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.424+0000 7fbe72600640 1 -- 172.21.15.162:0/2804836226 >> v1:172.21.15.162:6789/0 conn(0x7fbe6404ffd0 legacy=0x7fbe64037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.424+0000 7fbe72600640 1 -- 172.21.15.162:0/2804836226 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64053a00 con 0x7fbe64006ea0 2024-01-20T11:07:41.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.426+0000 7fbe72600640 1 --2- 172.21.15.162:0/2804836226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 0x7fbe64007310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c074ce0 tx=0x7fbe6c0683d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3161133272e31a0c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.427+0000 7fbe6be00640 1 -- 172.21.15.162:0/2804836226 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0ae440 con 0x7fbe64006ea0 2024-01-20T11:07:41.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.427+0000 7fbe6be00640 1 -- 172.21.15.162:0/2804836226 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c0ae5a0 con 0x7fbe64006ea0 2024-01-20T11:07:41.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.427+0000 7fbe6be00640 1 -- 172.21.15.162:0/2804836226 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0ae9d0 con 0x7fbe64006ea0 2024-01-20T11:07:41.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 -- 172.21.15.162:0/2804836226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 msgr2=0x7fbe64007310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 --2- 172.21.15.162:0/2804836226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 0x7fbe64007310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c074ce0 tx=0x7fbe6c0683d0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 -- 172.21.15.162:0/2804836226 shutdown_connections 2024-01-20T11:07:41.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 --2- 172.21.15.162:0/2804836226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 0x7fbe64007310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 --2- 172.21.15.162:0/2804836226 >> v2:172.21.15.162:3300/0 conn(0x7fbe640ead00 0x7fbe6404fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 -- 172.21.15.162:0/2804836226 >> 172.21.15.162:0/2804836226 conn(0x7fbe64009fb0 msgr2=0x7fbe6400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 -- 172.21.15.162:0/2804836226 shutdown_connections 2024-01-20T11:07:41.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.428+0000 7fbe73000640 1 -- 172.21.15.162:0/2804836226 wait complete. 2024-01-20T11:07:41.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.431+0000 7fbe73000640 1 Processor -- start 2024-01-20T11:07:41.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.431+0000 7fbe73000640 1 -- start start 2024-01-20T11:07:41.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.433+0000 7fbe73000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 0x7fbe64033a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.433+0000 7fbe73000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe6404ffd0 0x7fbe641a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.433+0000 7fbe73000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe640ead00 0x7fbe641a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe72600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe640ead00 0x7fbe641a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe72600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe640ead00 0x7fbe641a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34532/0 (socket says 172.21.15.162:34532) 2024-01-20T11:07:41.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.435+0000 7ff449a00640 1 Processor -- start 2024-01-20T11:07:41.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.435+0000 7ff449a00640 1 -- start start 2024-01-20T11:07:41.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7f164ee00640 1 Processor -- start 2024-01-20T11:07:41.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe71200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe6404ffd0 0x7fbe641a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe73000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64185180 con 0x7fbe6404ffd0 2024-01-20T11:07:41.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe73000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64033fd0 con 0x7fbe64006ea0 2024-01-20T11:07:41.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe73000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe641a0290 con 0x7fbe640ead00 2024-01-20T11:07:41.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7f164ee00640 1 -- start start 2024-01-20T11:07:41.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe71200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe6404ffd0 0x7fbe641a2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41414/0 (socket says 172.21.15.162:41414) 2024-01-20T11:07:41.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.436+0000 7fbe72600640 1 -- 172.21.15.162:0/3736235836 learned_addr learned my addr 172.21.15.162:0/3736235836 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe71c00640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 0x7fbe64033a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe71200640 1 -- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe640ead00 msgr2=0x7fbe641a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe71200640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe640ead00 0x7fbe641a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe71200640 1 -- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 msgr2=0x7fbe64033a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe71200640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 0x7fbe64033a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe71200640 1 -- 172.21.15.162:0/3736235836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c068640 con 0x7fbe6404ffd0 2024-01-20T11:07:41.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7f6874a00640 1 Processor -- start 2024-01-20T11:07:41.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7ff449a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4440d2250 0x7ff4440ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7ff449a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff4440d0400 0x7ff4440d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7ff449a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4440d0d60 con 0x7ff44415d5a0 2024-01-20T11:07:41.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7ff449a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4440b6d60 con 0x7ff4440d0400 2024-01-20T11:07:41.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7ff449a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440d2730 con 0x7ff4440d2250 2024-01-20T11:07:41.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe72600640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe640ead00 0x7fbe641a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:41.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7fbe71200640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe6404ffd0 0x7fbe641a2620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c780 tx=0x7fbe5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.437+0000 7f6874a00640 1 -- start start 2024-01-20T11:07:41.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7ff442a00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff44415d5a0 0x7ff4440b6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48122/0 (socket says 172.21.15.162:48122) 2024-01-20T11:07:41.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7ff442a00640 1 -- 172.21.15.162:0/145500279 learned_addr learned my addr 172.21.15.162:0/145500279 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:41.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7fbe69600640 1 -- 172.21.15.162:0/3736235836 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54005ab0 con 0x7fbe6404ffd0 2024-01-20T11:07:41.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7fbe69600640 1 -- 172.21.15.162:0/3736235836 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54005c10 con 0x7fbe6404ffd0 2024-01-20T11:07:41.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7fbe69600640 1 -- 172.21.15.162:0/3736235836 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400ce30 con 0x7fbe6404ffd0 2024-01-20T11:07:41.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7ff442000640 1 --2- 172.21.15.162:0/145500279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4440d2250 0x7ff4440ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7ff443400640 1 --2- 172.21.15.162:0/145500279 >> v2:172.21.15.179:3300/0 conn(0x7ff4440d0400 0x7ff4440d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7f164ee00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f16400ead00 0x7f164004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7f164ee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f164004ffd0 0x7f1640037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7f164ee00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1640054330 con 0x7f1640038110 2024-01-20T11:07:41.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7f164ee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1640053720 con 0x7f164004ffd0 2024-01-20T11:07:41.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7f164ee00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1640053a00 con 0x7f16400ead00 2024-01-20T11:07:41.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7ff441600640 1 -- 172.21.15.162:0/145500279 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290472982 0 0) 0x7ff4440d0d60 con 0x7ff44415d5a0 2024-01-20T11:07:41.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7ff441600640 1 -- 172.21.15.162:0/145500279 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff424003520 con 0x7ff44415d5a0 2024-01-20T11:07:41.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7ff442000640 1 -- 172.21.15.162:0/145500279 >> v2:172.21.15.179:3300/0 conn(0x7ff4440d0400 msgr2=0x7ff4440d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7f6874a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f68640e59b0 0x7f68640e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7ff442000640 1 --2- 172.21.15.162:0/145500279 >> v2:172.21.15.179:3300/0 conn(0x7ff4440d0400 0x7ff4440d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7ff442000640 1 -- 172.21.15.162:0/145500279 >> v1:172.21.15.179:6789/0 conn(0x7ff44415d5a0 legacy=0x7ff4440b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7ff442000640 1 -- 172.21.15.162:0/145500279 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440d2a10 con 0x7ff4440d2250 2024-01-20T11:07:41.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe641a0570 con 0x7fbe6404ffd0 2024-01-20T11:07:41.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.438+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe641a0b30 con 0x7fbe6404ffd0 2024-01-20T11:07:41.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7f6874a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f686400a520 0x7f68640e0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7f6874a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6864051c90 con 0x7f6864051720 2024-01-20T11:07:41.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.439+0000 7f6874a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640e5d90 con 0x7f68640e59b0 2024-01-20T11:07:41.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7f6874a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6864051f70 con 0x7f686400a520 2024-01-20T11:07:41.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7f164da00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f16400ead00 0x7f164004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7f164da00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f16400ead00 0x7f164004fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42660/0 (socket says 172.21.15.162:42660) 2024-01-20T11:07:41.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7f164da00640 1 -- 172.21.15.162:0/3861508497 learned_addr learned my addr 172.21.15.162:0/3861508497 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7f164d000640 1 --2- 172.21.15.162:0/3861508497 >> v2:172.21.15.162:3300/0 conn(0x7f164004ffd0 0x7f1640037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c005290 con 0x7fbe6404ffd0 2024-01-20T11:07:41.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7f164da00640 1 -- 172.21.15.162:0/3861508497 >> v2:172.21.15.162:3300/0 conn(0x7f164004ffd0 msgr2=0x7f1640037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.440+0000 7f6871600640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6864051720 0x7f6864009e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48124/0 (socket says 172.21.15.162:48124) 2024-01-20T11:07:41.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7f6871600640 1 -- 172.21.15.162:0/3157117903 learned_addr learned my addr 172.21.15.162:0/3157117903 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:41.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7f6872000640 1 --2- 172.21.15.162:0/3157117903 >> v2:172.21.15.162:3300/0 conn(0x7f68640e59b0 0x7f68640e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7f6872a00640 1 --2- 172.21.15.162:0/3157117903 >> v2:172.21.15.179:3300/0 conn(0x7f686400a520 0x7f68640e0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7fd505800640 1 Processor -- start 2024-01-20T11:07:41.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7f6872000640 1 -- 172.21.15.162:0/3157117903 >> v2:172.21.15.179:3300/0 conn(0x7f686400a520 msgr2=0x7f68640e0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7f6872000640 1 --2- 172.21.15.162:0/3157117903 >> v2:172.21.15.179:3300/0 conn(0x7f686400a520 0x7f68640e0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7f6872000640 1 -- 172.21.15.162:0/3157117903 >> v1:172.21.15.179:6789/0 conn(0x7f6864051720 legacy=0x7f6864009e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7ff442000640 1 --2- 172.21.15.162:0/145500279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4440d2250 0x7ff4440ce580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0097a0 tx=0x7ff42c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed152e875ef28efe server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7f7d19400640 1 Processor -- start 2024-01-20T11:07:41.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7f7d19400640 1 -- start start 2024-01-20T11:07:41.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7fd505800640 1 -- start start 2024-01-20T11:07:41.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7f164da00640 1 --2- 172.21.15.162:0/3861508497 >> v2:172.21.15.162:3300/0 conn(0x7f164004ffd0 0x7f1640037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7f164da00640 1 -- 172.21.15.162:0/3861508497 >> v1:172.21.15.179:6789/0 conn(0x7f1640038110 legacy=0x7f1640038580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.441+0000 7f164da00640 1 -- 172.21.15.162:0/3861508497 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1640053ce0 con 0x7f16400ead00 2024-01-20T11:07:41.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7ff441600640 1 -- 172.21.15.162:0/145500279 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c031780 con 0x7ff4440d2250 2024-01-20T11:07:41.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7f0644c00640 1 Processor -- start 2024-01-20T11:07:41.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7f0644c00640 1 -- start start 2024-01-20T11:07:41.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.442+0000 7f6872000640 1 -- 172.21.15.162:0/3157117903 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864052250 con 0x7f68640e59b0 2024-01-20T11:07:41.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.443+0000 7fd505800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5000cefe0 0x7fd5000cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.443+0000 7fd505800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5000b3560 con 0x7fd500165690 2024-01-20T11:07:41.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.443+0000 7fd505800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd500161f60 con 0x7fd500161b80 2024-01-20T11:07:41.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.443+0000 7fd505800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd500072830 con 0x7fd5000cefe0 2024-01-20T11:07:41.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.443+0000 7f164da00640 1 --2- 172.21.15.162:0/3861508497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400ead00 0x7f164004fa90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1640007a60 tx=0x7f163802b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a4df54a7f1070db server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7fd4fea00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd500161b80 0x7fd500071d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48140/0 (socket says 172.21.15.162:48140) 2024-01-20T11:07:41.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7fd4fea00640 1 -- 172.21.15.162:0/2240432010 learned_addr learned my addr 172.21.15.162:0/2240432010 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:41.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f0644c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f06380df220 0x7f0638038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f0644c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0638053c70 0x7f063804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f6872000640 1 --2- 172.21.15.162:0/3157117903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f68640e4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6864056d00 tx=0x7f685c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00b65b218593367 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f0644c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06380544c0 con 0x7f0638033ef0 2024-01-20T11:07:41.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f0644c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06380541e0 con 0x7f06380df220 2024-01-20T11:07:41.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f0644c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0638005f30 con 0x7f0638053c70 2024-01-20T11:07:41.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7fd4fe000640 1 --2- 172.21.15.162:0/2240432010 >> v2:172.21.15.162:3300/0 conn(0x7fd5000cefe0 0x7fd5000cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7ff441600640 1 -- 172.21.15.162:0/145500279 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c0318e0 con 0x7ff4440d2250 2024-01-20T11:07:41.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7ff441600640 1 -- 172.21.15.162:0/145500279 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c031c50 con 0x7ff4440d2250 2024-01-20T11:07:41.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f063ea00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0638053c70 0x7f063804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f063ea00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0638053c70 0x7f063804fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42700/0 (socket says 172.21.15.162:42700) 2024-01-20T11:07:41.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f063fe00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0638033ef0 0x7f0638006a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48148/0 (socket says 172.21.15.162:48148) 2024-01-20T11:07:41.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f063ea00640 1 -- 172.21.15.162:0/822835047 learned_addr learned my addr 172.21.15.162:0/822835047 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7fd4fd600640 1 -- 172.21.15.162:0/2240432010 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890578889 0 0) 0x7fd500161f60 con 0x7fd500161b80 2024-01-20T11:07:41.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7fd4fd600640 1 -- 172.21.15.162:0/2240432010 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e0003520 con 0x7fd500161b80 2024-01-20T11:07:41.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7fd4fe000640 1 -- 172.21.15.162:0/2240432010 >> v1:172.21.15.179:6789/0 conn(0x7fd500161b80 legacy=0x7fd500071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7fd4fe000640 1 -- 172.21.15.162:0/2240432010 >> v1:172.21.15.162:6789/0 conn(0x7fd500165690 legacy=0x7fd500165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7fd4fe000640 1 -- 172.21.15.162:0/2240432010 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5000b3de0 con 0x7fd5000cefe0 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f7d19400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d140b25e0 0x7f7d1406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f7d19400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140cfde0 0x7f7d140d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f7d19400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7d140ced20 0x7f7d140cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f7d19400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d140d0780 con 0x7f7d140ced20 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f7d19400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d140cdfe0 con 0x7f7d140b25e0 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.444+0000 7f7d19400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140ce280 con 0x7f7d140cfde0 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d12800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d140b25e0 0x7f7d1406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d12800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d140b25e0 0x7f7d1406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42686/0 (socket says 172.21.15.162:42686) 2024-01-20T11:07:41.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d12800640 1 -- 172.21.15.162:0/1596191945 learned_addr learned my addr 172.21.15.162:0/1596191945 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d11e00640 1 --2- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140cfde0 0x7f7d140d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d12800640 1 -- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140cfde0 msgr2=0x7f7d140d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d12800640 1 --2- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140cfde0 0x7f7d140d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d12800640 1 -- 172.21.15.162:0/1596191945 >> v2:172.21.15.162:3300/0 conn(0x7f7d140ced20 msgr2=0x7f7d140cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f7d12800640 1 --2- 172.21.15.162:0/1596191945 >> v2:172.21.15.162:3300/0 conn(0x7f7d140ced20 0x7f7d140cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7f7d12800640 1 -- 172.21.15.162:0/1596191945 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140d2450 con 0x7f7d140b25e0 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7ff449a00640 1 -- 172.21.15.162:0/145500279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4440d2250 msgr2=0x7ff4440ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7ff449a00640 1 --2- 172.21.15.162:0/145500279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4440d2250 0x7ff4440ce580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0097a0 tx=0x7ff42c02b820 comp rx=0 tx=0).stop 2024-01-20T11:07:41.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f1647e00640 1 -- 172.21.15.162:0/3861508497 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638031890 con 0x7f16400ead00 2024-01-20T11:07:41.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f1647e00640 1 -- 172.21.15.162:0/3861508497 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380319f0 con 0x7f16400ead00 2024-01-20T11:07:41.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.445+0000 7f1647e00640 1 -- 172.21.15.162:0/3861508497 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638031dc0 con 0x7f16400ead00 2024-01-20T11:07:41.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.447+0000 7f164ee00640 1 -- 172.21.15.162:0/3861508497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400ead00 msgr2=0x7f164004fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.447+0000 7f164ee00640 1 --2- 172.21.15.162:0/3861508497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400ead00 0x7f164004fa90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1640007a60 tx=0x7f163802b930 comp rx=0 tx=0).stop 2024-01-20T11:07:41.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7f063ea00640 1 -- 172.21.15.162:0/822835047 >> v2:172.21.15.162:3300/0 conn(0x7f06380df220 msgr2=0x7f0638038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:41.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7f063ea00640 1 --2- 172.21.15.162:0/822835047 >> v2:172.21.15.162:3300/0 conn(0x7f06380df220 0x7f0638038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7f063ea00640 1 -- 172.21.15.162:0/822835047 >> v1:172.21.15.179:6789/0 conn(0x7f0638033ef0 legacy=0x7f0638006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7f063ea00640 1 -- 172.21.15.162:0/822835047 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638006210 con 0x7f0638053c70 2024-01-20T11:07:41.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.446+0000 7f063e000640 1 -- 172.21.15.162:0/822835047 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088349800 0 0) 0x7f06380544c0 con 0x7f0638033ef0 2024-01-20T11:07:41.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.447+0000 7ff449a00640 1 -- 172.21.15.162:0/145500279 shutdown_connections 2024-01-20T11:07:41.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.447+0000 7ff449a00640 1 --2- 172.21.15.162:0/145500279 >> v2:172.21.15.179:3300/0 conn(0x7ff4440d0400 0x7ff4440d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.447+0000 7ff449a00640 1 --2- 172.21.15.162:0/145500279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4440d2250 0x7ff4440ce580 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.447+0000 7ff449a00640 1 -- 172.21.15.162:0/145500279 >> 172.21.15.162:0/145500279 conn(0x7ff444066760 msgr2=0x7ff444066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.447+0000 7f7d12800640 1 --2- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140b25e0 0x7f7d1406b6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d140d33a0 tx=0x7f7cfc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb303c3e6afd587 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7f164ee00640 1 -- 172.21.15.162:0/3861508497 shutdown_connections 2024-01-20T11:07:41.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7f164ee00640 1 --2- 172.21.15.162:0/3861508497 >> v2:172.21.15.162:3300/0 conn(0x7f164004ffd0 0x7f1640037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7f063ea00640 1 --2- 172.21.15.162:0/822835047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0638053c70 0x7f063804fa90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f063800b3f0 tx=0x7f062802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b452132a9f8b0ff0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7fd4fe000640 1 --2- 172.21.15.162:0/2240432010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5000cefe0 0x7fd5000cf470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00097a0 tx=0x7fd4f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1563bb2e388ab5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7f164ee00640 1 --2- 172.21.15.162:0/3861508497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400ead00 0x7f164004fa90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7f164ee00640 1 -- 172.21.15.162:0/3861508497 >> 172.21.15.162:0/3861508497 conn(0x7f1640009fb0 msgr2=0x7f164000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7f164ee00640 1 -- 172.21.15.162:0/3861508497 shutdown_connections 2024-01-20T11:07:41.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7f164ee00640 1 -- 172.21.15.162:0/3861508497 wait complete. 2024-01-20T11:07:41.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7ff449a00640 1 -- 172.21.15.162:0/145500279 shutdown_connections 2024-01-20T11:07:41.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.448+0000 7ff449a00640 1 -- 172.21.15.162:0/145500279 wait complete. 2024-01-20T11:07:41.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7fd4fd600640 1 -- 172.21.15.162:0/2240432010 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f002e070 con 0x7fd5000cefe0 2024-01-20T11:07:41.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7fd4fd600640 1 -- 172.21.15.162:0/2240432010 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00315a0 con 0x7fd5000cefe0 2024-01-20T11:07:41.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7fd4fd600640 1 -- 172.21.15.162:0/2240432010 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0031910 con 0x7fd5000cefe0 2024-01-20T11:07:41.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7f6870c00640 1 -- 172.21.15.162:0/3157117903 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c02e070 con 0x7f68640e59b0 2024-01-20T11:07:41.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7f6870c00640 1 -- 172.21.15.162:0/3157117903 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c0315a0 con 0x7f68640e59b0 2024-01-20T11:07:41.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7f6870c00640 1 -- 172.21.15.162:0/3157117903 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c031930 con 0x7f68640e59b0 2024-01-20T11:07:41.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7fbe69600640 1 -- 172.21.15.162:0/3736235836 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbe54007070 con 0x7fbe6404ffd0 2024-01-20T11:07:41.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7f063e000640 1 -- 172.21.15.162:0/822835047 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628030610 con 0x7f0638053c70 2024-01-20T11:07:41.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7f063e000640 1 -- 172.21.15.162:0/822835047 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0628030770 con 0x7f0638053c70 2024-01-20T11:07:41.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7f063e000640 1 -- 172.21.15.162:0/822835047 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628030b00 con 0x7f0638053c70 2024-01-20T11:07:41.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.450+0000 7f164ee00640 1 Processor -- start 2024-01-20T11:07:41.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7f7d11400640 1 -- 172.21.15.162:0/1596191945 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc030610 con 0x7f7d140b25e0 2024-01-20T11:07:41.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7fd505800640 1 -- 172.21.15.162:0/2240432010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5000cefe0 msgr2=0x7fd5000cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7fd505800640 1 --2- 172.21.15.162:0/2240432010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5000cefe0 0x7fd5000cf470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00097a0 tx=0x7fd4f002b840 comp rx=0 tx=0).stop 2024-01-20T11:07:41.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7ff449a00640 1 Processor -- start 2024-01-20T11:07:41.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7f7d11400640 1 -- 172.21.15.162:0/1596191945 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc030770 con 0x7f7d140b25e0 2024-01-20T11:07:41.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7f7d11400640 1 -- 172.21.15.162:0/1596191945 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc030b40 con 0x7f7d140b25e0 2024-01-20T11:07:41.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7fd505800640 1 -- 172.21.15.162:0/2240432010 shutdown_connections 2024-01-20T11:07:41.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7fd505800640 1 --2- 172.21.15.162:0/2240432010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5000cefe0 0x7fd5000cf470 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7fd505800640 1 -- 172.21.15.162:0/2240432010 >> 172.21.15.162:0/2240432010 conn(0x7fd50006a600 msgr2=0x7fd50006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7fd505800640 1 -- 172.21.15.162:0/2240432010 shutdown_connections 2024-01-20T11:07:41.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7f6874a00640 1 -- 172.21.15.162:0/3157117903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 msgr2=0x7f68640e4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7f6874a00640 1 --2- 172.21.15.162:0/3157117903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f68640e4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6864056d00 tx=0x7f685c02b840 comp rx=0 tx=0).stop 2024-01-20T11:07:41.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7fd505800640 1 -- 172.21.15.162:0/2240432010 wait complete. 2024-01-20T11:07:41.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.451+0000 7ff449a00640 1 -- start start 2024-01-20T11:07:41.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f7d19400640 1 -- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140b25e0 msgr2=0x7f7d1406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f7d19400640 1 --2- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140b25e0 0x7f7d1406b6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d140d33a0 tx=0x7f7cfc02b960 comp rx=0 tx=0).stop 2024-01-20T11:07:41.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f164ee00640 1 -- start start 2024-01-20T11:07:41.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f0644c00640 1 -- 172.21.15.162:0/822835047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0638053c70 msgr2=0x7f063804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f0644c00640 1 --2- 172.21.15.162:0/822835047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0638053c70 0x7f063804fa90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f063800b3f0 tx=0x7f062802b960 comp rx=0 tx=0).stop 2024-01-20T11:07:41.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7fbe69600640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe4406afa0 0x7fbe4406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f0644c00640 1 -- 172.21.15.162:0/822835047 shutdown_connections 2024-01-20T11:07:41.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f0644c00640 1 --2- 172.21.15.162:0/822835047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0638053c70 0x7f063804fa90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f0644c00640 1 --2- 172.21.15.162:0/822835047 >> v2:172.21.15.162:3300/0 conn(0x7f06380df220 0x7f0638038080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f6874a00640 1 -- 172.21.15.162:0/3157117903 shutdown_connections 2024-01-20T11:07:41.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f6874a00640 1 --2- 172.21.15.162:0/3157117903 >> v2:172.21.15.179:3300/0 conn(0x7f686400a520 0x7f68640e0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f6874a00640 1 --2- 172.21.15.162:0/3157117903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f68640e4d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f6874a00640 1 -- 172.21.15.162:0/3157117903 >> 172.21.15.162:0/3157117903 conn(0x7f68640537b0 msgr2=0x7f6864053bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.452+0000 7f0644c00640 1 -- 172.21.15.162:0/822835047 >> 172.21.15.162:0/822835047 conn(0x7f0638009fb0 msgr2=0x7f063800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7fbe69600640 1 -- 172.21.15.162:0/3736235836 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe54089040 con 0x7fbe6404ffd0 2024-01-20T11:07:41.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7fbe69600640 1 -- 172.21.15.162:0/3736235836 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbe540894c0 con 0x7fbe6404ffd0 2024-01-20T11:07:41.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7f6874a00640 1 -- 172.21.15.162:0/3157117903 shutdown_connections 2024-01-20T11:07:41.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7ff449a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4440d0400 0x7ff44414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7ff449a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4440d2250 0x7ff4440c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7ff449a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44415d5a0 0x7ff44415ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7ff449a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440c8310 con 0x7ff4440d2250 2024-01-20T11:07:41.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7ff449a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444159da0 con 0x7ff4440d0400 2024-01-20T11:07:41.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7ff449a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440c7080 con 0x7ff44415d5a0 2024-01-20T11:07:41.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7f0644c00640 1 -- 172.21.15.162:0/822835047 shutdown_connections 2024-01-20T11:07:41.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7f0644c00640 1 -- 172.21.15.162:0/822835047 wait complete. 2024-01-20T11:07:41.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7fd505800640 1 Processor -- start 2024-01-20T11:07:41.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7f7d19400640 1 -- 172.21.15.162:0/1596191945 shutdown_connections 2024-01-20T11:07:41.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7f7d19400640 1 --2- 172.21.15.162:0/1596191945 >> v2:172.21.15.162:3300/0 conn(0x7f7d140ced20 0x7f7d140cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7f7d19400640 1 --2- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140cfde0 0x7f7d140d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7f7d19400640 1 --2- 172.21.15.162:0/1596191945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140b25e0 0x7f7d1406b6c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7f7d19400640 1 -- 172.21.15.162:0/1596191945 >> 172.21.15.162:0/1596191945 conn(0x7f7d1409c7d0 msgr2=0x7f7d140d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7fd505800640 1 -- start start 2024-01-20T11:07:41.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7f7d19400640 1 -- 172.21.15.162:0/1596191945 shutdown_connections 2024-01-20T11:07:41.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7f7d19400640 1 -- 172.21.15.162:0/1596191945 wait complete. 2024-01-20T11:07:41.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7ff443400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44415d5a0 0x7ff44415ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7fbe71c00640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe4406afa0 0x7fbe4406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7ff443400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44415d5a0 0x7ff44415ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34562/0 (socket says 172.21.15.162:34562) 2024-01-20T11:07:41.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7ff442000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4440d2250 0x7ff4440c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7ff442000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4440d2250 0x7ff4440c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41454/0 (socket says 172.21.15.162:41454) 2024-01-20T11:07:41.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7ff442000640 1 -- 172.21.15.162:0/2418133225 learned_addr learned my addr 172.21.15.162:0/2418133225 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.454+0000 7ff442a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4440d0400 0x7ff44414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7f6874a00640 1 -- 172.21.15.162:0/3157117903 wait complete. 2024-01-20T11:07:41.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7f6874a00640 1 Processor -- start 2024-01-20T11:07:41.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7ff442000640 1 -- 172.21.15.162:0/2418133225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44415d5a0 msgr2=0x7ff44415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7ff442000640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44415d5a0 0x7ff44415ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7ff442000640 1 -- 172.21.15.162:0/2418133225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4440d0400 msgr2=0x7ff44414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7fbe71c00640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe4406afa0 0x7fbe4406d460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0079a0 tx=0x7fbe5c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7ff442000640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4440d0400 0x7ff44414f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7fd505800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5000cefe0 0x7fd500152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7f0644c00640 1 Processor -- start 2024-01-20T11:07:41.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7ff443400640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44415d5a0 0x7ff44415ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-01-20T11:07:41.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7ff442000640 1 -- 172.21.15.162:0/2418133225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c009400 con 0x7ff4440d2250 2024-01-20T11:07:41.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7fd505800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd500161b80 0x7fd50014ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.453+0000 7f164ee00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640038110 0x7f16400dc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7f0644c00640 1 -- start start 2024-01-20T11:07:41.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7fd505800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd500165690 0x7fd50014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.456+0000 7f6874a00640 1 -- start start 2024-01-20T11:07:41.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7f164ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164004ffd0 0x7f1640034e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd4fe000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd500161b80 0x7fd50014ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd505800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50014cb60 con 0x7fd500165690 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd4fe000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd500161b80 0x7fd50014ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34568/0 (socket says 172.21.15.162:34568) 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd4fe000640 1 -- 172.21.15.162:0/1085123361 learned_addr learned my addr 172.21.15.162:0/1085123361 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd4fea00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5000cefe0 0x7fd500152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50014ce20 con 0x7fd5000cefe0 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50014d100 con 0x7fd500161b80 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7f164da00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640038110 0x7f16400dc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7f164da00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640038110 0x7f16400dc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42728/0 (socket says 172.21.15.162:42728) 2024-01-20T11:07:41.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7fd4ff400640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd500165690 0x7fd50014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7f7d19400640 1 Processor -- start 2024-01-20T11:07:41.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7f164da00640 1 -- 172.21.15.162:0/1504234267 learned_addr learned my addr 172.21.15.162:0/1504234267 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.457+0000 7ff442000640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4440d2250 0x7ff4440c7dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff42c034040 tx=0x7ff42c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f7d19400640 1 -- start start 2024-01-20T11:07:41.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f6874a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f686400a520 0x7f686404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f6874a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6864051720 0x7f68640de530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f6874a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f686417fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f6874a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6864008bd0 con 0x7f68640e59b0 2024-01-20T11:07:41.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f6874a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6864050f60 con 0x7f686400a520 2024-01-20T11:07:41.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f6874a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68640503e0 con 0x7f6864051720 2024-01-20T11:07:41.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7fd4ff400640 1 -- 172.21.15.162:0/1085123361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd500161b80 msgr2=0x7fd50014ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f164ee00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400ead00 0x7f1640035b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f164d000640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164004ffd0 0x7f1640034e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7fd4ff400640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd500161b80 0x7fd50014ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7fd4ff400640 1 -- 172.21.15.162:0/1085123361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5000cefe0 msgr2=0x7fd500152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7fd4ff400640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5000cefe0 0x7fd500152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7fd4ff400640 1 -- 172.21.15.162:0/1085123361 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f0009400 con 0x7fd500165690 2024-01-20T11:07:41.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f0644c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0638033ef0 0x7f0638173dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f0644c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0638053c70 0x7f0638174310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f0644c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06380df220 0x7f063804a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7f6871600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6864051720 0x7f68640de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7fd4fe000640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd500161b80 0x7fd50014ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:41.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.458+0000 7ff43aa00640 1 -- 172.21.15.162:0/2418133225 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c003810 con 0x7ff4440d2250 2024-01-20T11:07:41.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164017d630 con 0x7f164004ffd0 2024-01-20T11:07:41.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400e5e90 con 0x7f1640038110 2024-01-20T11:07:41.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400e58b0 con 0x7f16400ead00 2024-01-20T11:07:41.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f6871600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6864051720 0x7f68640de530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34574/0 (socket says 172.21.15.162:34574) 2024-01-20T11:07:41.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f6871600640 1 -- 172.21.15.162:0/2179235067 learned_addr learned my addr 172.21.15.162:0/2179235067 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f063f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0638033ef0 0x7f0638173dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7fd4ff400640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd500165690 0x7fd50014efb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800c690 tx=0x7fd4f800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f0644c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063804e120 con 0x7f0638033ef0 2024-01-20T11:07:41.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f6872000640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f686400a520 0x7f686404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f6872a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f686417fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7ff43aa00640 1 -- 172.21.15.162:0/2418133225 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c040070 con 0x7ff4440d2250 2024-01-20T11:07:41.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f0644c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063804a1a0 con 0x7f06380df220 2024-01-20T11:07:41.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7ff43aa00640 1 -- 172.21.15.162:0/2418133225 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c003b70 con 0x7ff4440d2250 2024-01-20T11:07:41.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4440c72f0 con 0x7ff4440d2250 2024-01-20T11:07:41.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f063ea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0638053c70 0x7f0638174310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f063fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06380df220 0x7f063804a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f063fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06380df220 0x7f063804a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42740/0 (socket says 172.21.15.162:42740) 2024-01-20T11:07:41.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7fd4f6a00640 1 -- 172.21.15.162:0/1085123361 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8003b70 con 0x7fd500165690 2024-01-20T11:07:41.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f063fe00640 1 -- 172.21.15.162:0/1004422079 learned_addr learned my addr 172.21.15.162:0/1004422079 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06380e2760 con 0x7f0638053c70 2024-01-20T11:07:41.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7f164e400640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400ead00 0x7f1640035b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd500152dd0 con 0x7fd500165690 2024-01-20T11:07:41.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5001500b0 con 0x7fd500165690 2024-01-20T11:07:41.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7f6871600640 1 -- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f686400a520 msgr2=0x7f686404fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7f6871600640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f686400a520 0x7f686404fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.459+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4440c78b0 con 0x7ff4440d2250 2024-01-20T11:07:41.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7f6871600640 1 -- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 msgr2=0x7f686417fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7f6871600640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f686417fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7f6871600640 1 -- 172.21.15.162:0/2179235067 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c009400 con 0x7f6864051720 2024-01-20T11:07:41.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7fd4f6a00640 1 -- 172.21.15.162:0/1085123361 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8003cd0 con 0x7fd500165690 2024-01-20T11:07:41.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.461+0000 7f164e400640 1 -- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640038110 msgr2=0x7f16400dc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.461+0000 7f164e400640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640038110 0x7f16400dc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.461+0000 7f164e400640 1 -- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164004ffd0 msgr2=0x7f1640034e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.461+0000 7f164e400640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164004ffd0 0x7f1640034e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.461+0000 7f164e400640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380094d0 con 0x7f16400ead00 2024-01-20T11:07:41.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7f6872a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f686417fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:41.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f164d000640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164004ffd0 0x7f1640034e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:07:41.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.461+0000 7f6872000640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f686400a520 0x7f686404fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:41.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f063fe00640 1 -- 172.21.15.162:0/1004422079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0638053c70 msgr2=0x7f0638174310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f063fe00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0638053c70 0x7f0638174310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f063fe00640 1 -- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0638033ef0 msgr2=0x7f0638173dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f063fe00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0638033ef0 0x7f0638173dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f063fe00640 1 -- 172.21.15.162:0/1004422079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280094d0 con 0x7f06380df220 2024-01-20T11:07:41.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.460+0000 7fd4f6a00640 1 -- 172.21.15.162:0/1085123361 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8003b70 con 0x7fd500165690 2024-01-20T11:07:41.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f7d19400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b25e0 0x7f7d140c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f164e400640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400ead00 0x7f1640035b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f164804ee90 tx=0x7f164806b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.461+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d0005290 con 0x7fd500165690 2024-01-20T11:07:41.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f6871600640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6864051720 0x7f68640de530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f685400c4a0 tx=0x7f685400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f1645600640 1 -- 172.21.15.162:0/1504234267 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648092600 con 0x7f16400ead00 2024-01-20T11:07:41.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f1645600640 1 -- 172.21.15.162:0/1504234267 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648092780 con 0x7f16400ead00 2024-01-20T11:07:41.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f1645600640 1 -- 172.21.15.162:0/1504234267 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648092b30 con 0x7f16400ead00 2024-01-20T11:07:41.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7f7d19400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ced20 0x7f7d141523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d19400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140cfde0 0x7f7d1414c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400dc5a0 con 0x7f16400ead00 2024-01-20T11:07:41.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d19400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140cce00 con 0x7f7d140ced20 2024-01-20T11:07:41.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d19400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140cd350 con 0x7f7d140cfde0 2024-01-20T11:07:41.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d19400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140c7080 con 0x7f7d140b25e0 2024-01-20T11:07:41.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f686a000640 1 -- 172.21.15.162:0/2179235067 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854005ce0 con 0x7f6864051720 2024-01-20T11:07:41.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f686a000640 1 -- 172.21.15.162:0/2179235067 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6854005e40 con 0x7f6864051720 2024-01-20T11:07:41.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f686a000640 1 -- 172.21.15.162:0/2179235067 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854007270 con 0x7f6864051720 2024-01-20T11:07:41.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68640506c0 con 0x7f6864051720 2024-01-20T11:07:41.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400e5b20 con 0x7f16400ead00 2024-01-20T11:07:41.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d12800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b25e0 0x7f7d140c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7fd4f6a00640 1 -- 172.21.15.162:0/1085123361 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd4f80050d0 con 0x7fd500165690 2024-01-20T11:07:41.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6864050c80 con 0x7f6864051720 2024-01-20T11:07:41.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d13200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140cfde0 0x7f7d1414c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d13200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140cfde0 0x7f7d1414c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:42752/0 (socket says 172.21.15.162:42752) 2024-01-20T11:07:41.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d13200640 1 -- 172.21.15.162:0/3132031538 learned_addr learned my addr 172.21.15.162:0/3132031538 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:41.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.464+0000 7f063fe00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06380df220 0x7f063804a660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f063000c3e0 tx=0x7f063000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.462+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff414005290 con 0x7ff4440d2250 2024-01-20T11:07:41.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.464+0000 7f7d13200640 1 -- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b25e0 msgr2=0x7f7d140c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.464+0000 7f7d13200640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b25e0 0x7f7d140c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.464+0000 7f7d13200640 1 -- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ced20 msgr2=0x7f7d141523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.464+0000 7f7d12800640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b25e0 0x7f7d140c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:41.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.464+0000 7ff43aa00640 1 -- 172.21.15.162:0/2418133225 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff42c003cd0 con 0x7ff4440d2250 2024-01-20T11:07:41.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.463+0000 7f7d11e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ced20 0x7f7d141523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6864051140 con 0x7f6864051720 2024-01-20T11:07:41.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.464+0000 7f0637400640 1 -- 172.21.15.162:0/1004422079 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300074e0 con 0x7f06380df220 2024-01-20T11:07:41.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16400e6020 con 0x7f16400ead00 2024-01-20T11:07:41.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7f7d13200640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ced20 0x7f7d141523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7f7d13200640 1 -- 172.21.15.162:0/3132031538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0094d0 con 0x7f7d140cfde0 2024-01-20T11:07:41.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063804d880 con 0x7f06380df220 2024-01-20T11:07:41.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063804de40 con 0x7f06380df220 2024-01-20T11:07:41.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7f7d11e00640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ced20 0x7f7d141523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:41.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.466+0000 7f0637400640 1 -- 172.21.15.162:0/1004422079 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630007640 con 0x7f06380df220 2024-01-20T11:07:41.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.466+0000 7f0637400640 1 -- 172.21.15.162:0/1004422079 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300049e0 con 0x7f06380df220 2024-01-20T11:07:41.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.466+0000 7f7d13200640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140cfde0 0x7f7d1414c460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009fd0 tx=0x7f7d0c00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.466+0000 7ff43aa00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff41c06aed0 0x7ff41c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.465+0000 7fd4f6a00640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4d806af30 0x7fd4d806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.466+0000 7fd4fea00640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4d806af30 0x7fd4d806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7fd4f6a00640 1 -- 172.21.15.162:0/1085123361 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4f8088eb0 con 0x7fd500165690 2024-01-20T11:07:41.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7f7d0aa00640 1 -- 172.21.15.162:0/3132031538 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011830 con 0x7f7d140cfde0 2024-01-20T11:07:41.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d140cd070 con 0x7f7d140cfde0 2024-01-20T11:07:41.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d140c7600 con 0x7f7d140cfde0 2024-01-20T11:07:41.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7ff43aa00640 1 -- 172.21.15.162:0/2418133225 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff42c042070 con 0x7ff4440d2250 2024-01-20T11:07:41.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7f7d0aa00640 1 -- 172.21.15.162:0/3132031538 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c011990 con 0x7f7d140cfde0 2024-01-20T11:07:41.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7f7d0aa00640 1 -- 172.21.15.162:0/3132031538 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011830 con 0x7f7d140cfde0 2024-01-20T11:07:41.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.467+0000 7fd4fea00640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4d806af30 0x7fd4d806d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007fd0 tx=0x7fd4e8007d60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.468+0000 7ff442a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff41c06aed0 0x7ff41c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.469+0000 7ff442a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff41c06aed0 0x7ff41c06d390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff434007fd0 tx=0x7ff434007dc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.468+0000 7f1645600640 1 -- 172.21.15.162:0/1504234267 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1648092c90 con 0x7f16400ead00 2024-01-20T11:07:41.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.469+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce4005290 con 0x7f7d140cfde0 2024-01-20T11:07:41.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.470+0000 7f0637400640 1 -- 172.21.15.162:0/1004422079 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0630004b40 con 0x7f06380df220 2024-01-20T11:07:41.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.468+0000 7f686a000640 1 -- 172.21.15.162:0/2179235067 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6854007490 con 0x7f6864051720 2024-01-20T11:07:41.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.470+0000 7f686a000640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f684406afa0 0x7f684406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.470+0000 7f686a000640 1 -- 172.21.15.162:0/2179235067 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6854088fd0 con 0x7f6864051720 2024-01-20T11:07:41.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.470+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610005290 con 0x7f06380df220 2024-01-20T11:07:41.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.471+0000 7f1645600640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f162006af20 0x7f162006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.471+0000 7f6872000640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f684406afa0 0x7f684406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.471+0000 7f1645600640 1 -- 172.21.15.162:0/1504234267 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1648102fe0 con 0x7f16400ead00 2024-01-20T11:07:41.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.471+0000 7f0637400640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f061806aed0 0x7f061806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.471+0000 7f0637400640 1 -- 172.21.15.162:0/1004422079 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0630089470 con 0x7f06380df220 2024-01-20T11:07:41.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.471+0000 7f7d0aa00640 1 -- 172.21.15.162:0/3132031538 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7d0c011b00 con 0x7f7d140cfde0 2024-01-20T11:07:41.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.472+0000 7f164da00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f162006af20 0x7f162006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.472+0000 7f7d0aa00640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7cec06af60 0x7f7cec06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:41.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.472+0000 7f7d0aa00640 1 -- 172.21.15.162:0/3132031538 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d0c088f50 con 0x7f7d140cfde0 2024-01-20T11:07:41.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.473+0000 7f7d12800640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7cec06af60 0x7f7cec06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.473+0000 7f063f400640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f061806aed0 0x7f061806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:41.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.473+0000 7f063f400640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f061806aed0 0x7f061806d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f064004fbe0 tx=0x7f064006d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.473+0000 7f6872000640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f684406afa0 0x7f684406d460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f685c036000 tx=0x7f685c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.474+0000 7f7d12800640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7cec06af60 0x7f7cec06d420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc036000 tx=0x7f7cfc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.474+0000 7f164da00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f162006af20 0x7f162006d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f163802b970 tx=0x7f163803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:41.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.475+0000 7fd4f6a00640 1 -- 172.21.15.162:0/1085123361 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd4f8053e10 con 0x7fd500165690 2024-01-20T11:07:41.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.479+0000 7ff43aa00640 1 -- 172.21.15.162:0/2418133225 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff42c0768b0 con 0x7ff4440d2250 2024-01-20T11:07:41.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.482+0000 7f1645600640 1 -- 172.21.15.162:0/1504234267 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f16480cdfd0 con 0x7f16400ead00 2024-01-20T11:07:41.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.485+0000 7f0637400640 1 -- 172.21.15.162:0/1004422079 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f06300542b0 con 0x7f06380df220 2024-01-20T11:07:41.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.494+0000 7f686a000640 1 -- 172.21.15.162:0/2179235067 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6854053fc0 con 0x7f6864051720 2024-01-20T11:07:41.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.498+0000 7f7d0aa00640 1 -- 172.21.15.162:0/3132031538 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7d0c0578a0 con 0x7f7d140cfde0 2024-01-20T11:07:41.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.803+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c0004e970 con 0x7f4c0015d800 2024-01-20T11:07:41.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.804+0000 7f4bf7400640 1 -- 172.21.15.162:0/1958374498 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4be80539c0 con 0x7f4c0015d800 2024-01-20T11:07:41.805 INFO:teuthology.orchestra.run.smithi162.stdout:60129542151 2024-01-20T11:07:41.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.808+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4bd806aed0 msgr2=0x7f4bd806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.808+0000 7f4c06600640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4bd806aed0 0x7f4bd806d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8007fd0 tx=0x7f4bf8009040 comp rx=0 tx=0).stop 2024-01-20T11:07:41.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.808+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c0015d800 msgr2=0x7f4c00156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.808+0000 7f4c06600640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c0015d800 0x7f4c00156e60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c5c0 tx=0x7f4be800ca80 comp rx=0 tx=0).stop 2024-01-20T11:07:41.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.809+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 shutdown_connections 2024-01-20T11:07:41.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.809+0000 7f4c06600640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c0015d800 0x7f4c00156e60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.809+0000 7f4c06600640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c000d1fc0 0x7f4c000b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.809+0000 7f4c06600640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4bd806aed0 0x7f4bd806d390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.809+0000 7f4c06600640 1 --2- 172.21.15.162:0/1958374498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c000b5690 0x7f4c002030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.809+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 >> 172.21.15.162:0/1958374498 conn(0x7f4c0009c7b0 msgr2=0x7f4c0015ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.809+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 shutdown_connections 2024-01-20T11:07:41.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.810+0000 7f4c06600640 1 -- 172.21.15.162:0/1958374498 wait complete. 2024-01-20T11:07:41.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.3 2024-01-20T11:07:41.835 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.860+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4d0005810 con 0x7fd500165690 2024-01-20T11:07:41.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.861+0000 7fd4f6a00640 1 -- 172.21.15.162:0/1085123361 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4f8001780 con 0x7fd500165690 2024-01-20T11:07:41.861 INFO:teuthology.orchestra.run.smithi162.stdout:60129542149 2024-01-20T11:07:41.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.862+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbe3c005810 con 0x7fbe6404ffd0 2024-01-20T11:07:41.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.863+0000 7fbe69600640 1 -- 172.21.15.162:0/3736235836 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe54017020 con 0x7fbe6404ffd0 2024-01-20T11:07:41.863 INFO:teuthology.orchestra.run.smithi162.stdout:60129542150 2024-01-20T11:07:41.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.863+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4d806af30 msgr2=0x7fd4d806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.863+0000 7fd505800640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4d806af30 0x7fd4d806d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007fd0 tx=0x7fd4e8007d60 comp rx=0 tx=0).stop 2024-01-20T11:07:41.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.863+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd500165690 msgr2=0x7fd50014efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.863+0000 7fd505800640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd500165690 0x7fd50014efb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800c690 tx=0x7fd4f800cb50 comp rx=0 tx=0).stop 2024-01-20T11:07:41.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.864+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 shutdown_connections 2024-01-20T11:07:41.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.864+0000 7fd505800640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd500165690 0x7fd50014efb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.864+0000 7fd505800640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd500161b80 0x7fd50014ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.864+0000 7fd505800640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4d806af30 0x7fd4d806d3f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.864+0000 7fd505800640 1 --2- 172.21.15.162:0/1085123361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5000cefe0 0x7fd500152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.864+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 >> 172.21.15.162:0/1085123361 conn(0x7fd50006a600 msgr2=0x7fd500164030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.866+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 shutdown_connections 2024-01-20T11:07:41.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.866+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe4406afa0 msgr2=0x7fbe4406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.866+0000 7fbe73000640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe4406afa0 0x7fbe4406d460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0079a0 tx=0x7fbe5c008040 comp rx=0 tx=0).stop 2024-01-20T11:07:41.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.866+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe6404ffd0 msgr2=0x7fbe641a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.866+0000 7fbe73000640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe6404ffd0 0x7fbe641a2620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c780 tx=0x7fbe5400cc40 comp rx=0 tx=0).stop 2024-01-20T11:07:41.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.866+0000 7fd505800640 1 -- 172.21.15.162:0/1085123361 wait complete. 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 shutdown_connections 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe640ead00 0x7fbe641a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe6404ffd0 0x7fbe641a2620 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe4406afa0 0x7fbe4406d460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 --2- 172.21.15.162:0/3736235836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe64006ea0 0x7fbe64033a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 >> 172.21.15.162:0/3736235836 conn(0x7fbe64009fb0 msgr2=0x7fbe64004930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 shutdown_connections 2024-01-20T11:07:41.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.867+0000 7fbe73000640 1 -- 172.21.15.162:0/3736235836 wait complete. 2024-01-20T11:07:41.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.1 2024-01-20T11:07:41.884 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.884+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1640005390 con 0x7f16400ead00 2024-01-20T11:07:41.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.885+0000 7f1645600640 1 -- 172.21.15.162:0/1504234267 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16480d15f0 con 0x7f16400ead00 2024-01-20T11:07:41.885 INFO:teuthology.orchestra.run.smithi162.stdout:60129542152 2024-01-20T11:07:41.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f162006af20 msgr2=0x7f162006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f162006af20 0x7f162006d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f163802b970 tx=0x7f163803c040 comp rx=0 tx=0).stop 2024-01-20T11:07:41.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400ead00 msgr2=0x7f1640035b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400ead00 0x7f1640035b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f164804ee90 tx=0x7f164806b9e0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 shutdown_connections 2024-01-20T11:07:41.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400ead00 0x7f1640035b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f164004ffd0 0x7f1640034e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f162006af20 0x7f162006d3e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 --2- 172.21.15.162:0/1504234267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640038110 0x7f16400dc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.887+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 >> 172.21.15.162:0/1504234267 conn(0x7f1640009fb0 msgr2=0x7f1640048b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.888+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 shutdown_connections 2024-01-20T11:07:41.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.888+0000 7f164ee00640 1 -- 172.21.15.162:0/1504234267 wait complete. 2024-01-20T11:07:41.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.4 2024-01-20T11:07:41.893 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.893+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff414005810 con 0x7ff4440d2250 2024-01-20T11:07:41.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.894+0000 7ff43aa00640 1 -- 172.21.15.162:0/2418133225 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff42c006e10 con 0x7ff4440d2250 2024-01-20T11:07:41.895 INFO:teuthology.orchestra.run.smithi162.stdout:60129542150 2024-01-20T11:07:41.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff41c06aed0 msgr2=0x7ff41c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff41c06aed0 0x7ff41c06d390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff434007fd0 tx=0x7ff434007dc0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4440d2250 msgr2=0x7ff4440c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4440d2250 0x7ff4440c7dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff42c034040 tx=0x7ff42c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0610005540 con 0x7f06380df220 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 shutdown_connections 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44415d5a0 0x7ff44415ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4440d2250 0x7ff4440c7dd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff41c06aed0 0x7ff41c06d390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.897+0000 7ff449a00640 1 --2- 172.21.15.162:0/2418133225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4440d0400 0x7ff44414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.898+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 >> 172.21.15.162:0/2418133225 conn(0x7ff444066760 msgr2=0x7ff4440cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.898+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 shutdown_connections 2024-01-20T11:07:41.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.898+0000 7ff449a00640 1 -- 172.21.15.162:0/2418133225 wait complete. 2024-01-20T11:07:41.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.898+0000 7f0637400640 1 -- 172.21.15.162:0/1004422079 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06300578d0 con 0x7f06380df220 2024-01-20T11:07:41.900 INFO:teuthology.orchestra.run.smithi162.stdout:60129542151 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f061806aed0 msgr2=0x7f061806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f061806aed0 0x7f061806d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f064004fbe0 tx=0x7f064006d040 comp rx=0 tx=0).stop 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06380df220 msgr2=0x7f063804a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06380df220 0x7f063804a660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f063000c3e0 tx=0x7f063000c8a0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 shutdown_connections 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f061806aed0 0x7f061806d390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06380df220 0x7f063804a660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0638053c70 0x7f0638174310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 --2- 172.21.15.162:0/1004422079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0638033ef0 0x7f0638173dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 >> 172.21.15.162:0/1004422079 conn(0x7f0638009fb0 msgr2=0x7f063804fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 shutdown_connections 2024-01-20T11:07:41.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.901+0000 7f0644c00640 1 -- 172.21.15.162:0/1004422079 wait complete. 2024-01-20T11:07:41.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.5 2024-01-20T11:07:41.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.912+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ce4005540 con 0x7f7d140cfde0 2024-01-20T11:07:41.913 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.913+0000 7f7d0aa00640 1 -- 172.21.15.162:0/3132031538 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d0c057430 con 0x7f7d140cfde0 2024-01-20T11:07:41.913 INFO:teuthology.orchestra.run.smithi162.stdout:60129542150 2024-01-20T11:07:41.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6864053030 con 0x7f6864051720 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7cec06af60 msgr2=0x7f7cec06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7cec06af60 0x7f7cec06d420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc036000 tx=0x7f7cfc03b040 comp rx=0 tx=0).stop 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140cfde0 msgr2=0x7f7d1414c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140cfde0 0x7f7d1414c460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009fd0 tx=0x7f7d0c00b8e0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 shutdown_connections 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7cec06af60 0x7f7cec06d420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d140cfde0 0x7f7d1414c460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ced20 0x7f7d141523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 --2- 172.21.15.162:0/3132031538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b25e0 0x7f7d140c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 >> 172.21.15.162:0/3132031538 conn(0x7f7d1409c7d0 msgr2=0x7f7d1406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 shutdown_connections 2024-01-20T11:07:41.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.915+0000 7f7d19400640 1 -- 172.21.15.162:0/3132031538 wait complete. 2024-01-20T11:07:41.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.916+0000 7f686a000640 1 -- 172.21.15.162:0/2179235067 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6854017090 con 0x7f6864051720 2024-01-20T11:07:41.917 INFO:teuthology.orchestra.run.smithi162.stdout:60129542150 2024-01-20T11:07:41.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f684406afa0 msgr2=0x7f684406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f684406afa0 0x7f684406d460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f685c036000 tx=0x7f685c03d040 comp rx=0 tx=0).stop 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6864051720 msgr2=0x7f68640de530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6864051720 0x7f68640de530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f685400c4a0 tx=0x7f685400c960 comp rx=0 tx=0).stop 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 shutdown_connections 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640e59b0 0x7f686417fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6864051720 0x7f68640de530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f684406afa0 0x7f684406d460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 --2- 172.21.15.162:0/2179235067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f686400a520 0x7f686404fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:41.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 >> 172.21.15.162:0/2179235067 conn(0x7f68640537b0 msgr2=0x7f6864009780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:41.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 shutdown_connections 2024-01-20T11:07:41.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:41.919+0000 7f6874a00640 1 -- 172.21.15.162:0/2179235067 wait complete. 2024-01-20T11:07:41.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.6 2024-01-20T11:07:41.922 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.7 2024-01-20T11:07:41.922 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.2 2024-01-20T11:07:41.934 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.0 2024-01-20T11:07:41.937 DEBUG:teuthology.parallel:result is None 2024-01-20T11:07:41.937 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-20T11:07:41.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:07:42.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.181+0000 7f3144c00640 1 Processor -- start 2024-01-20T11:07:42.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.181+0000 7f3144c00640 1 -- start start 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f3144c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3140157b70 0x7f314015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f3144c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31400b3360 0x7f31400cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f3144c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400b2150 con 0x7f31400cf370 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f3144c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31400cfd60 con 0x7f3140157b70 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f3144c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3140157f50 con 0x7f31400b3360 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f313f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3140157b70 0x7f314015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f313f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3140157b70 0x7f314015e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41502/0 (socket says 172.21.15.162:41502) 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.183+0000 7f313f400640 1 -- 172.21.15.162:0/4028120875 learned_addr learned my addr 172.21.15.162:0/4028120875 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:42.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.184+0000 7f313fe00640 1 --2- 172.21.15.162:0/4028120875 >> v2:172.21.15.179:3300/0 conn(0x7f31400b3360 0x7f31400cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.184+0000 7f313f400640 1 -- 172.21.15.162:0/4028120875 >> v2:172.21.15.179:3300/0 conn(0x7f31400b3360 msgr2=0x7f31400cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:42.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.184+0000 7f313f400640 1 --2- 172.21.15.162:0/4028120875 >> v2:172.21.15.179:3300/0 conn(0x7f31400b3360 0x7f31400cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.184+0000 7f313f400640 1 -- 172.21.15.162:0/4028120875 >> v1:172.21.15.179:6789/0 conn(0x7f31400cf370 legacy=0x7f314006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:42.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.184+0000 7f313f400640 1 -- 172.21.15.162:0/4028120875 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314015ea00 con 0x7f3140157b70 2024-01-20T11:07:42.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.185+0000 7f313f400640 1 --2- 172.21.15.162:0/4028120875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3140157b70 0x7f314015e4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f314006dff0 tx=0x7f313002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e71dd4c314714 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:42.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.185+0000 7f313ea00640 1 -- 172.21.15.162:0/4028120875 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130031870 con 0x7f3140157b70 2024-01-20T11:07:42.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f313ea00640 1 -- 172.21.15.162:0/4028120875 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31300319d0 con 0x7f3140157b70 2024-01-20T11:07:42.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f313ea00640 1 -- 172.21.15.162:0/4028120875 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130031d60 con 0x7f3140157b70 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 -- 172.21.15.162:0/4028120875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3140157b70 msgr2=0x7f314015e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 --2- 172.21.15.162:0/4028120875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3140157b70 0x7f314015e4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f314006dff0 tx=0x7f313002b910 comp rx=0 tx=0).stop 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 -- 172.21.15.162:0/4028120875 shutdown_connections 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 --2- 172.21.15.162:0/4028120875 >> v2:172.21.15.179:3300/0 conn(0x7f31400b3360 0x7f31400cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 --2- 172.21.15.162:0/4028120875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3140157b70 0x7f314015e4c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 -- 172.21.15.162:0/4028120875 >> 172.21.15.162:0/4028120875 conn(0x7f314006aa20 msgr2=0x7f314006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 -- 172.21.15.162:0/4028120875 shutdown_connections 2024-01-20T11:07:42.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.186+0000 7f3144c00640 1 -- 172.21.15.162:0/4028120875 wait complete. 2024-01-20T11:07:42.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.188+0000 7f3144c00640 1 Processor -- start 2024-01-20T11:07:42.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.188+0000 7f3144c00640 1 -- start start 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3144c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31400b3360 0x7f3140152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3144c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31400cf370 0x7f314013dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3144c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3140157b70 0x7f3140150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3144c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31400afbd0 con 0x7f31400cf370 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3144c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314013e020 con 0x7f3140157b70 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3144c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140152c10 con 0x7f31400b3360 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3137e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31400cf370 0x7f314013dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3137e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31400cf370 0x7f314013dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41504/0 (socket says 172.21.15.162:41504) 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.189+0000 7f3137e00640 1 -- 172.21.15.162:0/608286822 learned_addr learned my addr 172.21.15.162:0/608286822 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f313f400640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31400b3360 0x7f3140152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f313fe00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3140157b70 0x7f3140150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137e00640 1 -- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31400b3360 msgr2=0x7f3140152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137e00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31400b3360 0x7f3140152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137e00640 1 -- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3140157b70 msgr2=0x7f3140150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137e00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3140157b70 0x7f3140150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137e00640 1 -- 172.21.15.162:0/608286822 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300094d0 con 0x7f31400cf370 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137e00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31400cf370 0x7f314013dae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f312800c430 tx=0x7f312800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137400640 1 -- 172.21.15.162:0/608286822 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128011790 con 0x7f31400cf370 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137400640 1 -- 172.21.15.162:0/608286822 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31280118f0 con 0x7f31400cf370 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3137400640 1 -- 172.21.15.162:0/608286822 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128011ce0 con 0x7f31400cf370 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3140152ef0 con 0x7f31400cf370 2024-01-20T11:07:42.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.190+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31400af860 con 0x7f31400cf370 2024-01-20T11:07:42.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.192+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31400afd80 con 0x7f31400cf370 2024-01-20T11:07:42.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.192+0000 7f3137400640 1 -- 172.21.15.162:0/608286822 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f312801c460 con 0x7f31400cf370 2024-01-20T11:07:42.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.193+0000 7f3137400640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f311806af00 0x7f311806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.193+0000 7f3137400640 1 -- 172.21.15.162:0/608286822 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31280896e0 con 0x7f31400cf370 2024-01-20T11:07:42.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.193+0000 7f313f400640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f311806af00 0x7f311806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.194+0000 7f313f400640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f311806af00 0x7f311806d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3130036000 tx=0x7f313003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:42.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.197+0000 7f3137400640 1 -- 172.21.15.162:0/608286822 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3128054480 con 0x7f31400cf370 2024-01-20T11:07:42.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.373+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3140070c00 con 0x7f311806af00 2024-01-20T11:07:42.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.382+0000 7f3137400640 1 -- 172.21.15.162:0/608286822 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264292 (secure 0 0 0) 0x7f3130031bc0 con 0x7f311806af00 2024-01-20T11:07:42.385 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:42.389 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:07:42.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f311806af00 msgr2=0x7f311806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f311806af00 0x7f311806d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3130036000 tx=0x7f313003c040 comp rx=0 tx=0).stop 2024-01-20T11:07:42.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31400cf370 msgr2=0x7f314013dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31400cf370 0x7f314013dae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f312800c430 tx=0x7f312800c8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 shutdown_connections 2024-01-20T11:07:42.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f311806af00 0x7f311806d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3140157b70 0x7f3140150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31400cf370 0x7f314013dae0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 --2- 172.21.15.162:0/608286822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31400b3360 0x7f3140152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.390+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 >> 172.21.15.162:0/608286822 conn(0x7f314006aa20 msgr2=0x7f31400ad5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:42.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.391+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 shutdown_connections 2024-01-20T11:07:42.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.391+0000 7f3144c00640 1 -- 172.21.15.162:0/608286822 wait complete. 2024-01-20T11:07:42.410 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-20T11:07:41.583897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219364,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755356,"statfs":{"total":773094113280,"available":772869484544,"internally_reserved":0,"allocated":3055616,"data_stored":1815380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.120732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498954+0000","last_change":"2024-01-20T11:07:32.511393+0000","last_active":"2024-01-20T11:07:33.498954+0000","last_peered":"2024-01-20T11:07:33.498954+0000","last_clean":"2024-01-20T11:07:33.498954+0000","last_became_active":"2024-01-20T11:07:32.511094+0000","last_became_peered":"2024-01-20T11:07:32.511094+0000","last_unstale":"2024-01-20T11:07:33.498954+0000","last_undegraded":"2024-01-20T11:07:33.498954+0000","last_fullsized":"2024-01-20T11:07:33.498954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160365+0000","last_change":"2024-01-20T11:07:32.495713+0000","last_active":"2024-01-20T11:07:34.160365+0000","last_peered":"2024-01-20T11:07:34.160365+0000","last_clean":"2024-01-20T11:07:34.160365+0000","last_became_active":"2024-01-20T11:07:32.495487+0000","last_became_peered":"2024-01-20T11:07:32.495487+0000","last_unstale":"2024-01-20T11:07:34.160365+0000","last_undegraded":"2024-01-20T11:07:34.160365+0000","last_fullsized":"2024-01-20T11:07:34.160365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:21.564586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806650+0000","last_change":"2024-01-20T11:07:32.481755+0000","last_active":"2024-01-20T11:07:34.806650+0000","last_peered":"2024-01-20T11:07:34.806650+0000","last_clean":"2024-01-20T11:07:34.806650+0000","last_became_active":"2024-01-20T11:07:32.481213+0000","last_became_peered":"2024-01-20T11:07:32.481213+0000","last_unstale":"2024-01-20T11:07:34.806650+0000","last_undegraded":"2024-01-20T11:07:34.806650+0000","last_fullsized":"2024-01-20T11:07:34.806650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501649+0000","last_change":"2024-01-20T11:07:32.502344+0000","last_active":"2024-01-20T11:07:33.501649+0000","last_peered":"2024-01-20T11:07:33.501649+0000","last_clean":"2024-01-20T11:07:33.501649+0000","last_became_active":"2024-01-20T11:07:32.502037+0000","last_became_peered":"2024-01-20T11:07:32.502037+0000","last_unstale":"2024-01-20T11:07:33.501649+0000","last_undegraded":"2024-01-20T11:07:33.501649+0000","last_fullsized":"2024-01-20T11:07:33.501649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498895+0000","last_change":"2024-01-20T11:07:32.511019+0000","last_active":"2024-01-20T11:07:33.498895+0000","last_peered":"2024-01-20T11:07:33.498895+0000","last_clean":"2024-01-20T11:07:33.498895+0000","last_became_active":"2024-01-20T11:07:32.509419+0000","last_became_peered":"2024-01-20T11:07:32.509419+0000","last_unstale":"2024-01-20T11:07:33.498895+0000","last_undegraded":"2024-01-20T11:07:33.498895+0000","last_fullsized":"2024-01-20T11:07:33.498895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500988+0000","last_change":"2024-01-20T11:07:32.500145+0000","last_active":"2024-01-20T11:07:33.500988+0000","last_peered":"2024-01-20T11:07:33.500988+0000","last_clean":"2024-01-20T11:07:33.500988+0000","last_became_active":"2024-01-20T11:07:32.499948+0000","last_became_peered":"2024-01-20T11:07:32.499948+0000","last_unstale":"2024-01-20T11:07:33.500988+0000","last_undegraded":"2024-01-20T11:07:33.500988+0000","last_fullsized":"2024-01-20T11:07:33.500988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498132+0000","last_change":"2024-01-20T11:07:32.509101+0000","last_active":"2024-01-20T11:07:33.498132+0000","last_peered":"2024-01-20T11:07:33.498132+0000","last_clean":"2024-01-20T11:07:33.498132+0000","last_became_active":"2024-01-20T11:07:32.508125+0000","last_became_peered":"2024-01-20T11:07:32.508125+0000","last_unstale":"2024-01-20T11:07:33.498132+0000","last_undegraded":"2024-01-20T11:07:33.498132+0000","last_fullsized":"2024-01-20T11:07:33.498132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307168+0000","last_change":"2024-01-20T11:07:32.508785+0000","last_active":"2024-01-20T11:07:34.307168+0000","last_peered":"2024-01-20T11:07:34.307168+0000","last_clean":"2024-01-20T11:07:34.307168+0000","last_became_active":"2024-01-20T11:07:32.508563+0000","last_became_peered":"2024-01-20T11:07:32.508563+0000","last_unstale":"2024-01-20T11:07:34.307168+0000","last_undegraded":"2024-01-20T11:07:34.307168+0000","last_fullsized":"2024-01-20T11:07:34.307168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499139+0000","last_change":"2024-01-20T11:07:32.521686+0000","last_active":"2024-01-20T11:07:33.499139+0000","last_peered":"2024-01-20T11:07:33.499139+0000","last_clean":"2024-01-20T11:07:33.499139+0000","last_became_active":"2024-01-20T11:07:32.521333+0000","last_became_peered":"2024-01-20T11:07:32.521333+0000","last_unstale":"2024-01-20T11:07:33.499139+0000","last_undegraded":"2024-01-20T11:07:33.499139+0000","last_fullsized":"2024-01-20T11:07:33.499139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390247+0000","last_change":"2024-01-20T11:07:32.511433+0000","last_active":"2024-01-20T11:07:34.390247+0000","last_peered":"2024-01-20T11:07:34.390247+0000","last_clean":"2024-01-20T11:07:34.390247+0000","last_became_active":"2024-01-20T11:07:32.507192+0000","last_became_peered":"2024-01-20T11:07:32.507192+0000","last_unstale":"2024-01-20T11:07:34.390247+0000","last_undegraded":"2024-01-20T11:07:34.390247+0000","last_fullsized":"2024-01-20T11:07:34.390247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389662+0000","last_change":"2024-01-20T11:07:32.510460+0000","last_active":"2024-01-20T11:07:34.389662+0000","last_peered":"2024-01-20T11:07:34.389662+0000","last_clean":"2024-01-20T11:07:34.389662+0000","last_became_active":"2024-01-20T11:07:32.510165+0000","last_became_peered":"2024-01-20T11:07:32.510165+0000","last_unstale":"2024-01-20T11:07:34.389662+0000","last_undegraded":"2024-01-20T11:07:34.389662+0000","last_fullsized":"2024-01-20T11:07:34.389662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809847+0000","last_change":"2024-01-20T11:07:32.507297+0000","last_active":"2024-01-20T11:07:34.809847+0000","last_peered":"2024-01-20T11:07:34.809847+0000","last_clean":"2024-01-20T11:07:34.809847+0000","last_became_active":"2024-01-20T11:07:32.505550+0000","last_became_peered":"2024-01-20T11:07:32.505550+0000","last_unstale":"2024-01-20T11:07:34.809847+0000","last_undegraded":"2024-01-20T11:07:34.809847+0000","last_fullsized":"2024-01-20T11:07:34.809847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.007672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307927+0000","last_change":"2024-01-20T11:07:32.499378+0000","last_active":"2024-01-20T11:07:34.307927+0000","last_peered":"2024-01-20T11:07:34.307927+0000","last_clean":"2024-01-20T11:07:34.307927+0000","last_became_active":"2024-01-20T11:07:32.498514+0000","last_became_peered":"2024-01-20T11:07:32.498514+0000","last_unstale":"2024-01-20T11:07:34.307927+0000","last_undegraded":"2024-01-20T11:07:34.307927+0000","last_fullsized":"2024-01-20T11:07:34.307927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806348+0000","last_change":"2024-01-20T11:07:32.494967+0000","last_active":"2024-01-20T11:07:34.806348+0000","last_peered":"2024-01-20T11:07:34.806348+0000","last_clean":"2024-01-20T11:07:34.806348+0000","last_became_active":"2024-01-20T11:07:32.494120+0000","last_became_peered":"2024-01-20T11:07:32.494120+0000","last_unstale":"2024-01-20T11:07:34.806348+0000","last_undegraded":"2024-01-20T11:07:34.806348+0000","last_fullsized":"2024-01-20T11:07:34.806348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:52.043273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.491525+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491262+0000","last_became_peered":"2024-01-20T11:07:32.491262+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:52.065195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500692+0000","last_change":"2024-01-20T11:07:32.500042+0000","last_active":"2024-01-20T11:07:33.500692+0000","last_peered":"2024-01-20T11:07:33.500692+0000","last_clean":"2024-01-20T11:07:33.500692+0000","last_became_active":"2024-01-20T11:07:32.499808+0000","last_became_peered":"2024-01-20T11:07:32.499808+0000","last_unstale":"2024-01-20T11:07:33.500692+0000","last_undegraded":"2024-01-20T11:07:33.500692+0000","last_fullsized":"2024-01-20T11:07:33.500692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502287+0000","last_change":"2024-01-20T11:07:32.517082+0000","last_active":"2024-01-20T11:07:33.502287+0000","last_peered":"2024-01-20T11:07:33.502287+0000","last_clean":"2024-01-20T11:07:33.502287+0000","last_became_active":"2024-01-20T11:07:32.516792+0000","last_became_peered":"2024-01-20T11:07:32.516792+0000","last_unstale":"2024-01-20T11:07:33.502287+0000","last_undegraded":"2024-01-20T11:07:33.502287+0000","last_fullsized":"2024-01-20T11:07:33.502287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498121+0000","last_change":"2024-01-20T11:07:32.496924+0000","last_active":"2024-01-20T11:07:33.498121+0000","last_peered":"2024-01-20T11:07:33.498121+0000","last_clean":"2024-01-20T11:07:33.498121+0000","last_became_active":"2024-01-20T11:07:32.496711+0000","last_became_peered":"2024-01-20T11:07:32.496711+0000","last_unstale":"2024-01-20T11:07:33.498121+0000","last_undegraded":"2024-01-20T11:07:33.498121+0000","last_fullsized":"2024-01-20T11:07:33.498121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:50.078866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499802+0000","last_change":"2024-01-20T11:07:32.509963+0000","last_active":"2024-01-20T11:07:33.499802+0000","last_peered":"2024-01-20T11:07:33.499802+0000","last_clean":"2024-01-20T11:07:33.499802+0000","last_became_active":"2024-01-20T11:07:32.509355+0000","last_became_peered":"2024-01-20T11:07:32.509355+0000","last_unstale":"2024-01-20T11:07:33.499802+0000","last_undegraded":"2024-01-20T11:07:33.499802+0000","last_fullsized":"2024-01-20T11:07:33.499802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:51:48.711512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389493+0000","last_change":"2024-01-20T11:07:32.499797+0000","last_active":"2024-01-20T11:07:34.389493+0000","last_peered":"2024-01-20T11:07:34.389493+0000","last_clean":"2024-01-20T11:07:34.389493+0000","last_became_active":"2024-01-20T11:07:32.499479+0000","last_became_peered":"2024-01-20T11:07:32.499479+0000","last_unstale":"2024-01-20T11:07:34.389493+0000","last_undegraded":"2024-01-20T11:07:34.389493+0000","last_fullsized":"2024-01-20T11:07:34.389493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806454+0000","last_change":"2024-01-20T11:07:32.510484+0000","last_active":"2024-01-20T11:07:34.806454+0000","last_peered":"2024-01-20T11:07:34.806454+0000","last_clean":"2024-01-20T11:07:34.806454+0000","last_became_active":"2024-01-20T11:07:32.510232+0000","last_became_peered":"2024-01-20T11:07:32.510232+0000","last_unstale":"2024-01-20T11:07:34.806454+0000","last_undegraded":"2024-01-20T11:07:34.806454+0000","last_fullsized":"2024-01-20T11:07:34.806454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:51:15.717971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501069+0000","last_change":"2024-01-20T11:07:32.514040+0000","last_active":"2024-01-20T11:07:33.501069+0000","last_peered":"2024-01-20T11:07:33.501069+0000","last_clean":"2024-01-20T11:07:33.501069+0000","last_became_active":"2024-01-20T11:07:32.513752+0000","last_became_peered":"2024-01-20T11:07:32.513752+0000","last_unstale":"2024-01-20T11:07:33.501069+0000","last_undegraded":"2024-01-20T11:07:33.501069+0000","last_fullsized":"2024-01-20T11:07:33.501069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307277+0000","last_change":"2024-01-20T11:07:32.506093+0000","last_active":"2024-01-20T11:07:34.307277+0000","last_peered":"2024-01-20T11:07:34.307277+0000","last_clean":"2024-01-20T11:07:34.307277+0000","last_became_active":"2024-01-20T11:07:32.505824+0000","last_became_peered":"2024-01-20T11:07:32.505824+0000","last_unstale":"2024-01-20T11:07:34.307277+0000","last_undegraded":"2024-01-20T11:07:34.307277+0000","last_fullsized":"2024-01-20T11:07:34.307277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500841+0000","last_change":"2024-01-20T11:07:32.499561+0000","last_active":"2024-01-20T11:07:33.500841+0000","last_peered":"2024-01-20T11:07:33.500841+0000","last_clean":"2024-01-20T11:07:33.500841+0000","last_became_active":"2024-01-20T11:07:32.499132+0000","last_became_peered":"2024-01-20T11:07:32.499132+0000","last_unstale":"2024-01-20T11:07:33.500841+0000","last_undegraded":"2024-01-20T11:07:33.500841+0000","last_fullsized":"2024-01-20T11:07:33.500841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308164+0000","last_change":"2024-01-20T11:07:32.504381+0000","last_active":"2024-01-20T11:07:34.308164+0000","last_peered":"2024-01-20T11:07:34.308164+0000","last_clean":"2024-01-20T11:07:34.308164+0000","last_became_active":"2024-01-20T11:07:32.504077+0000","last_became_peered":"2024-01-20T11:07:32.504077+0000","last_unstale":"2024-01-20T11:07:34.308164+0000","last_undegraded":"2024-01-20T11:07:34.308164+0000","last_fullsized":"2024-01-20T11:07:34.308164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390177+0000","last_change":"2024-01-20T11:07:32.516522+0000","last_active":"2024-01-20T11:07:34.390177+0000","last_peered":"2024-01-20T11:07:34.390177+0000","last_clean":"2024-01-20T11:07:34.390177+0000","last_became_active":"2024-01-20T11:07:32.516166+0000","last_became_peered":"2024-01-20T11:07:32.516166+0000","last_unstale":"2024-01-20T11:07:34.390177+0000","last_undegraded":"2024-01-20T11:07:34.390177+0000","last_fullsized":"2024-01-20T11:07:34.390177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160091+0000","last_change":"2024-01-20T11:07:32.493441+0000","last_active":"2024-01-20T11:07:34.160091+0000","last_peered":"2024-01-20T11:07:34.160091+0000","last_clean":"2024-01-20T11:07:34.160091+0000","last_became_active":"2024-01-20T11:07:32.493167+0000","last_became_peered":"2024-01-20T11:07:32.493167+0000","last_unstale":"2024-01-20T11:07:34.160091+0000","last_undegraded":"2024-01-20T11:07:34.160091+0000","last_fullsized":"2024-01-20T11:07:34.160091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:37:16.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308502+0000","last_change":"2024-01-20T11:07:32.506319+0000","last_active":"2024-01-20T11:07:34.308502+0000","last_peered":"2024-01-20T11:07:34.308502+0000","last_clean":"2024-01-20T11:07:34.308502+0000","last_became_active":"2024-01-20T11:07:32.505816+0000","last_became_peered":"2024-01-20T11:07:32.505816+0000","last_unstale":"2024-01-20T11:07:34.308502+0000","last_undegraded":"2024-01-20T11:07:34.308502+0000","last_fullsized":"2024-01-20T11:07:34.308502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806471+0000","last_change":"2024-01-20T11:07:32.493479+0000","last_active":"2024-01-20T11:07:34.806471+0000","last_peered":"2024-01-20T11:07:34.806471+0000","last_clean":"2024-01-20T11:07:34.806471+0000","last_became_active":"2024-01-20T11:07:32.493225+0000","last_became_peered":"2024-01-20T11:07:32.493225+0000","last_unstale":"2024-01-20T11:07:34.806471+0000","last_undegraded":"2024-01-20T11:07:34.806471+0000","last_fullsized":"2024-01-20T11:07:34.806471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501201+0000","last_change":"2024-01-20T11:07:32.499811+0000","last_active":"2024-01-20T11:07:33.501201+0000","last_peered":"2024-01-20T11:07:33.501201+0000","last_clean":"2024-01-20T11:07:33.501201+0000","last_became_active":"2024-01-20T11:07:32.499484+0000","last_became_peered":"2024-01-20T11:07:32.499484+0000","last_unstale":"2024-01-20T11:07:33.501201+0000","last_undegraded":"2024-01-20T11:07:33.501201+0000","last_fullsized":"2024-01-20T11:07:33.501201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497885+0000","last_change":"2024-01-20T11:07:32.502715+0000","last_active":"2024-01-20T11:07:33.497885+0000","last_peered":"2024-01-20T11:07:33.497885+0000","last_clean":"2024-01-20T11:07:33.497885+0000","last_became_active":"2024-01-20T11:07:32.502450+0000","last_became_peered":"2024-01-20T11:07:32.502450+0000","last_unstale":"2024-01-20T11:07:33.497885+0000","last_undegraded":"2024-01-20T11:07:33.497885+0000","last_fullsized":"2024-01-20T11:07:33.497885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.007672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389175+0000","last_change":"2024-01-20T11:07:32.489772+0000","last_active":"2024-01-20T11:07:34.389175+0000","last_peered":"2024-01-20T11:07:34.389175+0000","last_clean":"2024-01-20T11:07:34.389175+0000","last_became_active":"2024-01-20T11:07:32.489524+0000","last_became_peered":"2024-01-20T11:07:32.489524+0000","last_unstale":"2024-01-20T11:07:34.389175+0000","last_undegraded":"2024-01-20T11:07:34.389175+0000","last_fullsized":"2024-01-20T11:07:34.389175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809351+0000","last_change":"2024-01-20T11:07:32.494072+0000","last_active":"2024-01-20T11:07:34.809351+0000","last_peered":"2024-01-20T11:07:34.809351+0000","last_clean":"2024-01-20T11:07:34.809351+0000","last_became_active":"2024-01-20T11:07:32.493626+0000","last_became_peered":"2024-01-20T11:07:32.493626+0000","last_unstale":"2024-01-20T11:07:34.809351+0000","last_undegraded":"2024-01-20T11:07:34.809351+0000","last_fullsized":"2024-01-20T11:07:34.809351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:30.634124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308311+0000","last_change":"2024-01-20T11:07:31.495270+0000","last_active":"2024-01-20T11:07:34.308311+0000","last_peered":"2024-01-20T11:07:34.308311+0000","last_clean":"2024-01-20T11:07:34.308311+0000","last_became_active":"2024-01-20T11:07:31.494820+0000","last_became_peered":"2024-01-20T11:07:31.494820+0000","last_unstale":"2024-01-20T11:07:34.308311+0000","last_undegraded":"2024-01-20T11:07:34.308311+0000","last_fullsized":"2024-01-20T11:07:34.308311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806587+0000","last_change":"2024-01-20T11:07:32.502657+0000","last_active":"2024-01-20T11:07:34.806587+0000","last_peered":"2024-01-20T11:07:34.806587+0000","last_clean":"2024-01-20T11:07:34.806587+0000","last_became_active":"2024-01-20T11:07:32.502221+0000","last_became_peered":"2024-01-20T11:07:32.502221+0000","last_unstale":"2024-01-20T11:07:34.806587+0000","last_undegraded":"2024-01-20T11:07:34.806587+0000","last_fullsized":"2024-01-20T11:07:34.806587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389440+0000","last_change":"2024-01-20T11:07:31.493668+0000","last_active":"2024-01-20T11:07:34.389440+0000","last_peered":"2024-01-20T11:07:34.389440+0000","last_clean":"2024-01-20T11:07:34.389440+0000","last_became_active":"2024-01-20T11:07:31.493350+0000","last_became_peered":"2024-01-20T11:07:31.493350+0000","last_unstale":"2024-01-20T11:07:34.389440+0000","last_undegraded":"2024-01-20T11:07:34.389440+0000","last_fullsized":"2024-01-20T11:07:34.389440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307546+0000","last_change":"2024-01-20T11:07:31.500395+0000","last_active":"2024-01-20T11:07:34.307546+0000","last_peered":"2024-01-20T11:07:34.307546+0000","last_clean":"2024-01-20T11:07:34.307546+0000","last_became_active":"2024-01-20T11:07:31.500032+0000","last_became_peered":"2024-01-20T11:07:31.500032+0000","last_unstale":"2024-01-20T11:07:34.307546+0000","last_undegraded":"2024-01-20T11:07:34.307546+0000","last_fullsized":"2024-01-20T11:07:34.307546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:18:38.315489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307397+0000","last_change":"2024-01-20T11:07:32.494245+0000","last_active":"2024-01-20T11:07:34.307397+0000","last_peered":"2024-01-20T11:07:34.307397+0000","last_clean":"2024-01-20T11:07:34.307397+0000","last_became_active":"2024-01-20T11:07:32.493862+0000","last_became_peered":"2024-01-20T11:07:32.493862+0000","last_unstale":"2024-01-20T11:07:34.307397+0000","last_undegraded":"2024-01-20T11:07:34.307397+0000","last_fullsized":"2024-01-20T11:07:34.307397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502269+0000","last_change":"2024-01-20T11:07:31.483052+0000","last_active":"2024-01-20T11:07:33.502269+0000","last_peered":"2024-01-20T11:07:33.502269+0000","last_clean":"2024-01-20T11:07:33.502269+0000","last_became_active":"2024-01-20T11:07:31.482767+0000","last_became_peered":"2024-01-20T11:07:31.482767+0000","last_unstale":"2024-01-20T11:07:33.502269+0000","last_undegraded":"2024-01-20T11:07:33.502269+0000","last_fullsized":"2024-01-20T11:07:33.502269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.492275+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491992+0000","last_became_peered":"2024-01-20T11:07:32.491992+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:21:36.093817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390038+0000","last_change":"2024-01-20T11:07:31.495203+0000","last_active":"2024-01-20T11:07:34.390038+0000","last_peered":"2024-01-20T11:07:34.390038+0000","last_clean":"2024-01-20T11:07:34.390038+0000","last_became_active":"2024-01-20T11:07:31.494906+0000","last_became_peered":"2024-01-20T11:07:31.494906+0000","last_unstale":"2024-01-20T11:07:34.390038+0000","last_undegraded":"2024-01-20T11:07:34.390038+0000","last_fullsized":"2024-01-20T11:07:34.390038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502013+0000","last_change":"2024-01-20T11:07:32.517083+0000","last_active":"2024-01-20T11:07:33.502013+0000","last_peered":"2024-01-20T11:07:33.502013+0000","last_clean":"2024-01-20T11:07:33.502013+0000","last_became_active":"2024-01-20T11:07:32.516815+0000","last_became_peered":"2024-01-20T11:07:32.516815+0000","last_unstale":"2024-01-20T11:07:33.502013+0000","last_undegraded":"2024-01-20T11:07:33.502013+0000","last_fullsized":"2024-01-20T11:07:33.502013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502340+0000","last_change":"2024-01-20T11:07:31.497490+0000","last_active":"2024-01-20T11:07:33.502340+0000","last_peered":"2024-01-20T11:07:33.502340+0000","last_clean":"2024-01-20T11:07:33.502340+0000","last_became_active":"2024-01-20T11:07:31.497068+0000","last_became_peered":"2024-01-20T11:07:31.497068+0000","last_unstale":"2024-01-20T11:07:33.502340+0000","last_undegraded":"2024-01-20T11:07:33.502340+0000","last_fullsized":"2024-01-20T11:07:33.502340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806995+0000","last_change":"2024-01-20T11:07:32.508883+0000","last_active":"2024-01-20T11:07:34.806995+0000","last_peered":"2024-01-20T11:07:34.806995+0000","last_clean":"2024-01-20T11:07:34.806995+0000","last_became_active":"2024-01-20T11:07:32.508389+0000","last_became_peered":"2024-01-20T11:07:32.508389+0000","last_unstale":"2024-01-20T11:07:34.806995+0000","last_undegraded":"2024-01-20T11:07:34.806995+0000","last_fullsized":"2024-01-20T11:07:34.806995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160453+0000","last_change":"2024-01-20T11:07:31.487647+0000","last_active":"2024-01-20T11:07:34.160453+0000","last_peered":"2024-01-20T11:07:34.160453+0000","last_clean":"2024-01-20T11:07:34.160453+0000","last_became_active":"2024-01-20T11:07:31.487411+0000","last_became_peered":"2024-01-20T11:07:31.487411+0000","last_unstale":"2024-01-20T11:07:34.160453+0000","last_undegraded":"2024-01-20T11:07:34.160453+0000","last_fullsized":"2024-01-20T11:07:34.160453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:41.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.810048+0000","last_change":"2024-01-20T11:07:32.511836+0000","last_active":"2024-01-20T11:07:34.810048+0000","last_peered":"2024-01-20T11:07:34.810048+0000","last_clean":"2024-01-20T11:07:34.810048+0000","last_became_active":"2024-01-20T11:07:32.510548+0000","last_became_peered":"2024-01-20T11:07:32.510548+0000","last_unstale":"2024-01-20T11:07:34.810048+0000","last_undegraded":"2024-01-20T11:07:34.810048+0000","last_fullsized":"2024-01-20T11:07:34.810048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:50.078866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389476+0000","last_change":"2024-01-20T11:07:31.492414+0000","last_active":"2024-01-20T11:07:34.389476+0000","last_peered":"2024-01-20T11:07:34.389476+0000","last_clean":"2024-01-20T11:07:34.389476+0000","last_became_active":"2024-01-20T11:07:31.491799+0000","last_became_peered":"2024-01-20T11:07:31.491799+0000","last_unstale":"2024-01-20T11:07:34.389476+0000","last_undegraded":"2024-01-20T11:07:34.389476+0000","last_fullsized":"2024-01-20T11:07:34.389476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498912+0000","last_change":"2024-01-20T11:07:32.510180+0000","last_active":"2024-01-20T11:07:33.498912+0000","last_peered":"2024-01-20T11:07:33.498912+0000","last_clean":"2024-01-20T11:07:33.498912+0000","last_became_active":"2024-01-20T11:07:32.509697+0000","last_became_peered":"2024-01-20T11:07:32.509697+0000","last_unstale":"2024-01-20T11:07:33.498912+0000","last_undegraded":"2024-01-20T11:07:33.498912+0000","last_fullsized":"2024-01-20T11:07:33.498912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.641512+0000","last_change":"2024-01-20T11:07:31.482038+0000","last_active":"2024-01-20T11:07:34.641512+0000","last_peered":"2024-01-20T11:07:34.641512+0000","last_clean":"2024-01-20T11:07:34.641512+0000","last_became_active":"2024-01-20T11:07:31.480827+0000","last_became_peered":"2024-01-20T11:07:31.480827+0000","last_unstale":"2024-01-20T11:07:34.641512+0000","last_undegraded":"2024-01-20T11:07:34.641512+0000","last_fullsized":"2024-01-20T11:07:34.641512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:55:30.237540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806508+0000","last_change":"2024-01-20T11:07:32.506977+0000","last_active":"2024-01-20T11:07:34.806508+0000","last_peered":"2024-01-20T11:07:34.806508+0000","last_clean":"2024-01-20T11:07:34.806508+0000","last_became_active":"2024-01-20T11:07:32.506670+0000","last_became_peered":"2024-01-20T11:07:32.506670+0000","last_unstale":"2024-01-20T11:07:34.806508+0000","last_undegraded":"2024-01-20T11:07:34.806508+0000","last_fullsized":"2024-01-20T11:07:34.806508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501345+0000","last_change":"2024-01-20T11:07:31.490601+0000","last_active":"2024-01-20T11:07:33.501345+0000","last_peered":"2024-01-20T11:07:33.501345+0000","last_clean":"2024-01-20T11:07:33.501345+0000","last_became_active":"2024-01-20T11:07:31.490325+0000","last_became_peered":"2024-01-20T11:07:31.490325+0000","last_unstale":"2024-01-20T11:07:33.501345+0000","last_undegraded":"2024-01-20T11:07:33.501345+0000","last_fullsized":"2024-01-20T11:07:33.501345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499267+0000","last_change":"2024-01-20T11:07:32.511343+0000","last_active":"2024-01-20T11:07:33.499267+0000","last_peered":"2024-01-20T11:07:33.499267+0000","last_clean":"2024-01-20T11:07:33.499267+0000","last_became_active":"2024-01-20T11:07:32.510728+0000","last_became_peered":"2024-01-20T11:07:32.510728+0000","last_unstale":"2024-01-20T11:07:33.499267+0000","last_undegraded":"2024-01-20T11:07:33.499267+0000","last_fullsized":"2024-01-20T11:07:33.499267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389024+0000","last_change":"2024-01-20T11:07:31.498147+0000","last_active":"2024-01-20T11:07:34.389024+0000","last_peered":"2024-01-20T11:07:34.389024+0000","last_clean":"2024-01-20T11:07:34.389024+0000","last_became_active":"2024-01-20T11:07:31.497862+0000","last_became_peered":"2024-01-20T11:07:31.497862+0000","last_unstale":"2024-01-20T11:07:34.389024+0000","last_undegraded":"2024-01-20T11:07:34.389024+0000","last_fullsized":"2024-01-20T11:07:34.389024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389272+0000","last_change":"2024-01-20T11:07:32.488914+0000","last_active":"2024-01-20T11:07:34.389272+0000","last_peered":"2024-01-20T11:07:34.389272+0000","last_clean":"2024-01-20T11:07:34.389272+0000","last_became_active":"2024-01-20T11:07:32.488534+0000","last_became_peered":"2024-01-20T11:07:32.488534+0000","last_unstale":"2024-01-20T11:07:34.389272+0000","last_undegraded":"2024-01-20T11:07:34.389272+0000","last_fullsized":"2024-01-20T11:07:34.389272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497591+0000","last_change":"2024-01-20T11:07:31.478318+0000","last_active":"2024-01-20T11:07:33.497591+0000","last_peered":"2024-01-20T11:07:33.497591+0000","last_clean":"2024-01-20T11:07:33.497591+0000","last_became_active":"2024-01-20T11:07:31.477994+0000","last_became_peered":"2024-01-20T11:07:31.477994+0000","last_unstale":"2024-01-20T11:07:33.497591+0000","last_undegraded":"2024-01-20T11:07:33.497591+0000","last_fullsized":"2024-01-20T11:07:33.497591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:28:19.098438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498521+0000","last_change":"2024-01-20T11:07:32.513578+0000","last_active":"2024-01-20T11:07:33.498521+0000","last_peered":"2024-01-20T11:07:33.498521+0000","last_clean":"2024-01-20T11:07:33.498521+0000","last_became_active":"2024-01-20T11:07:32.512877+0000","last_became_peered":"2024-01-20T11:07:32.512877+0000","last_unstale":"2024-01-20T11:07:33.498521+0000","last_undegraded":"2024-01-20T11:07:33.498521+0000","last_fullsized":"2024-01-20T11:07:33.498521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.727077+0000","last_change":"2024-01-20T11:07:31.484253+0000","last_active":"2024-01-20T11:07:34.727077+0000","last_peered":"2024-01-20T11:07:34.727077+0000","last_clean":"2024-01-20T11:07:34.727077+0000","last_became_active":"2024-01-20T11:07:31.483906+0000","last_became_peered":"2024-01-20T11:07:31.483906+0000","last_unstale":"2024-01-20T11:07:34.727077+0000","last_undegraded":"2024-01-20T11:07:34.727077+0000","last_fullsized":"2024-01-20T11:07:34.727077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:36:56.507275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500008+0000","last_change":"2024-01-20T11:07:32.514965+0000","last_active":"2024-01-20T11:07:33.500008+0000","last_peered":"2024-01-20T11:07:33.500008+0000","last_clean":"2024-01-20T11:07:33.500008+0000","last_became_active":"2024-01-20T11:07:32.514653+0000","last_became_peered":"2024-01-20T11:07:32.514653+0000","last_unstale":"2024-01-20T11:07:33.500008+0000","last_undegraded":"2024-01-20T11:07:33.500008+0000","last_fullsized":"2024-01-20T11:07:33.500008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:57:36.226100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498288+0000","last_change":"2024-01-20T11:07:31.483149+0000","last_active":"2024-01-20T11:07:33.498288+0000","last_peered":"2024-01-20T11:07:33.498288+0000","last_clean":"2024-01-20T11:07:33.498288+0000","last_became_active":"2024-01-20T11:07:31.482857+0000","last_became_peered":"2024-01-20T11:07:31.482857+0000","last_unstale":"2024-01-20T11:07:33.498288+0000","last_undegraded":"2024-01-20T11:07:33.498288+0000","last_fullsized":"2024-01-20T11:07:33.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499404+0000","last_change":"2024-01-20T11:07:32.511923+0000","last_active":"2024-01-20T11:07:33.499404+0000","last_peered":"2024-01-20T11:07:33.499404+0000","last_clean":"2024-01-20T11:07:33.499404+0000","last_became_active":"2024-01-20T11:07:32.511673+0000","last_became_peered":"2024-01-20T11:07:32.511673+0000","last_unstale":"2024-01-20T11:07:33.499404+0000","last_undegraded":"2024-01-20T11:07:33.499404+0000","last_fullsized":"2024-01-20T11:07:33.499404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:17.125662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160314+0000","last_change":"2024-01-20T11:07:31.483039+0000","last_active":"2024-01-20T11:07:34.160314+0000","last_peered":"2024-01-20T11:07:34.160314+0000","last_clean":"2024-01-20T11:07:34.160314+0000","last_became_active":"2024-01-20T11:07:31.482677+0000","last_became_peered":"2024-01-20T11:07:31.482677+0000","last_unstale":"2024-01-20T11:07:34.160314+0000","last_undegraded":"2024-01-20T11:07:34.160314+0000","last_fullsized":"2024-01-20T11:07:34.160314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:56.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502126+0000","last_change":"2024-01-20T11:07:32.507370+0000","last_active":"2024-01-20T11:07:33.502126+0000","last_peered":"2024-01-20T11:07:33.502126+0000","last_clean":"2024-01-20T11:07:33.502126+0000","last_became_active":"2024-01-20T11:07:32.505163+0000","last_became_peered":"2024-01-20T11:07:32.505163+0000","last_unstale":"2024-01-20T11:07:33.502126+0000","last_undegraded":"2024-01-20T11:07:33.502126+0000","last_fullsized":"2024-01-20T11:07:33.502126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497973+0000","last_change":"2024-01-20T11:07:31.487538+0000","last_active":"2024-01-20T11:07:33.497973+0000","last_peered":"2024-01-20T11:07:33.497973+0000","last_clean":"2024-01-20T11:07:33.497973+0000","last_became_active":"2024-01-20T11:07:31.487176+0000","last_became_peered":"2024-01-20T11:07:31.487176+0000","last_unstale":"2024-01-20T11:07:33.497973+0000","last_undegraded":"2024-01-20T11:07:33.497973+0000","last_fullsized":"2024-01-20T11:07:33.497973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:35.843485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499114+0000","last_change":"2024-01-20T11:07:32.523249+0000","last_active":"2024-01-20T11:07:33.499114+0000","last_peered":"2024-01-20T11:07:33.499114+0000","last_clean":"2024-01-20T11:07:33.499114+0000","last_became_active":"2024-01-20T11:07:32.523025+0000","last_became_peered":"2024-01-20T11:07:32.523025+0000","last_unstale":"2024-01-20T11:07:33.499114+0000","last_undegraded":"2024-01-20T11:07:33.499114+0000","last_fullsized":"2024-01-20T11:07:33.499114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.493831+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:07:32.493831+0000","last_peered":"2024-01-20T11:07:32.493831+0000","last_clean":"2024-01-20T11:07:32.493831+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:07:32.493831+0000","last_undegraded":"2024-01-20T11:07:32.493831+0000","last_fullsized":"2024-01-20T11:07:32.493831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500923+0000","last_change":"2024-01-20T11:07:31.485438+0000","last_active":"2024-01-20T11:07:33.500923+0000","last_peered":"2024-01-20T11:07:33.500923+0000","last_clean":"2024-01-20T11:07:33.500923+0000","last_became_active":"2024-01-20T11:07:31.485131+0000","last_became_peered":"2024-01-20T11:07:31.485131+0000","last_unstale":"2024-01-20T11:07:33.500923+0000","last_undegraded":"2024-01-20T11:07:33.500923+0000","last_fullsized":"2024-01-20T11:07:33.500923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307797+0000","last_change":"2024-01-20T11:07:32.503033+0000","last_active":"2024-01-20T11:07:34.307797+0000","last_peered":"2024-01-20T11:07:34.307797+0000","last_clean":"2024-01-20T11:07:34.307797+0000","last_became_active":"2024-01-20T11:07:32.502390+0000","last_became_peered":"2024-01-20T11:07:32.502390+0000","last_unstale":"2024-01-20T11:07:34.307797+0000","last_undegraded":"2024-01-20T11:07:34.307797+0000","last_fullsized":"2024-01-20T11:07:34.307797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497374+0000","last_change":"2024-01-20T11:07:31.493977+0000","last_active":"2024-01-20T11:07:33.497374+0000","last_peered":"2024-01-20T11:07:33.497374+0000","last_clean":"2024-01-20T11:07:33.497374+0000","last_became_active":"2024-01-20T11:07:31.493633+0000","last_became_peered":"2024-01-20T11:07:31.493633+0000","last_unstale":"2024-01-20T11:07:33.497374+0000","last_undegraded":"2024-01-20T11:07:33.497374+0000","last_fullsized":"2024-01-20T11:07:33.497374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806243+0000","last_change":"2024-01-20T11:07:32.506901+0000","last_active":"2024-01-20T11:07:34.806243+0000","last_peered":"2024-01-20T11:07:34.806243+0000","last_clean":"2024-01-20T11:07:34.806243+0000","last_became_active":"2024-01-20T11:07:32.506048+0000","last_became_peered":"2024-01-20T11:07:32.506048+0000","last_unstale":"2024-01-20T11:07:34.806243+0000","last_undegraded":"2024-01-20T11:07:34.806243+0000","last_fullsized":"2024-01-20T11:07:34.806243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:33.156389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497694+0000","last_change":"2024-01-20T11:07:31.489897+0000","last_active":"2024-01-20T11:07:33.497694+0000","last_peered":"2024-01-20T11:07:33.497694+0000","last_clean":"2024-01-20T11:07:33.497694+0000","last_became_active":"2024-01-20T11:07:31.489264+0000","last_became_peered":"2024-01-20T11:07:31.489264+0000","last_unstale":"2024-01-20T11:07:33.497694+0000","last_undegraded":"2024-01-20T11:07:33.497694+0000","last_fullsized":"2024-01-20T11:07:33.497694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159751+0000","last_change":"2024-01-20T11:07:32.489551+0000","last_active":"2024-01-20T11:07:34.159751+0000","last_peered":"2024-01-20T11:07:34.159751+0000","last_clean":"2024-01-20T11:07:34.159751+0000","last_became_active":"2024-01-20T11:07:32.489277+0000","last_became_peered":"2024-01-20T11:07:32.489277+0000","last_unstale":"2024-01-20T11:07:34.159751+0000","last_undegraded":"2024-01-20T11:07:34.159751+0000","last_fullsized":"2024-01-20T11:07:34.159751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:48.457758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501412+0000","last_change":"2024-01-20T11:07:31.483881+0000","last_active":"2024-01-20T11:07:33.501412+0000","last_peered":"2024-01-20T11:07:33.501412+0000","last_clean":"2024-01-20T11:07:33.501412+0000","last_became_active":"2024-01-20T11:07:31.483528+0000","last_became_peered":"2024-01-20T11:07:31.483528+0000","last_unstale":"2024-01-20T11:07:33.501412+0000","last_undegraded":"2024-01-20T11:07:33.501412+0000","last_fullsized":"2024-01-20T11:07:33.501412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809531+0000","last_change":"2024-01-20T11:07:32.496285+0000","last_active":"2024-01-20T11:07:34.809531+0000","last_peered":"2024-01-20T11:07:34.809531+0000","last_clean":"2024-01-20T11:07:34.809531+0000","last_became_active":"2024-01-20T11:07:32.495112+0000","last_became_peered":"2024-01-20T11:07:32.495112+0000","last_unstale":"2024-01-20T11:07:34.809531+0000","last_undegraded":"2024-01-20T11:07:34.809531+0000","last_fullsized":"2024-01-20T11:07:34.809531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:32:26.335373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159900+0000","last_change":"2024-01-20T11:07:31.481611+0000","last_active":"2024-01-20T11:07:34.159900+0000","last_peered":"2024-01-20T11:07:34.159900+0000","last_clean":"2024-01-20T11:07:34.159900+0000","last_became_active":"2024-01-20T11:07:31.481322+0000","last_became_peered":"2024-01-20T11:07:31.481322+0000","last_unstale":"2024-01-20T11:07:34.159900+0000","last_undegraded":"2024-01-20T11:07:34.159900+0000","last_fullsized":"2024-01-20T11:07:34.159900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:49.040069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501882+0000","last_change":"2024-01-20T11:07:32.506000+0000","last_active":"2024-01-20T11:07:33.501882+0000","last_peered":"2024-01-20T11:07:33.501882+0000","last_clean":"2024-01-20T11:07:33.501882+0000","last_became_active":"2024-01-20T11:07:32.505039+0000","last_became_peered":"2024-01-20T11:07:32.505039+0000","last_unstale":"2024-01-20T11:07:33.501882+0000","last_undegraded":"2024-01-20T11:07:33.501882+0000","last_fullsized":"2024-01-20T11:07:33.501882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499473+0000","last_change":"2024-01-20T11:07:31.496162+0000","last_active":"2024-01-20T11:07:33.499473+0000","last_peered":"2024-01-20T11:07:33.499473+0000","last_clean":"2024-01-20T11:07:33.499473+0000","last_became_active":"2024-01-20T11:07:31.495742+0000","last_became_peered":"2024-01-20T11:07:31.495742+0000","last_unstale":"2024-01-20T11:07:33.499473+0000","last_undegraded":"2024-01-20T11:07:33.499473+0000","last_fullsized":"2024-01-20T11:07:33.499473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:37:17.428810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160078+0000","last_change":"2024-01-20T11:07:32.489292+0000","last_active":"2024-01-20T11:07:34.160078+0000","last_peered":"2024-01-20T11:07:34.160078+0000","last_clean":"2024-01-20T11:07:34.160078+0000","last_became_active":"2024-01-20T11:07:32.488833+0000","last_became_peered":"2024-01-20T11:07:32.488833+0000","last_unstale":"2024-01-20T11:07:34.160078+0000","last_undegraded":"2024-01-20T11:07:34.160078+0000","last_fullsized":"2024-01-20T11:07:34.160078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:03:48.348342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.728088+0000","last_change":"2024-01-20T11:07:31.499423+0000","last_active":"2024-01-20T11:07:34.728088+0000","last_peered":"2024-01-20T11:07:34.728088+0000","last_clean":"2024-01-20T11:07:34.728088+0000","last_became_active":"2024-01-20T11:07:31.499207+0000","last_became_peered":"2024-01-20T11:07:31.499207+0000","last_unstale":"2024-01-20T11:07:34.728088+0000","last_undegraded":"2024-01-20T11:07:34.728088+0000","last_fullsized":"2024-01-20T11:07:34.728088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:38:53.823701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307987+0000","last_change":"2024-01-20T11:07:32.518826+0000","last_active":"2024-01-20T11:07:34.307987+0000","last_peered":"2024-01-20T11:07:34.307987+0000","last_clean":"2024-01-20T11:07:34.307987+0000","last_became_active":"2024-01-20T11:07:32.518540+0000","last_became_peered":"2024-01-20T11:07:32.518540+0000","last_unstale":"2024-01-20T11:07:34.307987+0000","last_undegraded":"2024-01-20T11:07:34.307987+0000","last_fullsized":"2024-01-20T11:07:34.307987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390151+0000","last_change":"2024-01-20T11:07:31.498846+0000","last_active":"2024-01-20T11:07:34.390151+0000","last_peered":"2024-01-20T11:07:34.390151+0000","last_clean":"2024-01-20T11:07:34.390151+0000","last_became_active":"2024-01-20T11:07:31.498477+0000","last_became_peered":"2024-01-20T11:07:31.498477+0000","last_unstale":"2024-01-20T11:07:34.390151+0000","last_undegraded":"2024-01-20T11:07:34.390151+0000","last_fullsized":"2024-01-20T11:07:34.390151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806874+0000","last_change":"2024-01-20T11:07:32.495729+0000","last_active":"2024-01-20T11:07:34.806874+0000","last_peered":"2024-01-20T11:07:34.806874+0000","last_clean":"2024-01-20T11:07:34.806874+0000","last_became_active":"2024-01-20T11:07:32.493695+0000","last_became_peered":"2024-01-20T11:07:32.493695+0000","last_unstale":"2024-01-20T11:07:34.806874+0000","last_undegraded":"2024-01-20T11:07:34.806874+0000","last_fullsized":"2024-01-20T11:07:34.806874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497112+0000","last_change":"2024-01-20T11:07:31.495706+0000","last_active":"2024-01-20T11:07:33.497112+0000","last_peered":"2024-01-20T11:07:33.497112+0000","last_clean":"2024-01-20T11:07:33.497112+0000","last_became_active":"2024-01-20T11:07:31.495412+0000","last_became_peered":"2024-01-20T11:07:31.495412+0000","last_unstale":"2024-01-20T11:07:33.497112+0000","last_undegraded":"2024-01-20T11:07:33.497112+0000","last_fullsized":"2024-01-20T11:07:33.497112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809395+0000","last_change":"2024-01-20T11:07:32.492080+0000","last_active":"2024-01-20T11:07:34.809395+0000","last_peered":"2024-01-20T11:07:34.809395+0000","last_clean":"2024-01-20T11:07:34.809395+0000","last_became_active":"2024-01-20T11:07:32.491063+0000","last_became_peered":"2024-01-20T11:07:32.491063+0000","last_unstale":"2024-01-20T11:07:34.809395+0000","last_undegraded":"2024-01-20T11:07:34.809395+0000","last_fullsized":"2024-01-20T11:07:34.809395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:42.421665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159828+0000","last_change":"2024-01-20T11:07:31.485898+0000","last_active":"2024-01-20T11:07:34.159828+0000","last_peered":"2024-01-20T11:07:34.159828+0000","last_clean":"2024-01-20T11:07:34.159828+0000","last_became_active":"2024-01-20T11:07:31.485601+0000","last_became_peered":"2024-01-20T11:07:31.485601+0000","last_unstale":"2024-01-20T11:07:34.159828+0000","last_undegraded":"2024-01-20T11:07:34.159828+0000","last_fullsized":"2024-01-20T11:07:34.159828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307529+0000","last_change":"2024-01-20T11:07:32.491885+0000","last_active":"2024-01-20T11:07:34.307529+0000","last_peered":"2024-01-20T11:07:34.307529+0000","last_clean":"2024-01-20T11:07:34.307529+0000","last_became_active":"2024-01-20T11:07:32.491603+0000","last_became_peered":"2024-01-20T11:07:32.491603+0000","last_unstale":"2024-01-20T11:07:34.307529+0000","last_undegraded":"2024-01-20T11:07:34.307529+0000","last_fullsized":"2024-01-20T11:07:34.307529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159878+0000","last_change":"2024-01-20T11:07:31.492532+0000","last_active":"2024-01-20T11:07:34.159878+0000","last_peered":"2024-01-20T11:07:34.159878+0000","last_clean":"2024-01-20T11:07:34.159878+0000","last_became_active":"2024-01-20T11:07:31.492086+0000","last_became_peered":"2024-01-20T11:07:31.492086+0000","last_unstale":"2024-01-20T11:07:34.159878+0000","last_undegraded":"2024-01-20T11:07:34.159878+0000","last_fullsized":"2024-01-20T11:07:34.159878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308413+0000","last_change":"2024-01-20T11:07:32.496745+0000","last_active":"2024-01-20T11:07:34.308413+0000","last_peered":"2024-01-20T11:07:34.308413+0000","last_clean":"2024-01-20T11:07:34.308413+0000","last_became_active":"2024-01-20T11:07:32.496476+0000","last_became_peered":"2024-01-20T11:07:32.496476+0000","last_unstale":"2024-01-20T11:07:34.308413+0000","last_undegraded":"2024-01-20T11:07:34.308413+0000","last_fullsized":"2024-01-20T11:07:34.308413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499806+0000","last_change":"2024-01-20T11:07:31.497898+0000","last_active":"2024-01-20T11:07:33.499806+0000","last_peered":"2024-01-20T11:07:33.499806+0000","last_clean":"2024-01-20T11:07:33.499806+0000","last_became_active":"2024-01-20T11:07:31.497633+0000","last_became_peered":"2024-01-20T11:07:31.497633+0000","last_unstale":"2024-01-20T11:07:33.499806+0000","last_undegraded":"2024-01-20T11:07:33.499806+0000","last_fullsized":"2024-01-20T11:07:33.499806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:16:12.889750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389455+0000","last_change":"2024-01-20T11:07:32.502048+0000","last_active":"2024-01-20T11:07:34.389455+0000","last_peered":"2024-01-20T11:07:34.389455+0000","last_clean":"2024-01-20T11:07:34.389455+0000","last_became_active":"2024-01-20T11:07:32.501771+0000","last_became_peered":"2024-01-20T11:07:32.501771+0000","last_unstale":"2024-01-20T11:07:34.389455+0000","last_undegraded":"2024-01-20T11:07:34.389455+0000","last_fullsized":"2024-01-20T11:07:34.389455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501677+0000","last_change":"2024-01-20T11:07:32.505630+0000","last_active":"2024-01-20T11:07:33.501677+0000","last_peered":"2024-01-20T11:07:33.501677+0000","last_clean":"2024-01-20T11:07:33.501677+0000","last_became_active":"2024-01-20T11:07:32.505349+0000","last_became_peered":"2024-01-20T11:07:32.505349+0000","last_unstale":"2024-01-20T11:07:33.501677+0000","last_undegraded":"2024-01-20T11:07:33.501677+0000","last_fullsized":"2024-01-20T11:07:33.501677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498700+0000","last_change":"2024-01-20T11:07:31.500045+0000","last_active":"2024-01-20T11:07:33.498700+0000","last_peered":"2024-01-20T11:07:33.498700+0000","last_clean":"2024-01-20T11:07:33.498700+0000","last_became_active":"2024-01-20T11:07:31.499737+0000","last_became_peered":"2024-01-20T11:07:31.499737+0000","last_unstale":"2024-01-20T11:07:33.498700+0000","last_undegraded":"2024-01-20T11:07:33.498700+0000","last_fullsized":"2024-01-20T11:07:33.498700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:34.222349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501807+0000","last_change":"2024-01-20T11:07:32.506908+0000","last_active":"2024-01-20T11:07:33.501807+0000","last_peered":"2024-01-20T11:07:33.501807+0000","last_clean":"2024-01-20T11:07:33.501807+0000","last_became_active":"2024-01-20T11:07:32.506541+0000","last_became_peered":"2024-01-20T11:07:32.506541+0000","last_unstale":"2024-01-20T11:07:33.501807+0000","last_undegraded":"2024-01-20T11:07:33.501807+0000","last_fullsized":"2024-01-20T11:07:33.501807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499153+0000","last_change":"2024-01-20T11:07:31.500669+0000","last_active":"2024-01-20T11:07:33.499153+0000","last_peered":"2024-01-20T11:07:33.499153+0000","last_clean":"2024-01-20T11:07:33.499153+0000","last_became_active":"2024-01-20T11:07:31.500354+0000","last_became_peered":"2024-01-20T11:07:31.500354+0000","last_unstale":"2024-01-20T11:07:33.499153+0000","last_undegraded":"2024-01-20T11:07:33.499153+0000","last_fullsized":"2024-01-20T11:07:33.499153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:21.904186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806868+0000","last_change":"2024-01-20T11:07:32.509179+0000","last_active":"2024-01-20T11:07:34.806868+0000","last_peered":"2024-01-20T11:07:34.806868+0000","last_clean":"2024-01-20T11:07:34.806868+0000","last_became_active":"2024-01-20T11:07:32.508667+0000","last_became_peered":"2024-01-20T11:07:32.508667+0000","last_unstale":"2024-01-20T11:07:34.806868+0000","last_undegraded":"2024-01-20T11:07:34.806868+0000","last_fullsized":"2024-01-20T11:07:34.806868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308404+0000","last_change":"2024-01-20T11:07:31.487022+0000","last_active":"2024-01-20T11:07:34.308404+0000","last_peered":"2024-01-20T11:07:34.308404+0000","last_clean":"2024-01-20T11:07:34.308404+0000","last_became_active":"2024-01-20T11:07:31.485438+0000","last_became_peered":"2024-01-20T11:07:31.485438+0000","last_unstale":"2024-01-20T11:07:34.308404+0000","last_undegraded":"2024-01-20T11:07:34.308404+0000","last_fullsized":"2024-01-20T11:07:34.308404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308147+0000","last_change":"2024-01-20T11:07:32.498652+0000","last_active":"2024-01-20T11:07:34.308147+0000","last_peered":"2024-01-20T11:07:34.308147+0000","last_clean":"2024-01-20T11:07:34.308147+0000","last_became_active":"2024-01-20T11:07:32.498322+0000","last_became_peered":"2024-01-20T11:07:32.498322+0000","last_unstale":"2024-01-20T11:07:34.308147+0000","last_undegraded":"2024-01-20T11:07:34.308147+0000","last_fullsized":"2024-01-20T11:07:34.308147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.641734+0000","last_change":"2024-01-20T11:07:31.495529+0000","last_active":"2024-01-20T11:07:34.641734+0000","last_peered":"2024-01-20T11:07:34.641734+0000","last_clean":"2024-01-20T11:07:34.641734+0000","last_became_active":"2024-01-20T11:07:31.495233+0000","last_became_peered":"2024-01-20T11:07:31.495233+0000","last_unstale":"2024-01-20T11:07:34.641734+0000","last_undegraded":"2024-01-20T11:07:34.641734+0000","last_fullsized":"2024-01-20T11:07:34.641734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":823296,"data_stored":669678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.343}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4550000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.736}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":78854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.173}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.008}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":669734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:07:42.414 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:07:42.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.659+0000 7fda56e00640 1 Processor -- start 2024-01-20T11:07:42.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.659+0000 7fda56e00640 1 -- start start 2024-01-20T11:07:42.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.660+0000 7fda56e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda50070630 0x7fda500adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.660+0000 7fda56e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda50070b60 con 0x7fda5015c6e0 2024-01-20T11:07:42.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda56e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5015bc00 con 0x7fda50155a30 2024-01-20T11:07:42.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda56e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5015ba10 con 0x7fda50070630 2024-01-20T11:07:42.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda54e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fda5015c6e0 0x7fda5006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33782/0 (socket says 172.21.15.162:33782) 2024-01-20T11:07:42.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda54e00640 1 -- 172.21.15.162:0/3285715283 learned_addr learned my addr 172.21.15.162:0/3285715283 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda47e00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda50070630 0x7fda500adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089594187 0 0) 0x7fda50070b60 con 0x7fda5015c6e0 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda30003520 con 0x7fda5015c6e0 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571844554 0 0) 0x7fda30003520 con 0x7fda5015c6e0 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda50070630 msgr2=0x7fda500adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.661+0000 7fda4f400640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda50070630 0x7fda500adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 >> v1:172.21.15.179:6789/0 conn(0x7fda50155a30 legacy=0x7fda500ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5015bee0 con 0x7fda5015c6e0 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fda480019f0 con 0x7fda5015c6e0 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 >> v1:172.21.15.162:6789/0 conn(0x7fda5015c6e0 legacy=0x7fda5006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda300039a0 0x7fda30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda50070630 0x7fda300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3000bb60 con 0x7fda30004d00 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3000bcd0 con 0x7fda300039a0 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3000be90 con 0x7fda50070630 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda54e00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4fe00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda300039a0 0x7fda30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda54e00640 1 -- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda50070630 msgr2=0x7fda300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda54e00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda50070630 0x7fda300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda54e00640 1 -- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda300039a0 msgr2=0x7fda30003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda54e00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda300039a0 0x7fda30003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda54e00640 1 -- 172.21.15.162:0/3285715283 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30003520 con 0x7fda30004d00 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.662+0000 7fda4fe00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda300039a0 0x7fda30003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.663+0000 7fda54e00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda30005180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda4800a830 tx=0x7fda300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfe6bc988b75b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda480072d0 con 0x7fda30004d00 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4802f070 con 0x7fda30004d00 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda4f400640 1 -- 172.21.15.162:0/3285715283 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda480076b0 con 0x7fda30004d00 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda56e00640 1 -- 172.21.15.162:0/3285715283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 msgr2=0x7fda30005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda56e00640 1 --2- 172.21.15.162:0/3285715283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda30005180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda4800a830 tx=0x7fda300057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda54e00640 1 -- 172.21.15.162:0/3285715283 reap_dead start 2024-01-20T11:07:42.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda56e00640 1 -- 172.21.15.162:0/3285715283 shutdown_connections 2024-01-20T11:07:42.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda56e00640 1 -- 172.21.15.162:0/3285715283 >> 172.21.15.162:0/3285715283 conn(0x7fda500b0cd0 msgr2=0x7fda500b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:42.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda56e00640 1 -- 172.21.15.162:0/3285715283 shutdown_connections 2024-01-20T11:07:42.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.664+0000 7fda56e00640 1 -- 172.21.15.162:0/3285715283 wait complete. 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.666+0000 7fda56e00640 1 Processor -- start 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.666+0000 7fda56e00640 1 -- start start 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda56e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda50153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda56e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda500b1d90 0x7fda50153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda56e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda500b3e80 0x7fda500b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda56e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda500b3360 con 0x7fda30004d00 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda56e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda500b22c0 con 0x7fda500b3e80 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda56e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda500b25a0 con 0x7fda500b1d90 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda50153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda50153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41514/0 (socket says 172.21.15.162:41514) 2024-01-20T11:07:42.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 -- 172.21.15.162:0/3689978094 learned_addr learned my addr 172.21.15.162:0/3689978094 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 -- 172.21.15.162:0/3689978094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda500b1d90 msgr2=0x7fda50153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda500b1d90 0x7fda50153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 -- 172.21.15.162:0/3689978094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda500b3e80 msgr2=0x7fda500b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda500b3e80 0x7fda500b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.667+0000 7fda4fe00640 1 -- 172.21.15.162:0/3689978094 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50155f90 con 0x7fda30004d00 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.668+0000 7fda4fe00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda50153710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d7a0 tx=0x7fda4000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.668+0000 7fda4cc00640 1 -- 172.21.15.162:0/3689978094 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40017070 con 0x7fda30004d00 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.668+0000 7fda4cc00640 1 -- 172.21.15.162:0/3689978094 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40005070 con 0x7fda30004d00 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.668+0000 7fda4cc00640 1 -- 172.21.15.162:0/3689978094 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40005420 con 0x7fda30004d00 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.668+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda500b2880 con 0x7fda30004d00 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.668+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda500b2e40 con 0x7fda30004d00 2024-01-20T11:07:42.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.669+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5004e970 con 0x7fda30004d00 2024-01-20T11:07:42.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.670+0000 7fda4cc00640 1 -- 172.21.15.162:0/3689978094 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fda40007030 con 0x7fda30004d00 2024-01-20T11:07:42.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.671+0000 7fda4cc00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fda2806aed0 0x7fda2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:42.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.671+0000 7fda4cc00640 1 -- 172.21.15.162:0/3689978094 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda40088eb0 con 0x7fda30004d00 2024-01-20T11:07:42.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.671+0000 7fda47e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fda2806aed0 0x7fda2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:42.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.672+0000 7fda47e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fda2806aed0 0x7fda2806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda500b51a0 tx=0x7fda38008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:42.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.676+0000 7fda4cc00640 1 -- 172.21.15.162:0/3689978094 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fda40053d70 con 0x7fda30004d00 2024-01-20T11:07:42.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.851+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda500b2710 con 0x7fda2806aed0 2024-01-20T11:07:42.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.867+0000 7fda4cc00640 1 -- 172.21.15.162:0/3689978094 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264292 (secure 0 0 0) 0x7fda500b2710 con 0x7fda2806aed0 2024-01-20T11:07:42.871 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:42.872 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:07:42.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fda2806aed0 msgr2=0x7fda2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fda2806aed0 0x7fda2806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda500b51a0 tx=0x7fda38008040 comp rx=0 tx=0).stop 2024-01-20T11:07:42.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 msgr2=0x7fda50153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda50153710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d7a0 tx=0x7fda4000dc60 comp rx=0 tx=0).stop 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 shutdown_connections 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fda2806aed0 0x7fda2806d390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda500b3e80 0x7fda500b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda500b1d90 0x7fda50153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 --2- 172.21.15.162:0/3689978094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda30004d00 0x7fda50153710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 >> 172.21.15.162:0/3689978094 conn(0x7fda500b0cd0 msgr2=0x7fda501525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 shutdown_connections 2024-01-20T11:07:42.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:42.873+0000 7fda56e00640 1 -- 172.21.15.162:0/3689978094 wait complete. 2024-01-20T11:07:42.891 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-20T11:07:41.583897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219364,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755356,"statfs":{"total":773094113280,"available":772869484544,"internally_reserved":0,"allocated":3055616,"data_stored":1815380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.120732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498954+0000","last_change":"2024-01-20T11:07:32.511393+0000","last_active":"2024-01-20T11:07:33.498954+0000","last_peered":"2024-01-20T11:07:33.498954+0000","last_clean":"2024-01-20T11:07:33.498954+0000","last_became_active":"2024-01-20T11:07:32.511094+0000","last_became_peered":"2024-01-20T11:07:32.511094+0000","last_unstale":"2024-01-20T11:07:33.498954+0000","last_undegraded":"2024-01-20T11:07:33.498954+0000","last_fullsized":"2024-01-20T11:07:33.498954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160365+0000","last_change":"2024-01-20T11:07:32.495713+0000","last_active":"2024-01-20T11:07:34.160365+0000","last_peered":"2024-01-20T11:07:34.160365+0000","last_clean":"2024-01-20T11:07:34.160365+0000","last_became_active":"2024-01-20T11:07:32.495487+0000","last_became_peered":"2024-01-20T11:07:32.495487+0000","last_unstale":"2024-01-20T11:07:34.160365+0000","last_undegraded":"2024-01-20T11:07:34.160365+0000","last_fullsized":"2024-01-20T11:07:34.160365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:21.564586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806650+0000","last_change":"2024-01-20T11:07:32.481755+0000","last_active":"2024-01-20T11:07:34.806650+0000","last_peered":"2024-01-20T11:07:34.806650+0000","last_clean":"2024-01-20T11:07:34.806650+0000","last_became_active":"2024-01-20T11:07:32.481213+0000","last_became_peered":"2024-01-20T11:07:32.481213+0000","last_unstale":"2024-01-20T11:07:34.806650+0000","last_undegraded":"2024-01-20T11:07:34.806650+0000","last_fullsized":"2024-01-20T11:07:34.806650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501649+0000","last_change":"2024-01-20T11:07:32.502344+0000","last_active":"2024-01-20T11:07:33.501649+0000","last_peered":"2024-01-20T11:07:33.501649+0000","last_clean":"2024-01-20T11:07:33.501649+0000","last_became_active":"2024-01-20T11:07:32.502037+0000","last_became_peered":"2024-01-20T11:07:32.502037+0000","last_unstale":"2024-01-20T11:07:33.501649+0000","last_undegraded":"2024-01-20T11:07:33.501649+0000","last_fullsized":"2024-01-20T11:07:33.501649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498895+0000","last_change":"2024-01-20T11:07:32.511019+0000","last_active":"2024-01-20T11:07:33.498895+0000","last_peered":"2024-01-20T11:07:33.498895+0000","last_clean":"2024-01-20T11:07:33.498895+0000","last_became_active":"2024-01-20T11:07:32.509419+0000","last_became_peered":"2024-01-20T11:07:32.509419+0000","last_unstale":"2024-01-20T11:07:33.498895+0000","last_undegraded":"2024-01-20T11:07:33.498895+0000","last_fullsized":"2024-01-20T11:07:33.498895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500988+0000","last_change":"2024-01-20T11:07:32.500145+0000","last_active":"2024-01-20T11:07:33.500988+0000","last_peered":"2024-01-20T11:07:33.500988+0000","last_clean":"2024-01-20T11:07:33.500988+0000","last_became_active":"2024-01-20T11:07:32.499948+0000","last_became_peered":"2024-01-20T11:07:32.499948+0000","last_unstale":"2024-01-20T11:07:33.500988+0000","last_undegraded":"2024-01-20T11:07:33.500988+0000","last_fullsized":"2024-01-20T11:07:33.500988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498132+0000","last_change":"2024-01-20T11:07:32.509101+0000","last_active":"2024-01-20T11:07:33.498132+0000","last_peered":"2024-01-20T11:07:33.498132+0000","last_clean":"2024-01-20T11:07:33.498132+0000","last_became_active":"2024-01-20T11:07:32.508125+0000","last_became_peered":"2024-01-20T11:07:32.508125+0000","last_unstale":"2024-01-20T11:07:33.498132+0000","last_undegraded":"2024-01-20T11:07:33.498132+0000","last_fullsized":"2024-01-20T11:07:33.498132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307168+0000","last_change":"2024-01-20T11:07:32.508785+0000","last_active":"2024-01-20T11:07:34.307168+0000","last_peered":"2024-01-20T11:07:34.307168+0000","last_clean":"2024-01-20T11:07:34.307168+0000","last_became_active":"2024-01-20T11:07:32.508563+0000","last_became_peered":"2024-01-20T11:07:32.508563+0000","last_unstale":"2024-01-20T11:07:34.307168+0000","last_undegraded":"2024-01-20T11:07:34.307168+0000","last_fullsized":"2024-01-20T11:07:34.307168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499139+0000","last_change":"2024-01-20T11:07:32.521686+0000","last_active":"2024-01-20T11:07:33.499139+0000","last_peered":"2024-01-20T11:07:33.499139+0000","last_clean":"2024-01-20T11:07:33.499139+0000","last_became_active":"2024-01-20T11:07:32.521333+0000","last_became_peered":"2024-01-20T11:07:32.521333+0000","last_unstale":"2024-01-20T11:07:33.499139+0000","last_undegraded":"2024-01-20T11:07:33.499139+0000","last_fullsized":"2024-01-20T11:07:33.499139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390247+0000","last_change":"2024-01-20T11:07:32.511433+0000","last_active":"2024-01-20T11:07:34.390247+0000","last_peered":"2024-01-20T11:07:34.390247+0000","last_clean":"2024-01-20T11:07:34.390247+0000","last_became_active":"2024-01-20T11:07:32.507192+0000","last_became_peered":"2024-01-20T11:07:32.507192+0000","last_unstale":"2024-01-20T11:07:34.390247+0000","last_undegraded":"2024-01-20T11:07:34.390247+0000","last_fullsized":"2024-01-20T11:07:34.390247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389662+0000","last_change":"2024-01-20T11:07:32.510460+0000","last_active":"2024-01-20T11:07:34.389662+0000","last_peered":"2024-01-20T11:07:34.389662+0000","last_clean":"2024-01-20T11:07:34.389662+0000","last_became_active":"2024-01-20T11:07:32.510165+0000","last_became_peered":"2024-01-20T11:07:32.510165+0000","last_unstale":"2024-01-20T11:07:34.389662+0000","last_undegraded":"2024-01-20T11:07:34.389662+0000","last_fullsized":"2024-01-20T11:07:34.389662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809847+0000","last_change":"2024-01-20T11:07:32.507297+0000","last_active":"2024-01-20T11:07:34.809847+0000","last_peered":"2024-01-20T11:07:34.809847+0000","last_clean":"2024-01-20T11:07:34.809847+0000","last_became_active":"2024-01-20T11:07:32.505550+0000","last_became_peered":"2024-01-20T11:07:32.505550+0000","last_unstale":"2024-01-20T11:07:34.809847+0000","last_undegraded":"2024-01-20T11:07:34.809847+0000","last_fullsized":"2024-01-20T11:07:34.809847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.007672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307927+0000","last_change":"2024-01-20T11:07:32.499378+0000","last_active":"2024-01-20T11:07:34.307927+0000","last_peered":"2024-01-20T11:07:34.307927+0000","last_clean":"2024-01-20T11:07:34.307927+0000","last_became_active":"2024-01-20T11:07:32.498514+0000","last_became_peered":"2024-01-20T11:07:32.498514+0000","last_unstale":"2024-01-20T11:07:34.307927+0000","last_undegraded":"2024-01-20T11:07:34.307927+0000","last_fullsized":"2024-01-20T11:07:34.307927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806348+0000","last_change":"2024-01-20T11:07:32.494967+0000","last_active":"2024-01-20T11:07:34.806348+0000","last_peered":"2024-01-20T11:07:34.806348+0000","last_clean":"2024-01-20T11:07:34.806348+0000","last_became_active":"2024-01-20T11:07:32.494120+0000","last_became_peered":"2024-01-20T11:07:32.494120+0000","last_unstale":"2024-01-20T11:07:34.806348+0000","last_undegraded":"2024-01-20T11:07:34.806348+0000","last_fullsized":"2024-01-20T11:07:34.806348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:52.043273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.491525+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491262+0000","last_became_peered":"2024-01-20T11:07:32.491262+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:52.065195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500692+0000","last_change":"2024-01-20T11:07:32.500042+0000","last_active":"2024-01-20T11:07:33.500692+0000","last_peered":"2024-01-20T11:07:33.500692+0000","last_clean":"2024-01-20T11:07:33.500692+0000","last_became_active":"2024-01-20T11:07:32.499808+0000","last_became_peered":"2024-01-20T11:07:32.499808+0000","last_unstale":"2024-01-20T11:07:33.500692+0000","last_undegraded":"2024-01-20T11:07:33.500692+0000","last_fullsized":"2024-01-20T11:07:33.500692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502287+0000","last_change":"2024-01-20T11:07:32.517082+0000","last_active":"2024-01-20T11:07:33.502287+0000","last_peered":"2024-01-20T11:07:33.502287+0000","last_clean":"2024-01-20T11:07:33.502287+0000","last_became_active":"2024-01-20T11:07:32.516792+0000","last_became_peered":"2024-01-20T11:07:32.516792+0000","last_unstale":"2024-01-20T11:07:33.502287+0000","last_undegraded":"2024-01-20T11:07:33.502287+0000","last_fullsized":"2024-01-20T11:07:33.502287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498121+0000","last_change":"2024-01-20T11:07:32.496924+0000","last_active":"2024-01-20T11:07:33.498121+0000","last_peered":"2024-01-20T11:07:33.498121+0000","last_clean":"2024-01-20T11:07:33.498121+0000","last_became_active":"2024-01-20T11:07:32.496711+0000","last_became_peered":"2024-01-20T11:07:32.496711+0000","last_unstale":"2024-01-20T11:07:33.498121+0000","last_undegraded":"2024-01-20T11:07:33.498121+0000","last_fullsized":"2024-01-20T11:07:33.498121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:50.078866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499802+0000","last_change":"2024-01-20T11:07:32.509963+0000","last_active":"2024-01-20T11:07:33.499802+0000","last_peered":"2024-01-20T11:07:33.499802+0000","last_clean":"2024-01-20T11:07:33.499802+0000","last_became_active":"2024-01-20T11:07:32.509355+0000","last_became_peered":"2024-01-20T11:07:32.509355+0000","last_unstale":"2024-01-20T11:07:33.499802+0000","last_undegraded":"2024-01-20T11:07:33.499802+0000","last_fullsized":"2024-01-20T11:07:33.499802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:51:48.711512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389493+0000","last_change":"2024-01-20T11:07:32.499797+0000","last_active":"2024-01-20T11:07:34.389493+0000","last_peered":"2024-01-20T11:07:34.389493+0000","last_clean":"2024-01-20T11:07:34.389493+0000","last_became_active":"2024-01-20T11:07:32.499479+0000","last_became_peered":"2024-01-20T11:07:32.499479+0000","last_unstale":"2024-01-20T11:07:34.389493+0000","last_undegraded":"2024-01-20T11:07:34.389493+0000","last_fullsized":"2024-01-20T11:07:34.389493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806454+0000","last_change":"2024-01-20T11:07:32.510484+0000","last_active":"2024-01-20T11:07:34.806454+0000","last_peered":"2024-01-20T11:07:34.806454+0000","last_clean":"2024-01-20T11:07:34.806454+0000","last_became_active":"2024-01-20T11:07:32.510232+0000","last_became_peered":"2024-01-20T11:07:32.510232+0000","last_unstale":"2024-01-20T11:07:34.806454+0000","last_undegraded":"2024-01-20T11:07:34.806454+0000","last_fullsized":"2024-01-20T11:07:34.806454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:51:15.717971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501069+0000","last_change":"2024-01-20T11:07:32.514040+0000","last_active":"2024-01-20T11:07:33.501069+0000","last_peered":"2024-01-20T11:07:33.501069+0000","last_clean":"2024-01-20T11:07:33.501069+0000","last_became_active":"2024-01-20T11:07:32.513752+0000","last_became_peered":"2024-01-20T11:07:32.513752+0000","last_unstale":"2024-01-20T11:07:33.501069+0000","last_undegraded":"2024-01-20T11:07:33.501069+0000","last_fullsized":"2024-01-20T11:07:33.501069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307277+0000","last_change":"2024-01-20T11:07:32.506093+0000","last_active":"2024-01-20T11:07:34.307277+0000","last_peered":"2024-01-20T11:07:34.307277+0000","last_clean":"2024-01-20T11:07:34.307277+0000","last_became_active":"2024-01-20T11:07:32.505824+0000","last_became_peered":"2024-01-20T11:07:32.505824+0000","last_unstale":"2024-01-20T11:07:34.307277+0000","last_undegraded":"2024-01-20T11:07:34.307277+0000","last_fullsized":"2024-01-20T11:07:34.307277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500841+0000","last_change":"2024-01-20T11:07:32.499561+0000","last_active":"2024-01-20T11:07:33.500841+0000","last_peered":"2024-01-20T11:07:33.500841+0000","last_clean":"2024-01-20T11:07:33.500841+0000","last_became_active":"2024-01-20T11:07:32.499132+0000","last_became_peered":"2024-01-20T11:07:32.499132+0000","last_unstale":"2024-01-20T11:07:33.500841+0000","last_undegraded":"2024-01-20T11:07:33.500841+0000","last_fullsized":"2024-01-20T11:07:33.500841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308164+0000","last_change":"2024-01-20T11:07:32.504381+0000","last_active":"2024-01-20T11:07:34.308164+0000","last_peered":"2024-01-20T11:07:34.308164+0000","last_clean":"2024-01-20T11:07:34.308164+0000","last_became_active":"2024-01-20T11:07:32.504077+0000","last_became_peered":"2024-01-20T11:07:32.504077+0000","last_unstale":"2024-01-20T11:07:34.308164+0000","last_undegraded":"2024-01-20T11:07:34.308164+0000","last_fullsized":"2024-01-20T11:07:34.308164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390177+0000","last_change":"2024-01-20T11:07:32.516522+0000","last_active":"2024-01-20T11:07:34.390177+0000","last_peered":"2024-01-20T11:07:34.390177+0000","last_clean":"2024-01-20T11:07:34.390177+0000","last_became_active":"2024-01-20T11:07:32.516166+0000","last_became_peered":"2024-01-20T11:07:32.516166+0000","last_unstale":"2024-01-20T11:07:34.390177+0000","last_undegraded":"2024-01-20T11:07:34.390177+0000","last_fullsized":"2024-01-20T11:07:34.390177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160091+0000","last_change":"2024-01-20T11:07:32.493441+0000","last_active":"2024-01-20T11:07:34.160091+0000","last_peered":"2024-01-20T11:07:34.160091+0000","last_clean":"2024-01-20T11:07:34.160091+0000","last_became_active":"2024-01-20T11:07:32.493167+0000","last_became_peered":"2024-01-20T11:07:32.493167+0000","last_unstale":"2024-01-20T11:07:34.160091+0000","last_undegraded":"2024-01-20T11:07:34.160091+0000","last_fullsized":"2024-01-20T11:07:34.160091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:37:16.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308502+0000","last_change":"2024-01-20T11:07:32.506319+0000","last_active":"2024-01-20T11:07:34.308502+0000","last_peered":"2024-01-20T11:07:34.308502+0000","last_clean":"2024-01-20T11:07:34.308502+0000","last_became_active":"2024-01-20T11:07:32.505816+0000","last_became_peered":"2024-01-20T11:07:32.505816+0000","last_unstale":"2024-01-20T11:07:34.308502+0000","last_undegraded":"2024-01-20T11:07:34.308502+0000","last_fullsized":"2024-01-20T11:07:34.308502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806471+0000","last_change":"2024-01-20T11:07:32.493479+0000","last_active":"2024-01-20T11:07:34.806471+0000","last_peered":"2024-01-20T11:07:34.806471+0000","last_clean":"2024-01-20T11:07:34.806471+0000","last_became_active":"2024-01-20T11:07:32.493225+0000","last_became_peered":"2024-01-20T11:07:32.493225+0000","last_unstale":"2024-01-20T11:07:34.806471+0000","last_undegraded":"2024-01-20T11:07:34.806471+0000","last_fullsized":"2024-01-20T11:07:34.806471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501201+0000","last_change":"2024-01-20T11:07:32.499811+0000","last_active":"2024-01-20T11:07:33.501201+0000","last_peered":"2024-01-20T11:07:33.501201+0000","last_clean":"2024-01-20T11:07:33.501201+0000","last_became_active":"2024-01-20T11:07:32.499484+0000","last_became_peered":"2024-01-20T11:07:32.499484+0000","last_unstale":"2024-01-20T11:07:33.501201+0000","last_undegraded":"2024-01-20T11:07:33.501201+0000","last_fullsized":"2024-01-20T11:07:33.501201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:30.067143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497885+0000","last_change":"2024-01-20T11:07:32.502715+0000","last_active":"2024-01-20T11:07:33.497885+0000","last_peered":"2024-01-20T11:07:33.497885+0000","last_clean":"2024-01-20T11:07:33.497885+0000","last_became_active":"2024-01-20T11:07:32.502450+0000","last_became_peered":"2024-01-20T11:07:32.502450+0000","last_unstale":"2024-01-20T11:07:33.497885+0000","last_undegraded":"2024-01-20T11:07:33.497885+0000","last_fullsized":"2024-01-20T11:07:33.497885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.007672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389175+0000","last_change":"2024-01-20T11:07:32.489772+0000","last_active":"2024-01-20T11:07:34.389175+0000","last_peered":"2024-01-20T11:07:34.389175+0000","last_clean":"2024-01-20T11:07:34.389175+0000","last_became_active":"2024-01-20T11:07:32.489524+0000","last_became_peered":"2024-01-20T11:07:32.489524+0000","last_unstale":"2024-01-20T11:07:34.389175+0000","last_undegraded":"2024-01-20T11:07:34.389175+0000","last_fullsized":"2024-01-20T11:07:34.389175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:33:13.388821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809351+0000","last_change":"2024-01-20T11:07:32.494072+0000","last_active":"2024-01-20T11:07:34.809351+0000","last_peered":"2024-01-20T11:07:34.809351+0000","last_clean":"2024-01-20T11:07:34.809351+0000","last_became_active":"2024-01-20T11:07:32.493626+0000","last_became_peered":"2024-01-20T11:07:32.493626+0000","last_unstale":"2024-01-20T11:07:34.809351+0000","last_undegraded":"2024-01-20T11:07:34.809351+0000","last_fullsized":"2024-01-20T11:07:34.809351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:30.634124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308311+0000","last_change":"2024-01-20T11:07:31.495270+0000","last_active":"2024-01-20T11:07:34.308311+0000","last_peered":"2024-01-20T11:07:34.308311+0000","last_clean":"2024-01-20T11:07:34.308311+0000","last_became_active":"2024-01-20T11:07:31.494820+0000","last_became_peered":"2024-01-20T11:07:31.494820+0000","last_unstale":"2024-01-20T11:07:34.308311+0000","last_undegraded":"2024-01-20T11:07:34.308311+0000","last_fullsized":"2024-01-20T11:07:34.308311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806587+0000","last_change":"2024-01-20T11:07:32.502657+0000","last_active":"2024-01-20T11:07:34.806587+0000","last_peered":"2024-01-20T11:07:34.806587+0000","last_clean":"2024-01-20T11:07:34.806587+0000","last_became_active":"2024-01-20T11:07:32.502221+0000","last_became_peered":"2024-01-20T11:07:32.502221+0000","last_unstale":"2024-01-20T11:07:34.806587+0000","last_undegraded":"2024-01-20T11:07:34.806587+0000","last_fullsized":"2024-01-20T11:07:34.806587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389440+0000","last_change":"2024-01-20T11:07:31.493668+0000","last_active":"2024-01-20T11:07:34.389440+0000","last_peered":"2024-01-20T11:07:34.389440+0000","last_clean":"2024-01-20T11:07:34.389440+0000","last_became_active":"2024-01-20T11:07:31.493350+0000","last_became_peered":"2024-01-20T11:07:31.493350+0000","last_unstale":"2024-01-20T11:07:34.389440+0000","last_undegraded":"2024-01-20T11:07:34.389440+0000","last_fullsized":"2024-01-20T11:07:34.389440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307546+0000","last_change":"2024-01-20T11:07:31.500395+0000","last_active":"2024-01-20T11:07:34.307546+0000","last_peered":"2024-01-20T11:07:34.307546+0000","last_clean":"2024-01-20T11:07:34.307546+0000","last_became_active":"2024-01-20T11:07:31.500032+0000","last_became_peered":"2024-01-20T11:07:31.500032+0000","last_unstale":"2024-01-20T11:07:34.307546+0000","last_undegraded":"2024-01-20T11:07:34.307546+0000","last_fullsized":"2024-01-20T11:07:34.307546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:18:38.315489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307397+0000","last_change":"2024-01-20T11:07:32.494245+0000","last_active":"2024-01-20T11:07:34.307397+0000","last_peered":"2024-01-20T11:07:34.307397+0000","last_clean":"2024-01-20T11:07:34.307397+0000","last_became_active":"2024-01-20T11:07:32.493862+0000","last_became_peered":"2024-01-20T11:07:32.493862+0000","last_unstale":"2024-01-20T11:07:34.307397+0000","last_undegraded":"2024-01-20T11:07:34.307397+0000","last_fullsized":"2024-01-20T11:07:34.307397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502269+0000","last_change":"2024-01-20T11:07:31.483052+0000","last_active":"2024-01-20T11:07:33.502269+0000","last_peered":"2024-01-20T11:07:33.502269+0000","last_clean":"2024-01-20T11:07:33.502269+0000","last_became_active":"2024-01-20T11:07:31.482767+0000","last_became_peered":"2024-01-20T11:07:31.482767+0000","last_unstale":"2024-01-20T11:07:33.502269+0000","last_undegraded":"2024-01-20T11:07:33.502269+0000","last_fullsized":"2024-01-20T11:07:33.502269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159527+0000","last_change":"2024-01-20T11:07:32.492275+0000","last_active":"2024-01-20T11:07:34.159527+0000","last_peered":"2024-01-20T11:07:34.159527+0000","last_clean":"2024-01-20T11:07:34.159527+0000","last_became_active":"2024-01-20T11:07:32.491992+0000","last_became_peered":"2024-01-20T11:07:32.491992+0000","last_unstale":"2024-01-20T11:07:34.159527+0000","last_undegraded":"2024-01-20T11:07:34.159527+0000","last_fullsized":"2024-01-20T11:07:34.159527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:21:36.093817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390038+0000","last_change":"2024-01-20T11:07:31.495203+0000","last_active":"2024-01-20T11:07:34.390038+0000","last_peered":"2024-01-20T11:07:34.390038+0000","last_clean":"2024-01-20T11:07:34.390038+0000","last_became_active":"2024-01-20T11:07:31.494906+0000","last_became_peered":"2024-01-20T11:07:31.494906+0000","last_unstale":"2024-01-20T11:07:34.390038+0000","last_undegraded":"2024-01-20T11:07:34.390038+0000","last_fullsized":"2024-01-20T11:07:34.390038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502013+0000","last_change":"2024-01-20T11:07:32.517083+0000","last_active":"2024-01-20T11:07:33.502013+0000","last_peered":"2024-01-20T11:07:33.502013+0000","last_clean":"2024-01-20T11:07:33.502013+0000","last_became_active":"2024-01-20T11:07:32.516815+0000","last_became_peered":"2024-01-20T11:07:32.516815+0000","last_unstale":"2024-01-20T11:07:33.502013+0000","last_undegraded":"2024-01-20T11:07:33.502013+0000","last_fullsized":"2024-01-20T11:07:33.502013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502340+0000","last_change":"2024-01-20T11:07:31.497490+0000","last_active":"2024-01-20T11:07:33.502340+0000","last_peered":"2024-01-20T11:07:33.502340+0000","last_clean":"2024-01-20T11:07:33.502340+0000","last_became_active":"2024-01-20T11:07:31.497068+0000","last_became_peered":"2024-01-20T11:07:31.497068+0000","last_unstale":"2024-01-20T11:07:33.502340+0000","last_undegraded":"2024-01-20T11:07:33.502340+0000","last_fullsized":"2024-01-20T11:07:33.502340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806995+0000","last_change":"2024-01-20T11:07:32.508883+0000","last_active":"2024-01-20T11:07:34.806995+0000","last_peered":"2024-01-20T11:07:34.806995+0000","last_clean":"2024-01-20T11:07:34.806995+0000","last_became_active":"2024-01-20T11:07:32.508389+0000","last_became_peered":"2024-01-20T11:07:32.508389+0000","last_unstale":"2024-01-20T11:07:34.806995+0000","last_undegraded":"2024-01-20T11:07:34.806995+0000","last_fullsized":"2024-01-20T11:07:34.806995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160453+0000","last_change":"2024-01-20T11:07:31.487647+0000","last_active":"2024-01-20T11:07:34.160453+0000","last_peered":"2024-01-20T11:07:34.160453+0000","last_clean":"2024-01-20T11:07:34.160453+0000","last_became_active":"2024-01-20T11:07:31.487411+0000","last_became_peered":"2024-01-20T11:07:31.487411+0000","last_unstale":"2024-01-20T11:07:34.160453+0000","last_undegraded":"2024-01-20T11:07:34.160453+0000","last_fullsized":"2024-01-20T11:07:34.160453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:41.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.810048+0000","last_change":"2024-01-20T11:07:32.511836+0000","last_active":"2024-01-20T11:07:34.810048+0000","last_peered":"2024-01-20T11:07:34.810048+0000","last_clean":"2024-01-20T11:07:34.810048+0000","last_became_active":"2024-01-20T11:07:32.510548+0000","last_became_peered":"2024-01-20T11:07:32.510548+0000","last_unstale":"2024-01-20T11:07:34.810048+0000","last_undegraded":"2024-01-20T11:07:34.810048+0000","last_fullsized":"2024-01-20T11:07:34.810048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:50.078866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389476+0000","last_change":"2024-01-20T11:07:31.492414+0000","last_active":"2024-01-20T11:07:34.389476+0000","last_peered":"2024-01-20T11:07:34.389476+0000","last_clean":"2024-01-20T11:07:34.389476+0000","last_became_active":"2024-01-20T11:07:31.491799+0000","last_became_peered":"2024-01-20T11:07:31.491799+0000","last_unstale":"2024-01-20T11:07:34.389476+0000","last_undegraded":"2024-01-20T11:07:34.389476+0000","last_fullsized":"2024-01-20T11:07:34.389476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498912+0000","last_change":"2024-01-20T11:07:32.510180+0000","last_active":"2024-01-20T11:07:33.498912+0000","last_peered":"2024-01-20T11:07:33.498912+0000","last_clean":"2024-01-20T11:07:33.498912+0000","last_became_active":"2024-01-20T11:07:32.509697+0000","last_became_peered":"2024-01-20T11:07:32.509697+0000","last_unstale":"2024-01-20T11:07:33.498912+0000","last_undegraded":"2024-01-20T11:07:33.498912+0000","last_fullsized":"2024-01-20T11:07:33.498912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.641512+0000","last_change":"2024-01-20T11:07:31.482038+0000","last_active":"2024-01-20T11:07:34.641512+0000","last_peered":"2024-01-20T11:07:34.641512+0000","last_clean":"2024-01-20T11:07:34.641512+0000","last_became_active":"2024-01-20T11:07:31.480827+0000","last_became_peered":"2024-01-20T11:07:31.480827+0000","last_unstale":"2024-01-20T11:07:34.641512+0000","last_undegraded":"2024-01-20T11:07:34.641512+0000","last_fullsized":"2024-01-20T11:07:34.641512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:55:30.237540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806508+0000","last_change":"2024-01-20T11:07:32.506977+0000","last_active":"2024-01-20T11:07:34.806508+0000","last_peered":"2024-01-20T11:07:34.806508+0000","last_clean":"2024-01-20T11:07:34.806508+0000","last_became_active":"2024-01-20T11:07:32.506670+0000","last_became_peered":"2024-01-20T11:07:32.506670+0000","last_unstale":"2024-01-20T11:07:34.806508+0000","last_undegraded":"2024-01-20T11:07:34.806508+0000","last_fullsized":"2024-01-20T11:07:34.806508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501345+0000","last_change":"2024-01-20T11:07:31.490601+0000","last_active":"2024-01-20T11:07:33.501345+0000","last_peered":"2024-01-20T11:07:33.501345+0000","last_clean":"2024-01-20T11:07:33.501345+0000","last_became_active":"2024-01-20T11:07:31.490325+0000","last_became_peered":"2024-01-20T11:07:31.490325+0000","last_unstale":"2024-01-20T11:07:33.501345+0000","last_undegraded":"2024-01-20T11:07:33.501345+0000","last_fullsized":"2024-01-20T11:07:33.501345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:30.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499267+0000","last_change":"2024-01-20T11:07:32.511343+0000","last_active":"2024-01-20T11:07:33.499267+0000","last_peered":"2024-01-20T11:07:33.499267+0000","last_clean":"2024-01-20T11:07:33.499267+0000","last_became_active":"2024-01-20T11:07:32.510728+0000","last_became_peered":"2024-01-20T11:07:32.510728+0000","last_unstale":"2024-01-20T11:07:33.499267+0000","last_undegraded":"2024-01-20T11:07:33.499267+0000","last_fullsized":"2024-01-20T11:07:33.499267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:21.589327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389024+0000","last_change":"2024-01-20T11:07:31.498147+0000","last_active":"2024-01-20T11:07:34.389024+0000","last_peered":"2024-01-20T11:07:34.389024+0000","last_clean":"2024-01-20T11:07:34.389024+0000","last_became_active":"2024-01-20T11:07:31.497862+0000","last_became_peered":"2024-01-20T11:07:31.497862+0000","last_unstale":"2024-01-20T11:07:34.389024+0000","last_undegraded":"2024-01-20T11:07:34.389024+0000","last_fullsized":"2024-01-20T11:07:34.389024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:13:45.037746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389272+0000","last_change":"2024-01-20T11:07:32.488914+0000","last_active":"2024-01-20T11:07:34.389272+0000","last_peered":"2024-01-20T11:07:34.389272+0000","last_clean":"2024-01-20T11:07:34.389272+0000","last_became_active":"2024-01-20T11:07:32.488534+0000","last_became_peered":"2024-01-20T11:07:32.488534+0000","last_unstale":"2024-01-20T11:07:34.389272+0000","last_undegraded":"2024-01-20T11:07:34.389272+0000","last_fullsized":"2024-01-20T11:07:34.389272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:39:13.261432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497591+0000","last_change":"2024-01-20T11:07:31.478318+0000","last_active":"2024-01-20T11:07:33.497591+0000","last_peered":"2024-01-20T11:07:33.497591+0000","last_clean":"2024-01-20T11:07:33.497591+0000","last_became_active":"2024-01-20T11:07:31.477994+0000","last_became_peered":"2024-01-20T11:07:31.477994+0000","last_unstale":"2024-01-20T11:07:33.497591+0000","last_undegraded":"2024-01-20T11:07:33.497591+0000","last_fullsized":"2024-01-20T11:07:33.497591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:28:19.098438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498521+0000","last_change":"2024-01-20T11:07:32.513578+0000","last_active":"2024-01-20T11:07:33.498521+0000","last_peered":"2024-01-20T11:07:33.498521+0000","last_clean":"2024-01-20T11:07:33.498521+0000","last_became_active":"2024-01-20T11:07:32.512877+0000","last_became_peered":"2024-01-20T11:07:32.512877+0000","last_unstale":"2024-01-20T11:07:33.498521+0000","last_undegraded":"2024-01-20T11:07:33.498521+0000","last_fullsized":"2024-01-20T11:07:33.498521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.727077+0000","last_change":"2024-01-20T11:07:31.484253+0000","last_active":"2024-01-20T11:07:34.727077+0000","last_peered":"2024-01-20T11:07:34.727077+0000","last_clean":"2024-01-20T11:07:34.727077+0000","last_became_active":"2024-01-20T11:07:31.483906+0000","last_became_peered":"2024-01-20T11:07:31.483906+0000","last_unstale":"2024-01-20T11:07:34.727077+0000","last_undegraded":"2024-01-20T11:07:34.727077+0000","last_fullsized":"2024-01-20T11:07:34.727077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:36:56.507275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500008+0000","last_change":"2024-01-20T11:07:32.514965+0000","last_active":"2024-01-20T11:07:33.500008+0000","last_peered":"2024-01-20T11:07:33.500008+0000","last_clean":"2024-01-20T11:07:33.500008+0000","last_became_active":"2024-01-20T11:07:32.514653+0000","last_became_peered":"2024-01-20T11:07:32.514653+0000","last_unstale":"2024-01-20T11:07:33.500008+0000","last_undegraded":"2024-01-20T11:07:33.500008+0000","last_fullsized":"2024-01-20T11:07:33.500008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:57:36.226100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498288+0000","last_change":"2024-01-20T11:07:31.483149+0000","last_active":"2024-01-20T11:07:33.498288+0000","last_peered":"2024-01-20T11:07:33.498288+0000","last_clean":"2024-01-20T11:07:33.498288+0000","last_became_active":"2024-01-20T11:07:31.482857+0000","last_became_peered":"2024-01-20T11:07:31.482857+0000","last_unstale":"2024-01-20T11:07:33.498288+0000","last_undegraded":"2024-01-20T11:07:33.498288+0000","last_fullsized":"2024-01-20T11:07:33.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499404+0000","last_change":"2024-01-20T11:07:32.511923+0000","last_active":"2024-01-20T11:07:33.499404+0000","last_peered":"2024-01-20T11:07:33.499404+0000","last_clean":"2024-01-20T11:07:33.499404+0000","last_became_active":"2024-01-20T11:07:32.511673+0000","last_became_peered":"2024-01-20T11:07:32.511673+0000","last_unstale":"2024-01-20T11:07:33.499404+0000","last_undegraded":"2024-01-20T11:07:33.499404+0000","last_fullsized":"2024-01-20T11:07:33.499404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:17.125662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160314+0000","last_change":"2024-01-20T11:07:31.483039+0000","last_active":"2024-01-20T11:07:34.160314+0000","last_peered":"2024-01-20T11:07:34.160314+0000","last_clean":"2024-01-20T11:07:34.160314+0000","last_became_active":"2024-01-20T11:07:31.482677+0000","last_became_peered":"2024-01-20T11:07:31.482677+0000","last_unstale":"2024-01-20T11:07:34.160314+0000","last_undegraded":"2024-01-20T11:07:34.160314+0000","last_fullsized":"2024-01-20T11:07:34.160314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:56.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.502126+0000","last_change":"2024-01-20T11:07:32.507370+0000","last_active":"2024-01-20T11:07:33.502126+0000","last_peered":"2024-01-20T11:07:33.502126+0000","last_clean":"2024-01-20T11:07:33.502126+0000","last_became_active":"2024-01-20T11:07:32.505163+0000","last_became_peered":"2024-01-20T11:07:32.505163+0000","last_unstale":"2024-01-20T11:07:33.502126+0000","last_undegraded":"2024-01-20T11:07:33.502126+0000","last_fullsized":"2024-01-20T11:07:33.502126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:40:40.797016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497973+0000","last_change":"2024-01-20T11:07:31.487538+0000","last_active":"2024-01-20T11:07:33.497973+0000","last_peered":"2024-01-20T11:07:33.497973+0000","last_clean":"2024-01-20T11:07:33.497973+0000","last_became_active":"2024-01-20T11:07:31.487176+0000","last_became_peered":"2024-01-20T11:07:31.487176+0000","last_unstale":"2024-01-20T11:07:33.497973+0000","last_undegraded":"2024-01-20T11:07:33.497973+0000","last_fullsized":"2024-01-20T11:07:33.497973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:35.843485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499114+0000","last_change":"2024-01-20T11:07:32.523249+0000","last_active":"2024-01-20T11:07:33.499114+0000","last_peered":"2024-01-20T11:07:33.499114+0000","last_clean":"2024-01-20T11:07:33.499114+0000","last_became_active":"2024-01-20T11:07:32.523025+0000","last_became_peered":"2024-01-20T11:07:32.523025+0000","last_unstale":"2024-01-20T11:07:33.499114+0000","last_undegraded":"2024-01-20T11:07:33.499114+0000","last_fullsized":"2024-01-20T11:07:33.499114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:10.757513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:32.493831+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:07:32.493831+0000","last_peered":"2024-01-20T11:07:32.493831+0000","last_clean":"2024-01-20T11:07:32.493831+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:07:32.493831+0000","last_undegraded":"2024-01-20T11:07:32.493831+0000","last_fullsized":"2024-01-20T11:07:32.493831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.500923+0000","last_change":"2024-01-20T11:07:31.485438+0000","last_active":"2024-01-20T11:07:33.500923+0000","last_peered":"2024-01-20T11:07:33.500923+0000","last_clean":"2024-01-20T11:07:33.500923+0000","last_became_active":"2024-01-20T11:07:31.485131+0000","last_became_peered":"2024-01-20T11:07:31.485131+0000","last_unstale":"2024-01-20T11:07:33.500923+0000","last_undegraded":"2024-01-20T11:07:33.500923+0000","last_fullsized":"2024-01-20T11:07:33.500923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307797+0000","last_change":"2024-01-20T11:07:32.503033+0000","last_active":"2024-01-20T11:07:34.307797+0000","last_peered":"2024-01-20T11:07:34.307797+0000","last_clean":"2024-01-20T11:07:34.307797+0000","last_became_active":"2024-01-20T11:07:32.502390+0000","last_became_peered":"2024-01-20T11:07:32.502390+0000","last_unstale":"2024-01-20T11:07:34.307797+0000","last_undegraded":"2024-01-20T11:07:34.307797+0000","last_fullsized":"2024-01-20T11:07:34.307797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497374+0000","last_change":"2024-01-20T11:07:31.493977+0000","last_active":"2024-01-20T11:07:33.497374+0000","last_peered":"2024-01-20T11:07:33.497374+0000","last_clean":"2024-01-20T11:07:33.497374+0000","last_became_active":"2024-01-20T11:07:31.493633+0000","last_became_peered":"2024-01-20T11:07:31.493633+0000","last_unstale":"2024-01-20T11:07:33.497374+0000","last_undegraded":"2024-01-20T11:07:33.497374+0000","last_fullsized":"2024-01-20T11:07:33.497374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:57.388224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806243+0000","last_change":"2024-01-20T11:07:32.506901+0000","last_active":"2024-01-20T11:07:34.806243+0000","last_peered":"2024-01-20T11:07:34.806243+0000","last_clean":"2024-01-20T11:07:34.806243+0000","last_became_active":"2024-01-20T11:07:32.506048+0000","last_became_peered":"2024-01-20T11:07:32.506048+0000","last_unstale":"2024-01-20T11:07:34.806243+0000","last_undegraded":"2024-01-20T11:07:34.806243+0000","last_fullsized":"2024-01-20T11:07:34.806243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:33.156389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497694+0000","last_change":"2024-01-20T11:07:31.489897+0000","last_active":"2024-01-20T11:07:33.497694+0000","last_peered":"2024-01-20T11:07:33.497694+0000","last_clean":"2024-01-20T11:07:33.497694+0000","last_became_active":"2024-01-20T11:07:31.489264+0000","last_became_peered":"2024-01-20T11:07:31.489264+0000","last_unstale":"2024-01-20T11:07:33.497694+0000","last_undegraded":"2024-01-20T11:07:33.497694+0000","last_fullsized":"2024-01-20T11:07:33.497694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159751+0000","last_change":"2024-01-20T11:07:32.489551+0000","last_active":"2024-01-20T11:07:34.159751+0000","last_peered":"2024-01-20T11:07:34.159751+0000","last_clean":"2024-01-20T11:07:34.159751+0000","last_became_active":"2024-01-20T11:07:32.489277+0000","last_became_peered":"2024-01-20T11:07:32.489277+0000","last_unstale":"2024-01-20T11:07:34.159751+0000","last_undegraded":"2024-01-20T11:07:34.159751+0000","last_fullsized":"2024-01-20T11:07:34.159751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:48.457758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501412+0000","last_change":"2024-01-20T11:07:31.483881+0000","last_active":"2024-01-20T11:07:33.501412+0000","last_peered":"2024-01-20T11:07:33.501412+0000","last_clean":"2024-01-20T11:07:33.501412+0000","last_became_active":"2024-01-20T11:07:31.483528+0000","last_became_peered":"2024-01-20T11:07:31.483528+0000","last_unstale":"2024-01-20T11:07:33.501412+0000","last_undegraded":"2024-01-20T11:07:33.501412+0000","last_fullsized":"2024-01-20T11:07:33.501412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:36:06.726593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809531+0000","last_change":"2024-01-20T11:07:32.496285+0000","last_active":"2024-01-20T11:07:34.809531+0000","last_peered":"2024-01-20T11:07:34.809531+0000","last_clean":"2024-01-20T11:07:34.809531+0000","last_became_active":"2024-01-20T11:07:32.495112+0000","last_became_peered":"2024-01-20T11:07:32.495112+0000","last_unstale":"2024-01-20T11:07:34.809531+0000","last_undegraded":"2024-01-20T11:07:34.809531+0000","last_fullsized":"2024-01-20T11:07:34.809531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:32:26.335373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159900+0000","last_change":"2024-01-20T11:07:31.481611+0000","last_active":"2024-01-20T11:07:34.159900+0000","last_peered":"2024-01-20T11:07:34.159900+0000","last_clean":"2024-01-20T11:07:34.159900+0000","last_became_active":"2024-01-20T11:07:31.481322+0000","last_became_peered":"2024-01-20T11:07:31.481322+0000","last_unstale":"2024-01-20T11:07:34.159900+0000","last_undegraded":"2024-01-20T11:07:34.159900+0000","last_fullsized":"2024-01-20T11:07:34.159900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:42:49.040069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501882+0000","last_change":"2024-01-20T11:07:32.506000+0000","last_active":"2024-01-20T11:07:33.501882+0000","last_peered":"2024-01-20T11:07:33.501882+0000","last_clean":"2024-01-20T11:07:33.501882+0000","last_became_active":"2024-01-20T11:07:32.505039+0000","last_became_peered":"2024-01-20T11:07:32.505039+0000","last_unstale":"2024-01-20T11:07:33.501882+0000","last_undegraded":"2024-01-20T11:07:33.501882+0000","last_fullsized":"2024-01-20T11:07:33.501882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:03:21.752780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499473+0000","last_change":"2024-01-20T11:07:31.496162+0000","last_active":"2024-01-20T11:07:33.499473+0000","last_peered":"2024-01-20T11:07:33.499473+0000","last_clean":"2024-01-20T11:07:33.499473+0000","last_became_active":"2024-01-20T11:07:31.495742+0000","last_became_peered":"2024-01-20T11:07:31.495742+0000","last_unstale":"2024-01-20T11:07:33.499473+0000","last_undegraded":"2024-01-20T11:07:33.499473+0000","last_fullsized":"2024-01-20T11:07:33.499473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:37:17.428810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.160078+0000","last_change":"2024-01-20T11:07:32.489292+0000","last_active":"2024-01-20T11:07:34.160078+0000","last_peered":"2024-01-20T11:07:34.160078+0000","last_clean":"2024-01-20T11:07:34.160078+0000","last_became_active":"2024-01-20T11:07:32.488833+0000","last_became_peered":"2024-01-20T11:07:32.488833+0000","last_unstale":"2024-01-20T11:07:34.160078+0000","last_undegraded":"2024-01-20T11:07:34.160078+0000","last_fullsized":"2024-01-20T11:07:34.160078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:03:48.348342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.728088+0000","last_change":"2024-01-20T11:07:31.499423+0000","last_active":"2024-01-20T11:07:34.728088+0000","last_peered":"2024-01-20T11:07:34.728088+0000","last_clean":"2024-01-20T11:07:34.728088+0000","last_became_active":"2024-01-20T11:07:31.499207+0000","last_became_peered":"2024-01-20T11:07:31.499207+0000","last_unstale":"2024-01-20T11:07:34.728088+0000","last_undegraded":"2024-01-20T11:07:34.728088+0000","last_fullsized":"2024-01-20T11:07:34.728088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:38:53.823701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307987+0000","last_change":"2024-01-20T11:07:32.518826+0000","last_active":"2024-01-20T11:07:34.307987+0000","last_peered":"2024-01-20T11:07:34.307987+0000","last_clean":"2024-01-20T11:07:34.307987+0000","last_became_active":"2024-01-20T11:07:32.518540+0000","last_became_peered":"2024-01-20T11:07:32.518540+0000","last_unstale":"2024-01-20T11:07:34.307987+0000","last_undegraded":"2024-01-20T11:07:34.307987+0000","last_fullsized":"2024-01-20T11:07:34.307987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:12:49.049777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.390151+0000","last_change":"2024-01-20T11:07:31.498846+0000","last_active":"2024-01-20T11:07:34.390151+0000","last_peered":"2024-01-20T11:07:34.390151+0000","last_clean":"2024-01-20T11:07:34.390151+0000","last_became_active":"2024-01-20T11:07:31.498477+0000","last_became_peered":"2024-01-20T11:07:31.498477+0000","last_unstale":"2024-01-20T11:07:34.390151+0000","last_undegraded":"2024-01-20T11:07:34.390151+0000","last_fullsized":"2024-01-20T11:07:34.390151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806874+0000","last_change":"2024-01-20T11:07:32.495729+0000","last_active":"2024-01-20T11:07:34.806874+0000","last_peered":"2024-01-20T11:07:34.806874+0000","last_clean":"2024-01-20T11:07:34.806874+0000","last_became_active":"2024-01-20T11:07:32.493695+0000","last_became_peered":"2024-01-20T11:07:32.493695+0000","last_unstale":"2024-01-20T11:07:34.806874+0000","last_undegraded":"2024-01-20T11:07:34.806874+0000","last_fullsized":"2024-01-20T11:07:34.806874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:13.643405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.497112+0000","last_change":"2024-01-20T11:07:31.495706+0000","last_active":"2024-01-20T11:07:33.497112+0000","last_peered":"2024-01-20T11:07:33.497112+0000","last_clean":"2024-01-20T11:07:33.497112+0000","last_became_active":"2024-01-20T11:07:31.495412+0000","last_became_peered":"2024-01-20T11:07:31.495412+0000","last_unstale":"2024-01-20T11:07:33.497112+0000","last_undegraded":"2024-01-20T11:07:33.497112+0000","last_fullsized":"2024-01-20T11:07:33.497112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:16:23.120445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.809395+0000","last_change":"2024-01-20T11:07:32.492080+0000","last_active":"2024-01-20T11:07:34.809395+0000","last_peered":"2024-01-20T11:07:34.809395+0000","last_clean":"2024-01-20T11:07:34.809395+0000","last_became_active":"2024-01-20T11:07:32.491063+0000","last_became_peered":"2024-01-20T11:07:32.491063+0000","last_unstale":"2024-01-20T11:07:34.809395+0000","last_undegraded":"2024-01-20T11:07:34.809395+0000","last_fullsized":"2024-01-20T11:07:34.809395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:42.421665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159828+0000","last_change":"2024-01-20T11:07:31.485898+0000","last_active":"2024-01-20T11:07:34.159828+0000","last_peered":"2024-01-20T11:07:34.159828+0000","last_clean":"2024-01-20T11:07:34.159828+0000","last_became_active":"2024-01-20T11:07:31.485601+0000","last_became_peered":"2024-01-20T11:07:31.485601+0000","last_unstale":"2024-01-20T11:07:34.159828+0000","last_undegraded":"2024-01-20T11:07:34.159828+0000","last_fullsized":"2024-01-20T11:07:34.159828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:07.000653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.307529+0000","last_change":"2024-01-20T11:07:32.491885+0000","last_active":"2024-01-20T11:07:34.307529+0000","last_peered":"2024-01-20T11:07:34.307529+0000","last_clean":"2024-01-20T11:07:34.307529+0000","last_became_active":"2024-01-20T11:07:32.491603+0000","last_became_peered":"2024-01-20T11:07:32.491603+0000","last_unstale":"2024-01-20T11:07:34.307529+0000","last_undegraded":"2024-01-20T11:07:34.307529+0000","last_fullsized":"2024-01-20T11:07:34.307529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:54:26.557397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.159878+0000","last_change":"2024-01-20T11:07:31.492532+0000","last_active":"2024-01-20T11:07:34.159878+0000","last_peered":"2024-01-20T11:07:34.159878+0000","last_clean":"2024-01-20T11:07:34.159878+0000","last_became_active":"2024-01-20T11:07:31.492086+0000","last_became_peered":"2024-01-20T11:07:31.492086+0000","last_unstale":"2024-01-20T11:07:34.159878+0000","last_undegraded":"2024-01-20T11:07:34.159878+0000","last_fullsized":"2024-01-20T11:07:34.159878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:25:29.595328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308413+0000","last_change":"2024-01-20T11:07:32.496745+0000","last_active":"2024-01-20T11:07:34.308413+0000","last_peered":"2024-01-20T11:07:34.308413+0000","last_clean":"2024-01-20T11:07:34.308413+0000","last_became_active":"2024-01-20T11:07:32.496476+0000","last_became_peered":"2024-01-20T11:07:32.496476+0000","last_unstale":"2024-01-20T11:07:34.308413+0000","last_undegraded":"2024-01-20T11:07:34.308413+0000","last_fullsized":"2024-01-20T11:07:34.308413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:39.339171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499806+0000","last_change":"2024-01-20T11:07:31.497898+0000","last_active":"2024-01-20T11:07:33.499806+0000","last_peered":"2024-01-20T11:07:33.499806+0000","last_clean":"2024-01-20T11:07:33.499806+0000","last_became_active":"2024-01-20T11:07:31.497633+0000","last_became_peered":"2024-01-20T11:07:31.497633+0000","last_unstale":"2024-01-20T11:07:33.499806+0000","last_undegraded":"2024-01-20T11:07:33.499806+0000","last_fullsized":"2024-01-20T11:07:33.499806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:16:12.889750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.389455+0000","last_change":"2024-01-20T11:07:32.502048+0000","last_active":"2024-01-20T11:07:34.389455+0000","last_peered":"2024-01-20T11:07:34.389455+0000","last_clean":"2024-01-20T11:07:34.389455+0000","last_became_active":"2024-01-20T11:07:32.501771+0000","last_became_peered":"2024-01-20T11:07:32.501771+0000","last_unstale":"2024-01-20T11:07:34.389455+0000","last_undegraded":"2024-01-20T11:07:34.389455+0000","last_fullsized":"2024-01-20T11:07:34.389455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:32:32.890454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501677+0000","last_change":"2024-01-20T11:07:32.505630+0000","last_active":"2024-01-20T11:07:33.501677+0000","last_peered":"2024-01-20T11:07:33.501677+0000","last_clean":"2024-01-20T11:07:33.501677+0000","last_became_active":"2024-01-20T11:07:32.505349+0000","last_became_peered":"2024-01-20T11:07:32.505349+0000","last_unstale":"2024-01-20T11:07:33.501677+0000","last_undegraded":"2024-01-20T11:07:33.501677+0000","last_fullsized":"2024-01-20T11:07:33.501677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:03.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.498700+0000","last_change":"2024-01-20T11:07:31.500045+0000","last_active":"2024-01-20T11:07:33.498700+0000","last_peered":"2024-01-20T11:07:33.498700+0000","last_clean":"2024-01-20T11:07:33.498700+0000","last_became_active":"2024-01-20T11:07:31.499737+0000","last_became_peered":"2024-01-20T11:07:31.499737+0000","last_unstale":"2024-01-20T11:07:33.498700+0000","last_undegraded":"2024-01-20T11:07:33.498700+0000","last_fullsized":"2024-01-20T11:07:33.498700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:34.222349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.501807+0000","last_change":"2024-01-20T11:07:32.506908+0000","last_active":"2024-01-20T11:07:33.501807+0000","last_peered":"2024-01-20T11:07:33.501807+0000","last_clean":"2024-01-20T11:07:33.501807+0000","last_became_active":"2024-01-20T11:07:32.506541+0000","last_became_peered":"2024-01-20T11:07:32.506541+0000","last_unstale":"2024-01-20T11:07:33.501807+0000","last_undegraded":"2024-01-20T11:07:33.501807+0000","last_fullsized":"2024-01-20T11:07:33.501807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:19.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:33.499153+0000","last_change":"2024-01-20T11:07:31.500669+0000","last_active":"2024-01-20T11:07:33.499153+0000","last_peered":"2024-01-20T11:07:33.499153+0000","last_clean":"2024-01-20T11:07:33.499153+0000","last_became_active":"2024-01-20T11:07:31.500354+0000","last_became_peered":"2024-01-20T11:07:31.500354+0000","last_unstale":"2024-01-20T11:07:33.499153+0000","last_undegraded":"2024-01-20T11:07:33.499153+0000","last_fullsized":"2024-01-20T11:07:33.499153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:21.904186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.806868+0000","last_change":"2024-01-20T11:07:32.509179+0000","last_active":"2024-01-20T11:07:34.806868+0000","last_peered":"2024-01-20T11:07:34.806868+0000","last_clean":"2024-01-20T11:07:34.806868+0000","last_became_active":"2024-01-20T11:07:32.508667+0000","last_became_peered":"2024-01-20T11:07:32.508667+0000","last_unstale":"2024-01-20T11:07:34.806868+0000","last_undegraded":"2024-01-20T11:07:34.806868+0000","last_fullsized":"2024-01-20T11:07:34.806868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:20:49.657371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308404+0000","last_change":"2024-01-20T11:07:31.487022+0000","last_active":"2024-01-20T11:07:34.308404+0000","last_peered":"2024-01-20T11:07:34.308404+0000","last_clean":"2024-01-20T11:07:34.308404+0000","last_became_active":"2024-01-20T11:07:31.485438+0000","last_became_peered":"2024-01-20T11:07:31.485438+0000","last_unstale":"2024-01-20T11:07:34.308404+0000","last_undegraded":"2024-01-20T11:07:34.308404+0000","last_fullsized":"2024-01-20T11:07:34.308404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.308147+0000","last_change":"2024-01-20T11:07:32.498652+0000","last_active":"2024-01-20T11:07:34.308147+0000","last_peered":"2024-01-20T11:07:34.308147+0000","last_clean":"2024-01-20T11:07:34.308147+0000","last_became_active":"2024-01-20T11:07:32.498322+0000","last_became_peered":"2024-01-20T11:07:32.498322+0000","last_unstale":"2024-01-20T11:07:34.308147+0000","last_undegraded":"2024-01-20T11:07:34.308147+0000","last_fullsized":"2024-01-20T11:07:34.308147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:31.439790+0000","last_clean_scrub_stamp":"2024-01-20T11:07:31.439790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:44.830823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T11:07:34.641734+0000","last_change":"2024-01-20T11:07:31.495529+0000","last_active":"2024-01-20T11:07:34.641734+0000","last_peered":"2024-01-20T11:07:34.641734+0000","last_clean":"2024-01-20T11:07:34.641734+0000","last_became_active":"2024-01-20T11:07:31.495233+0000","last_became_peered":"2024-01-20T11:07:31.495233+0000","last_unstale":"2024-01-20T11:07:34.641734+0000","last_undegraded":"2024-01-20T11:07:34.641734+0000","last_fullsized":"2024-01-20T11:07:34.641734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:30.400993+0000","last_clean_scrub_stamp":"2024-01-20T11:07:30.400993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:36.769162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":823296,"data_stored":669678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.343}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4550000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.736}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":78854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.173}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.008}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":669734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:07:42.895 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-20T11:07:42.895 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-20T11:07:42.895 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-20T11:07:42.896 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-20T11:07:43.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.135+0000 7f97c9600640 1 Processor -- start 2024-01-20T11:07:43.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.135+0000 7f97c9600640 1 -- start start 2024-01-20T11:07:43.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c9600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c415f6f0 0x7f97c406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c9600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97c406cb10 0x7f97c4140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c9600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c413e760 con 0x7f97c413e380 2024-01-20T11:07:43.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c9600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c406d3a0 con 0x7f97c406cb10 2024-01-20T11:07:43.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c9600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40ccc70 con 0x7f97c415f6f0 2024-01-20T11:07:43.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c3400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97c406cb10 0x7f97c4140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c2a00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f97c413e380 0x7f97c415efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48174/0 (socket says 172.21.15.162:48174) 2024-01-20T11:07:43.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97bbe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c415f6f0 0x7f97c406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.137+0000 7f97c2a00640 1 -- 172.21.15.162:0/649416506 learned_addr learned my addr 172.21.15.162:0/649416506 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:43.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.138+0000 7f97c3400640 1 -- 172.21.15.162:0/649416506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c415f6f0 msgr2=0x7f97c406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:43.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.138+0000 7f97c3400640 1 --2- 172.21.15.162:0/649416506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c415f6f0 0x7f97c406c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.138+0000 7f97c3400640 1 -- 172.21.15.162:0/649416506 >> v1:172.21.15.179:6789/0 conn(0x7f97c413e380 legacy=0x7f97c415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.138+0000 7f97c3400640 1 -- 172.21.15.162:0/649416506 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c413fa50 con 0x7f97c406cb10 2024-01-20T11:07:43.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.139+0000 7f97c3400640 1 --2- 172.21.15.162:0/649416506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c406cb10 0x7f97c4140c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009d90 tx=0x7f97bc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2941c0c592a77735 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:43.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c2000640 1 -- 172.21.15.162:0/649416506 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc02cc50 con 0x7f97c406cb10 2024-01-20T11:07:43.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c2000640 1 -- 172.21.15.162:0/649416506 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc02cdb0 con 0x7f97c406cb10 2024-01-20T11:07:43.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c2000640 1 -- 172.21.15.162:0/649416506 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc034660 con 0x7f97c406cb10 2024-01-20T11:07:43.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 -- 172.21.15.162:0/649416506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c406cb10 msgr2=0x7f97c4140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 --2- 172.21.15.162:0/649416506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c406cb10 0x7f97c4140c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009d90 tx=0x7f97bc02bea0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 -- 172.21.15.162:0/649416506 shutdown_connections 2024-01-20T11:07:43.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 --2- 172.21.15.162:0/649416506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c406cb10 0x7f97c4140c10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 --2- 172.21.15.162:0/649416506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c415f6f0 0x7f97c406c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 -- 172.21.15.162:0/649416506 >> 172.21.15.162:0/649416506 conn(0x7f97c406a600 msgr2=0x7f97c406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:43.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 -- 172.21.15.162:0/649416506 shutdown_connections 2024-01-20T11:07:43.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.140+0000 7f97c9600640 1 -- 172.21.15.162:0/649416506 wait complete. 2024-01-20T11:07:43.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.142+0000 7f97c9600640 1 Processor -- start 2024-01-20T11:07:43.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.142+0000 7f97c9600640 1 -- start start 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.143+0000 7f97c9600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c406cb10 0x7f97c40b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.143+0000 7f97c9600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c413e380 0x7f97c40a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.143+0000 7f97c9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c415f6f0 0x7f97c4151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.143+0000 7f97c9600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b08e0 con 0x7f97c415f6f0 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.143+0000 7f97c9600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40a8d30 con 0x7f97c413e380 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.143+0000 7f97c9600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b0b10 con 0x7f97c406cb10 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c415f6f0 0x7f97c4151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c415f6f0 0x7f97c4151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41530/0 (socket says 172.21.15.162:41530) 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 -- 172.21.15.162:0/4232784343 learned_addr learned my addr 172.21.15.162:0/4232784343 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c2a00640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c406cb10 0x7f97c40b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97bbe00640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c413e380 0x7f97c40a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 -- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c406cb10 msgr2=0x7f97c40b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c406cb10 0x7f97c40b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 -- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c413e380 msgr2=0x7f97c40a87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c413e380 0x7f97c40a87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 -- 172.21.15.162:0/4232784343 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc009a70 con 0x7f97c415f6f0 2024-01-20T11:07:43.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97bbe00640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c413e380 0x7f97c40a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:43.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.144+0000 7f97c3400640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c415f6f0 0x7f97c4151690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009d90 tx=0x7f97bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:43.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.145+0000 7f97baa00640 1 -- 172.21.15.162:0/4232784343 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc040650 con 0x7f97c415f6f0 2024-01-20T11:07:43.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.145+0000 7f97baa00640 1 -- 172.21.15.162:0/4232784343 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc0407b0 con 0x7f97c415f6f0 2024-01-20T11:07:43.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.145+0000 7f97baa00640 1 -- 172.21.15.162:0/4232784343 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc040b60 con 0x7f97c415f6f0 2024-01-20T11:07:43.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.145+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c40b0df0 con 0x7f97c415f6f0 2024-01-20T11:07:43.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.145+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c40b13b0 con 0x7f97c415f6f0 2024-01-20T11:07:43.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.146+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c404e970 con 0x7f97c415f6f0 2024-01-20T11:07:43.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.147+0000 7f97baa00640 1 -- 172.21.15.162:0/4232784343 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f97bc040cc0 con 0x7f97c415f6f0 2024-01-20T11:07:43.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.147+0000 7f97baa00640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f979c06aed0 0x7f979c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.148+0000 7f97baa00640 1 -- 172.21.15.162:0/4232784343 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97bc0ac310 con 0x7f97c415f6f0 2024-01-20T11:07:43.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.148+0000 7f97c2a00640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f979c06aed0 0x7f979c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.148+0000 7f97c2a00640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f979c06aed0 0x7f979c06d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f97b4005880 tx=0x7f97b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:43.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.152+0000 7f97baa00640 1 -- 172.21.15.162:0/4232784343 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f97bc077270 con 0x7f97c415f6f0 2024-01-20T11:07:43.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.367+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f97c4073670 con 0x7f97c415f6f0 2024-01-20T11:07:43.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.367+0000 7f97baa00640 1 -- 172.21.15.162:0/4232784343 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f97bc009450 con 0x7f97c415f6f0 2024-01-20T11:07:43.368 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:43.368 INFO:teuthology.orchestra.run.smithi162.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f979c06aed0 msgr2=0x7f979c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f979c06aed0 0x7f979c06d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f97b4005880 tx=0x7f97b4009040 comp rx=0 tx=0).stop 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c415f6f0 msgr2=0x7f97c4151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c415f6f0 0x7f97c4151690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009d90 tx=0x7f97bc004a40 comp rx=0 tx=0).stop 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 shutdown_connections 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c415f6f0 0x7f97c4151690 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f979c06aed0 0x7f979c06d390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97c413e380 0x7f97c40a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 --2- 172.21.15.162:0/4232784343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97c406cb10 0x7f97c40b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 >> 172.21.15.162:0/4232784343 conn(0x7f97c406a600 msgr2=0x7f97c406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 shutdown_connections 2024-01-20T11:07:43.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.370+0000 7f97c9600640 1 -- 172.21.15.162:0/4232784343 wait complete. 2024-01-20T11:07:43.388 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-20T11:07:43.389 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:43.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.580+0000 7ff983200640 1 Processor -- start 2024-01-20T11:07:43.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.580+0000 7ff983200640 1 -- start start 2024-01-20T11:07:43.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff983200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff97c15a530 0x7ff97c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff983200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 0x7ff97c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff983200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c15a910 con 0x7ff97c06d7a0 2024-01-20T11:07:43.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff983200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0ca390 con 0x7ff97c15a530 2024-01-20T11:07:43.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff983200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c072960 con 0x7ff97c071260 2024-01-20T11:07:43.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff97be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff97c15a530 0x7ff97c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff981200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff97c06d7a0 0x7ff97c0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33794/0 (socket says 172.21.15.162:33794) 2024-01-20T11:07:43.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff981200640 1 -- 172.21.15.162:0/2186688408 learned_addr learned my addr 172.21.15.162:0/2186688408 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:43.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff97be00640 1 -- 172.21.15.162:0/2186688408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 msgr2=0x7ff97c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:43.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff97be00640 1 --2- 172.21.15.162:0/2186688408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 0x7ff97c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff97be00640 1 -- 172.21.15.162:0/2186688408 >> v1:172.21.15.162:6789/0 conn(0x7ff97c06d7a0 legacy=0x7ff97c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.582+0000 7ff97be00640 1 -- 172.21.15.162:0/2186688408 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0ce730 con 0x7ff97c15a530 2024-01-20T11:07:43.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.583+0000 7ff97be00640 1 --2- 172.21.15.162:0/2186688408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0cddb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0097a0 tx=0x7ff96c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fe3cfa7cb4ee0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:43.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff97b400640 1 -- 172.21.15.162:0/2186688408 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c02e070 con 0x7ff97c15a530 2024-01-20T11:07:43.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff97b400640 1 -- 172.21.15.162:0/2186688408 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c0315a0 con 0x7ff97c15a530 2024-01-20T11:07:43.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff97b400640 1 -- 172.21.15.162:0/2186688408 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c031930 con 0x7ff97c15a530 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 -- 172.21.15.162:0/2186688408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 msgr2=0x7ff97c0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 --2- 172.21.15.162:0/2186688408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0cddb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0097a0 tx=0x7ff96c02b840 comp rx=0 tx=0).stop 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 -- 172.21.15.162:0/2186688408 shutdown_connections 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 --2- 172.21.15.162:0/2186688408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 0x7ff97c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 --2- 172.21.15.162:0/2186688408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0cddb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 -- 172.21.15.162:0/2186688408 >> 172.21.15.162:0/2186688408 conn(0x7ff97c0b0cd0 msgr2=0x7ff97c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 -- 172.21.15.162:0/2186688408 shutdown_connections 2024-01-20T11:07:43.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.584+0000 7ff983200640 1 -- 172.21.15.162:0/2186688408 wait complete. 2024-01-20T11:07:43.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.586+0000 7ff983200640 1 Processor -- start 2024-01-20T11:07:43.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.586+0000 7ff983200640 1 -- start start 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff983200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c06d7a0 0x7ff97c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff983200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 0x7ff97c14b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff983200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff983200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c09a5d0 con 0x7ff97c15a530 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff983200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c156890 con 0x7ff97c06d7a0 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff983200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c155d10 con 0x7ff97c071260 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff981200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff981200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41544/0 (socket says 172.21.15.162:41544) 2024-01-20T11:07:43.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.587+0000 7ff981200640 1 -- 172.21.15.162:0/3865832003 learned_addr learned my addr 172.21.15.162:0/3865832003 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:43.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff973200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 0x7ff97c14b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff981200640 1 -- 172.21.15.162:0/3865832003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 msgr2=0x7ff97c14b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff981200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 0x7ff97c14b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff981200640 1 -- 172.21.15.162:0/3865832003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c06d7a0 msgr2=0x7ff97c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff981200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c06d7a0 0x7ff97c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff981200640 1 -- 172.21.15.162:0/3865832003 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c009400 con 0x7ff97c15a530 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff981200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0aca60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff97400cbc0 tx=0x7ff97400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff978c00640 1 -- 172.21.15.162:0/3865832003 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400ad40 con 0x7ff97c15a530 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff978c00640 1 -- 172.21.15.162:0/3865832003 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974012400 con 0x7ff97c15a530 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff978c00640 1 -- 172.21.15.162:0/3865832003 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400aea0 con 0x7ff97c15a530 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.588+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c155ff0 con 0x7ff97c15a530 2024-01-20T11:07:43.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.589+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c155a20 con 0x7ff97c15a530 2024-01-20T11:07:43.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.590+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c09a740 con 0x7ff97c15a530 2024-01-20T11:07:43.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.590+0000 7ff978c00640 1 -- 172.21.15.162:0/3865832003 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff974007070 con 0x7ff97c15a530 2024-01-20T11:07:43.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.591+0000 7ff978c00640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff95406aed0 0x7ff95406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:43.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.591+0000 7ff978c00640 1 -- 172.21.15.162:0/3865832003 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff974089500 con 0x7ff97c15a530 2024-01-20T11:07:43.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.591+0000 7ff97be00640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff95406aed0 0x7ff95406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:43.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.592+0000 7ff97be00640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff95406aed0 0x7ff95406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff96c036000 tx=0x7ff96c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:43.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.595+0000 7ff978c00640 1 -- 172.21.15.162:0/3865832003 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff9740543e0 con 0x7ff97c15a530 2024-01-20T11:07:43.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.779+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff97c0ce290 con 0x7ff97c15a530 2024-01-20T11:07:43.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.782+0000 7ff978c00640 1 -- 172.21.15.162:0/3865832003 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7ff974057a00 con 0x7ff97c15a530 2024-01-20T11:07:43.783 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:43.783 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff95406aed0 msgr2=0x7ff95406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff95406aed0 0x7ff95406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff96c036000 tx=0x7ff96c030000 comp rx=0 tx=0).stop 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 msgr2=0x7ff97c0aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0aca60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff97400cbc0 tx=0x7ff97400a430 comp rx=0 tx=0).stop 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 shutdown_connections 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff97c15a530 0x7ff97c0aca60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c071260 0x7ff97c14b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff95406aed0 0x7ff95406d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 --2- 172.21.15.162:0/3865832003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c06d7a0 0x7ff97c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 >> 172.21.15.162:0/3865832003 conn(0x7ff97c0b0cd0 msgr2=0x7ff97c0b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 shutdown_connections 2024-01-20T11:07:43.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:43.785+0000 7ff983200640 1 -- 172.21.15.162:0/3865832003 wait complete. 2024-01-20T11:07:43.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:07:43.804 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:07:44.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.011+0000 7f4d95a00640 1 Processor -- start 2024-01-20T11:07:44.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.011+0000 7f4d95a00640 1 -- start start 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d95a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d9015d5c0 0x7f4d90072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d95a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d900b29f0 0x7f4d900ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d95a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9015d9a0 con 0x7f4d9006d600 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d95a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d900acca0 con 0x7f4d9015d5c0 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d95a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9006dba0 con 0x7f4d900b29f0 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d8fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d9015d5c0 0x7f4d90072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d8f400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4d9006d600 0x7f4d900b22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33798/0 (socket says 172.21.15.162:33798) 2024-01-20T11:07:44.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d8f400640 1 -- 172.21.15.162:0/477600859 learned_addr learned my addr 172.21.15.162:0/477600859 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:44.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d95000640 1 --2- 172.21.15.162:0/477600859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d900b29f0 0x7f4d900ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d8fe00640 1 -- 172.21.15.162:0/477600859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d900b29f0 msgr2=0x7f4d900ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:44.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d8fe00640 1 --2- 172.21.15.162:0/477600859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d900b29f0 0x7f4d900ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.013+0000 7f4d8fe00640 1 -- 172.21.15.162:0/477600859 >> v1:172.21.15.162:6789/0 conn(0x7f4d9006d600 legacy=0x7f4d900b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.014+0000 7f4d8fe00640 1 -- 172.21.15.162:0/477600859 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9006de80 con 0x7f4d9015d5c0 2024-01-20T11:07:44.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.014+0000 7f4d8ea00640 1 -- 172.21.15.162:0/477600859 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748940293 0 0) 0x7f4d78001110 con 0x7f4d9006d600 2024-01-20T11:07:44.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.015+0000 7f4d8fe00640 1 --2- 172.21.15.162:0/477600859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d90072020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d800097a0 tx=0x7f4d8002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d741e1c0efac09c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.015+0000 7f4d8ea00640 1 -- 172.21.15.162:0/477600859 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80030610 con 0x7f4d9015d5c0 2024-01-20T11:07:44.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.015+0000 7f4d8ea00640 1 -- 172.21.15.162:0/477600859 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80030770 con 0x7f4d9015d5c0 2024-01-20T11:07:44.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.015+0000 7f4d8ea00640 1 -- 172.21.15.162:0/477600859 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80030b00 con 0x7f4d9015d5c0 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 -- 172.21.15.162:0/477600859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 msgr2=0x7f4d90072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 --2- 172.21.15.162:0/477600859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d90072020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d800097a0 tx=0x7f4d8002b960 comp rx=0 tx=0).stop 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 -- 172.21.15.162:0/477600859 shutdown_connections 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 --2- 172.21.15.162:0/477600859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d900b29f0 0x7f4d900ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 --2- 172.21.15.162:0/477600859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d90072020 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 -- 172.21.15.162:0/477600859 >> 172.21.15.162:0/477600859 conn(0x7f4d900b0c40 msgr2=0x7f4d900b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 -- 172.21.15.162:0/477600859 shutdown_connections 2024-01-20T11:07:44.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.016+0000 7f4d95a00640 1 -- 172.21.15.162:0/477600859 wait complete. 2024-01-20T11:07:44.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.018+0000 7f4d95a00640 1 Processor -- start 2024-01-20T11:07:44.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.018+0000 7f4d95a00640 1 -- start start 2024-01-20T11:07:44.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.019+0000 7f4d95a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d9006d600 0x7f4d90152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.019+0000 7f4d95a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d900b29f0 0x7f4d900cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.019+0000 7f4d95a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d900cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.019+0000 7f4d95a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90156b20 con 0x7f4d9015d5c0 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.019+0000 7f4d95a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90153600 con 0x7f4d900b29f0 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.019+0000 7f4d95a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90152db0 con 0x7f4d9006d600 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d900cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d900cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41566/0 (socket says 172.21.15.162:41566) 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 -- 172.21.15.162:0/932241972 learned_addr learned my addr 172.21.15.162:0/932241972 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d8fe00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d9006d600 0x7f4d90152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d8f400640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d900b29f0 0x7f4d900cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 -- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d9006d600 msgr2=0x7f4d90152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d9006d600 0x7f4d90152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 -- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d900b29f0 msgr2=0x7f4d900cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d900b29f0 0x7f4d900cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d95000640 1 -- 172.21.15.162:0/932241972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d80009400 con 0x7f4d9015d5c0 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.020+0000 7f4d8f400640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d900b29f0 0x7f4d900cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.021+0000 7f4d95000640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d900cf7d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d88007e70 tx=0x7f4d8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.021+0000 7f4d87e00640 1 -- 172.21.15.162:0/932241972 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88014420 con 0x7f4d9015d5c0 2024-01-20T11:07:44.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.021+0000 7f4d87e00640 1 -- 172.21.15.162:0/932241972 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d880145a0 con 0x7f4d9015d5c0 2024-01-20T11:07:44.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.021+0000 7f4d87e00640 1 -- 172.21.15.162:0/932241972 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88014950 con 0x7f4d9015d5c0 2024-01-20T11:07:44.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.021+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d901567d0 con 0x7f4d9015d5c0 2024-01-20T11:07:44.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.021+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d90155b00 con 0x7f4d9015d5c0 2024-01-20T11:07:44.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.022+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d90074a30 con 0x7f4d9015d5c0 2024-01-20T11:07:44.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.023+0000 7f4d87e00640 1 -- 172.21.15.162:0/932241972 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4d88014ab0 con 0x7f4d9015d5c0 2024-01-20T11:07:44.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.024+0000 7f4d87e00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d6806aed0 0x7f4d6806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.024+0000 7f4d87e00640 1 -- 172.21.15.162:0/932241972 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d88089ef0 con 0x7f4d9015d5c0 2024-01-20T11:07:44.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.024+0000 7f4d8fe00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d6806aed0 0x7f4d6806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.025+0000 7f4d8fe00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d6806aed0 0x7f4d6806d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4d80036000 tx=0x7f4d8003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.028+0000 7f4d87e00640 1 -- 172.21.15.162:0/932241972 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4d88054e50 con 0x7f4d9015d5c0 2024-01-20T11:07:44.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.212+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d900af1a0 con 0x7f4d9015d5c0 2024-01-20T11:07:44.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.213+0000 7f4d87e00640 1 -- 172.21.15.162:0/932241972 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d88058470 con 0x7f4d9015d5c0 2024-01-20T11:07:44.214 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d6806aed0 msgr2=0x7f4d6806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d6806aed0 0x7f4d6806d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4d80036000 tx=0x7f4d8003b040 comp rx=0 tx=0).stop 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 msgr2=0x7f4d900cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d900cf7d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d88007e70 tx=0x7f4d8800e4b0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 shutdown_connections 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d9015d5c0 0x7f4d900cf7d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d6806aed0 0x7f4d6806d390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d900b29f0 0x7f4d900cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 --2- 172.21.15.162:0/932241972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d9006d600 0x7f4d90152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 >> 172.21.15.162:0/932241972 conn(0x7f4d900b0c40 msgr2=0x7f4d900ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 shutdown_connections 2024-01-20T11:07:44.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.216+0000 7f4d95a00640 1 -- 172.21.15.162:0/932241972 wait complete. 2024-01-20T11:07:44.232 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:07:44.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.413+0000 7f7a3b000640 1 Processor -- start 2024-01-20T11:07:44.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.413+0000 7f7a3b000640 1 -- start start 2024-01-20T11:07:44.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.414+0000 7f7a3b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a3413e380 0x7f7a3415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a3b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3406d150 con 0x7f7a3415f520 2024-01-20T11:07:44.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a3b000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3413fa50 con 0x7f7a3406cce0 2024-01-20T11:07:44.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a3b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3406d3a0 con 0x7f7a3413e380 2024-01-20T11:07:44.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a33e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a3413e380 0x7f7a3415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a2be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7a3415f520 0x7f7a3406c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33808/0 (socket says 172.21.15.162:33808) 2024-01-20T11:07:44.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a2be00640 1 -- 172.21.15.162:0/4213835744 learned_addr learned my addr 172.21.15.162:0/4213835744 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:44.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a33e00640 1 -- 172.21.15.162:0/4213835744 >> v1:172.21.15.179:6789/0 conn(0x7f7a3406cce0 legacy=0x7f7a34140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:44.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a33e00640 1 -- 172.21.15.162:0/4213835744 >> v1:172.21.15.162:6789/0 conn(0x7f7a3415f520 legacy=0x7f7a3406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a33e00640 1 -- 172.21.15.162:0/4213835744 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3413e760 con 0x7f7a3413e380 2024-01-20T11:07:44.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.415+0000 7f7a33400640 1 -- 172.21.15.162:0/4213835744 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31732348 0 0) 0x7f7a3406d150 con 0x7f7a3415f520 2024-01-20T11:07:44.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.417+0000 7f7a33e00640 1 --2- 172.21.15.162:0/4213835744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3413e380 0x7f7a3415efe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097a0 tx=0x7f7a2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e8e36563b1708c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.417+0000 7f7a33400640 1 -- 172.21.15.162:0/4213835744 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24031830 con 0x7f7a3413e380 2024-01-20T11:07:44.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.417+0000 7f7a33400640 1 -- 172.21.15.162:0/4213835744 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24031990 con 0x7f7a3413e380 2024-01-20T11:07:44.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.417+0000 7f7a33400640 1 -- 172.21.15.162:0/4213835744 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24031d20 con 0x7f7a3413e380 2024-01-20T11:07:44.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.418+0000 7f7a3b000640 1 -- 172.21.15.162:0/4213835744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3413e380 msgr2=0x7f7a3415efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.418+0000 7f7a3b000640 1 --2- 172.21.15.162:0/4213835744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3413e380 0x7f7a3415efe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097a0 tx=0x7f7a2402b8d0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.418+0000 7f7a3b000640 1 -- 172.21.15.162:0/4213835744 shutdown_connections 2024-01-20T11:07:44.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.418+0000 7f7a3b000640 1 --2- 172.21.15.162:0/4213835744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3413e380 0x7f7a3415efe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.418+0000 7f7a3b000640 1 -- 172.21.15.162:0/4213835744 >> 172.21.15.162:0/4213835744 conn(0x7f7a3406a600 msgr2=0x7f7a3406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:44.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.418+0000 7f7a3b000640 1 -- 172.21.15.162:0/4213835744 shutdown_connections 2024-01-20T11:07:44.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.418+0000 7f7a3b000640 1 -- 172.21.15.162:0/4213835744 wait complete. 2024-01-20T11:07:44.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.419+0000 7f7a3b000640 1 Processor -- start 2024-01-20T11:07:44.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.420+0000 7f7a3b000640 1 -- start start 2024-01-20T11:07:44.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.420+0000 7f7a3b000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406cce0 0x7f7a3413b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.420+0000 7f7a3b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a3413e380 0x7f7a340ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.420+0000 7f7a3b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3415f520 0x7f7a34153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.420+0000 7f7a3b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340afa80 con 0x7f7a3415f520 2024-01-20T11:07:44.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.420+0000 7f7a3b000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34152dc0 con 0x7f7a3406cce0 2024-01-20T11:07:44.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.420+0000 7f7a3b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a341530a0 con 0x7f7a3413e380 2024-01-20T11:07:44.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3415f520 0x7f7a34153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3415f520 0x7f7a34153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41586/0 (socket says 172.21.15.162:41586) 2024-01-20T11:07:44.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 -- 172.21.15.162:0/1525591738 learned_addr learned my addr 172.21.15.162:0/1525591738 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:44.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a2be00640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a3413e380 0x7f7a340ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a33e00640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406cce0 0x7f7a3413b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 -- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a3413e380 msgr2=0x7f7a340ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a3413e380 0x7f7a340ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 -- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406cce0 msgr2=0x7f7a3413b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406cce0 0x7f7a3413b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 -- 172.21.15.162:0/1525591738 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24009400 con 0x7f7a3415f520 2024-01-20T11:07:44.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a2be00640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a3413e380 0x7f7a340ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:44.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.421+0000 7f7a39000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3415f520 0x7f7a34153e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00c780 tx=0x7f7a2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.422+0000 7f7a30c00640 1 -- 172.21.15.162:0/1525591738 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c004b60 con 0x7f7a3415f520 2024-01-20T11:07:44.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.422+0000 7f7a30c00640 1 -- 172.21.15.162:0/1525591738 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c00ce90 con 0x7f7a3415f520 2024-01-20T11:07:44.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.422+0000 7f7a30c00640 1 -- 172.21.15.162:0/1525591738 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00a850 con 0x7f7a3415f520 2024-01-20T11:07:44.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.422+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34153380 con 0x7f7a3415f520 2024-01-20T11:07:44.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.422+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34153940 con 0x7f7a3415f520 2024-01-20T11:07:44.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.423+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3406e8a0 con 0x7f7a3415f520 2024-01-20T11:07:44.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.424+0000 7f7a30c00640 1 -- 172.21.15.162:0/1525591738 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7a2c00a9b0 con 0x7f7a3415f520 2024-01-20T11:07:44.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.425+0000 7f7a30c00640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7a0c06aed0 0x7f7a0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.425+0000 7f7a30c00640 1 -- 172.21.15.162:0/1525591738 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2c0898c0 con 0x7f7a3415f520 2024-01-20T11:07:44.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.425+0000 7f7a33e00640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7a0c06aed0 0x7f7a0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.426+0000 7f7a33e00640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7a0c06aed0 0x7f7a0c06d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a24036000 tx=0x7f7a24008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.429+0000 7f7a30c00640 1 -- 172.21.15.162:0/1525591738 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7a2c0546f0 con 0x7f7a3415f520 2024-01-20T11:07:44.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.606+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a34153b30 con 0x7f7a3415f520 2024-01-20T11:07:44.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.607+0000 7f7a30c00640 1 -- 172.21.15.162:0/1525591738 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a2c089020 con 0x7f7a3415f520 2024-01-20T11:07:44.607 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7a0c06aed0 msgr2=0x7f7a0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7a0c06aed0 0x7f7a0c06d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a24036000 tx=0x7f7a24008030 comp rx=0 tx=0).stop 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3415f520 msgr2=0x7f7a34153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3415f520 0x7f7a34153e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00c780 tx=0x7f7a2c00cc40 comp rx=0 tx=0).stop 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 shutdown_connections 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a3415f520 0x7f7a34153e60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a3413e380 0x7f7a340ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7a0c06aed0 0x7f7a0c06d390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 --2- 172.21.15.162:0/1525591738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406cce0 0x7f7a3413b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 >> 172.21.15.162:0/1525591738 conn(0x7f7a3406a600 msgr2=0x7f7a3413e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 shutdown_connections 2024-01-20T11:07:44.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.609+0000 7f7a3b000640 1 -- 172.21.15.162:0/1525591738 wait complete. 2024-01-20T11:07:44.627 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:07:44.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.826+0000 7fc5c3e00640 1 Processor -- start 2024-01-20T11:07:44.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.826+0000 7fc5c3e00640 1 -- start start 2024-01-20T11:07:44.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.828+0000 7fc5c3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5bc141bb0 0x7fc5bc0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.828+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0ce6a0 0x7fc5bc06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.828+0000 7fc5c3e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc5bc0cdc30 0x7fc5bc06cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.828+0000 7fc5c3e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc0cee70 con 0x7fc5bc141bb0 2024-01-20T11:07:44.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.828+0000 7fc5c3e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc0cd7a0 con 0x7fc5bc0cdc30 2024-01-20T11:07:44.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.828+0000 7fc5c3e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0ceb90 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5bc141bb0 0x7fc5bc0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5bc141bb0 0x7fc5bc0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41596/0 (socket says 172.21.15.162:41596) 2024-01-20T11:07:44.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 -- 172.21.15.162:0/1216695990 learned_addr learned my addr 172.21.15.162:0/1216695990 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:44.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c0a00640 1 --2- 172.21.15.162:0/1216695990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0ce6a0 0x7fc5bc06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 -- 172.21.15.162:0/1216695990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0ce6a0 msgr2=0x7fc5bc06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1e00640 1 --2- 172.21.15.162:0/1216695990 >> v2:172.21.15.179:3300/0 conn(0x7fc5bc0cdc30 0x7fc5bc06cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 --2- 172.21.15.162:0/1216695990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0ce6a0 0x7fc5bc06c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 -- 172.21.15.162:0/1216695990 >> v2:172.21.15.179:3300/0 conn(0x7fc5bc0cdc30 msgr2=0x7fc5bc06cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 --2- 172.21.15.162:0/1216695990 >> v2:172.21.15.179:3300/0 conn(0x7fc5bc0cdc30 0x7fc5bc06cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c1400640 1 -- 172.21.15.162:0/1216695990 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0cd150 con 0x7fc5bc141bb0 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.829+0000 7fc5c0a00640 1 --2- 172.21.15.162:0/1216695990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0ce6a0 0x7fc5bc06c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:44.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.830+0000 7fc5c1400640 1 --2- 172.21.15.162:0/1216695990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc141bb0 0x7fc5bc0ce160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc074250 tx=0x7fc5ac02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3f24f9e43063c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.831+0000 7fc5bbe00640 1 -- 172.21.15.162:0/1216695990 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac0317d0 con 0x7fc5bc141bb0 2024-01-20T11:07:44.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.831+0000 7fc5bbe00640 1 -- 172.21.15.162:0/1216695990 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac031930 con 0x7fc5bc141bb0 2024-01-20T11:07:44.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.831+0000 7fc5bbe00640 1 -- 172.21.15.162:0/1216695990 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac031cc0 con 0x7fc5bc141bb0 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.831+0000 7fc5c3e00640 1 -- 172.21.15.162:0/1216695990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc141bb0 msgr2=0x7fc5bc0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.831+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/1216695990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc141bb0 0x7fc5bc0ce160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc074250 tx=0x7fc5ac02b870 comp rx=0 tx=0).stop 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.832+0000 7fc5c3e00640 1 -- 172.21.15.162:0/1216695990 shutdown_connections 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.832+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/1216695990 >> v2:172.21.15.179:3300/0 conn(0x7fc5bc0cdc30 0x7fc5bc06cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.832+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/1216695990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0ce6a0 0x7fc5bc06c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.832+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/1216695990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc141bb0 0x7fc5bc0ce160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.832+0000 7fc5c3e00640 1 -- 172.21.15.162:0/1216695990 >> 172.21.15.162:0/1216695990 conn(0x7fc5bc06a600 msgr2=0x7fc5bc06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.832+0000 7fc5c3e00640 1 -- 172.21.15.162:0/1216695990 shutdown_connections 2024-01-20T11:07:44.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.832+0000 7fc5c3e00640 1 -- 172.21.15.162:0/1216695990 wait complete. 2024-01-20T11:07:44.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.833+0000 7fc5c3e00640 1 Processor -- start 2024-01-20T11:07:44.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.834+0000 7fc5c3e00640 1 -- start start 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.834+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0cdc30 0x7fc5bc1f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc0ce6a0 0x7fc5bc15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5bc141bb0 0x7fc5bc13bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc15b1d0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c3e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc139160 con 0x7fc5bc141bb0 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c3e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc139440 con 0x7fc5bc0cdc30 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc0ce6a0 0x7fc5bc15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc0ce6a0 0x7fc5bc15ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41602/0 (socket says 172.21.15.162:41602) 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 -- 172.21.15.162:0/4254813019 learned_addr learned my addr 172.21.15.162:0/4254813019 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 -- 172.21.15.162:0/4254813019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0cdc30 msgr2=0x7fc5bc1f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0cdc30 0x7fc5bc1f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 -- 172.21.15.162:0/4254813019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5bc141bb0 msgr2=0x7fc5bc13bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:44.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5bc141bb0 0x7fc5bc13bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:44.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 -- 172.21.15.162:0/4254813019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0094d0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.835+0000 7fc5c0a00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc0ce6a0 0x7fc5bc15ac90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c7f0 tx=0x7fc5a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.836+0000 7fc5b9600640 1 -- 172.21.15.162:0/4254813019 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400cea0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.836+0000 7fc5b9600640 1 -- 172.21.15.162:0/4254813019 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4007a30 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.836+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc139720 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.836+0000 7fc5b9600640 1 -- 172.21.15.162:0/4254813019 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4007dc0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.836+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc139ce0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.837+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc139f00 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.838+0000 7fc5b9600640 1 -- 172.21.15.162:0/4254813019 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc5a40113f0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.839+0000 7fc5b9600640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc59406aed0 0x7fc59406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:44.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.839+0000 7fc5b9600640 1 -- 172.21.15.162:0/4254813019 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5a4089880 con 0x7fc5bc0ce6a0 2024-01-20T11:07:44.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.839+0000 7fc5c1400640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc59406aed0 0x7fc59406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:44.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.840+0000 7fc5c1400640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc59406aed0 0x7fc59406d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac036000 tx=0x7fc5ac030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:44.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:44.843+0000 7fc5b9600640 1 -- 172.21.15.162:0/4254813019 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc5a40546b0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:45.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.035+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5bc04e970 con 0x7fc5bc0ce6a0 2024-01-20T11:07:45.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.036+0000 7fc5b9600640 1 -- 172.21.15.162:0/4254813019 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5a4057cd0 con 0x7fc5bc0ce6a0 2024-01-20T11:07:45.036 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:07:45.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.038+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc59406aed0 msgr2=0x7fc59406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc59406aed0 0x7fc59406d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac036000 tx=0x7fc5ac030000 comp rx=0 tx=0).stop 2024-01-20T11:07:45.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc0ce6a0 msgr2=0x7fc5bc15ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc0ce6a0 0x7fc5bc15ac90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c7f0 tx=0x7fc5a400ccb0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 shutdown_connections 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc59406aed0 0x7fc59406d390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5bc141bb0 0x7fc5bc13bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5bc0ce6a0 0x7fc5bc15ac90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 --2- 172.21.15.162:0/4254813019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5bc0cdc30 0x7fc5bc1f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 >> 172.21.15.162:0/4254813019 conn(0x7fc5bc06a600 msgr2=0x7fc5bc15c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 shutdown_connections 2024-01-20T11:07:45.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.039+0000 7fc5c3e00640 1 -- 172.21.15.162:0/4254813019 wait complete. 2024-01-20T11:07:45.057 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:07:45.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.266+0000 7f8e7a800640 1 Processor -- start 2024-01-20T11:07:45.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.266+0000 7f8e7a800640 1 -- start start 2024-01-20T11:07:45.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e7a800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e740ae6b0 0x7f8e7406c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e7a800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e74070b60 con 0x7f8e74155a30 2024-01-20T11:07:45.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e7a800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7415bc00 con 0x7f8e74070630 2024-01-20T11:07:45.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e7a800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7415ba10 con 0x7f8e740ae6b0 2024-01-20T11:07:45.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e73400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8e74155a30 0x7f8e740ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33814/0 (socket says 172.21.15.162:33814) 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e73400640 1 -- 172.21.15.162:0/3123031852 learned_addr learned my addr 172.21.15.162:0/3123031852 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981904374 0 0) 0x7f8e74070b60 con 0x7f8e74155a30 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e73e00640 1 --2- 172.21.15.162:0/3123031852 >> v2:172.21.15.179:3300/0 conn(0x7f8e740ae6b0 0x7f8e7406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.268+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e54003520 con 0x7f8e74155a30 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 228765055 0 0) 0x7f8e54003520 con 0x7f8e74155a30 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 >> v2:172.21.15.179:3300/0 conn(0x7f8e740ae6b0 msgr2=0x7f8e7406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 --2- 172.21.15.162:0/3123031852 >> v2:172.21.15.179:3300/0 conn(0x7f8e740ae6b0 0x7f8e7406c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 >> v1:172.21.15.179:6789/0 conn(0x7f8e74070630 legacy=0x7f8e740adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7415bee0 con 0x7f8e74155a30 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f8e64001670 con 0x7f8e74155a30 2024-01-20T11:07:45.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 >> v1:172.21.15.162:6789/0 conn(0x7f8e74155a30 legacy=0x7f8e740ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e540039c0 0x7f8e54003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540047c0 0x7f8e54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e540051d0 0x7f8e5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5400c0f0 con 0x7f8e540051d0 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5400c260 con 0x7f8e540039c0 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5400c420 con 0x7f8e540047c0 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e73e00640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e540051d0 0x7f8e5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e73400640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e540039c0 0x7f8e54003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.269+0000 7f8e72a00640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540047c0 0x7f8e54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.270+0000 7f8e73e00640 1 -- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540047c0 msgr2=0x7f8e54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.270+0000 7f8e73e00640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540047c0 0x7f8e54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.270+0000 7f8e73e00640 1 -- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e540039c0 msgr2=0x7f8e54003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.270+0000 7f8e73e00640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e540039c0 0x7f8e54003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.270+0000 7f8e73e00640 1 -- 172.21.15.162:0/3123031852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54003520 con 0x7f8e540051d0 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.271+0000 7f8e73e00640 1 -- 172.21.15.162:0/3123031852 reap_dead start 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.271+0000 7f8e73e00640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e540051d0 0x7f8e5400b980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009f90 tx=0x7f8e540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07eba233de468ef server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.271+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c02cbf0 con 0x7f8e540051d0 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.271+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00f040 con 0x7f8e540051d0 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.271+0000 7f8e72000640 1 -- 172.21.15.162:0/3123031852 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c003990 con 0x7f8e540051d0 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.272+0000 7f8e7a800640 1 -- 172.21.15.162:0/3123031852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e540051d0 msgr2=0x7f8e5400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.272+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e540051d0 0x7f8e5400b980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009f90 tx=0x7f8e540057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.272+0000 7f8e7a800640 1 -- 172.21.15.162:0/3123031852 shutdown_connections 2024-01-20T11:07:45.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.272+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3123031852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e540051d0 0x7f8e5400b980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.272+0000 7f8e7a800640 1 -- 172.21.15.162:0/3123031852 >> 172.21.15.162:0/3123031852 conn(0x7f8e740b0cd0 msgr2=0x7f8e740b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.272+0000 7f8e7a800640 1 -- 172.21.15.162:0/3123031852 shutdown_connections 2024-01-20T11:07:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.272+0000 7f8e7a800640 1 -- 172.21.15.162:0/3123031852 wait complete. 2024-01-20T11:07:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.274+0000 7f8e7a800640 1 Processor -- start 2024-01-20T11:07:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.274+0000 7f8e7a800640 1 -- start start 2024-01-20T11:07:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.274+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540051d0 0x7f8e74154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e7409c160 0x7f8e7409c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e7406c700 0x7f8e7406cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e7a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7406d0a0 con 0x7f8e7409c160 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e7a800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7409abd0 con 0x7f8e7406c700 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e7a800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7409aeb0 con 0x7f8e540051d0 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e7409c160 0x7f8e7409c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e7409c160 0x7f8e7409c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41620/0 (socket says 172.21.15.162:41620) 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 -- 172.21.15.162:0/3611013530 learned_addr learned my addr 172.21.15.162:0/3611013530 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 -- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540051d0 msgr2=0x7f8e74154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e73400640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540051d0 0x7f8e74154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e73e00640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e7406c700 0x7f8e7406cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540051d0 0x7f8e74154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 -- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e7406c700 msgr2=0x7f8e7406cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e7406c700 0x7f8e7406cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 -- 172.21.15.162:0/3611013530 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74155f90 con 0x7f8e7409c160 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.275+0000 7f8e72a00640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e7409c160 0x7f8e7409c5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00e410 tx=0x7f8e5c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.276+0000 7f8e6b400640 1 -- 172.21.15.162:0/3611013530 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0052e0 con 0x7f8e7409c160 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.276+0000 7f8e6b400640 1 -- 172.21.15.162:0/3611013530 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c005440 con 0x7f8e7409c160 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.276+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7409b190 con 0x7f8e7409c160 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.276+0000 7f8e6b400640 1 -- 172.21.15.162:0/3611013530 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c003810 con 0x7f8e7409c160 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.276+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7409b750 con 0x7f8e7409c160 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.277+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7409b910 con 0x7f8e7409c160 2024-01-20T11:07:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.278+0000 7f8e6b400640 1 -- 172.21.15.162:0/3611013530 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8e5c003970 con 0x7f8e7409c160 2024-01-20T11:07:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.279+0000 7f8e6b400640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8e4c06aed0 0x7f8e4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.279+0000 7f8e6b400640 1 -- 172.21.15.162:0/3611013530 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e5c088cd0 con 0x7f8e7409c160 2024-01-20T11:07:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.279+0000 7f8e73400640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8e4c06aed0 0x7f8e4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.280+0000 7f8e73400640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8e4c06aed0 0x7f8e4c06d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e640016d0 tx=0x7f8e64000f30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:45.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.283+0000 7f8e6b400640 1 -- 172.21.15.162:0/3611013530 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8e5c053ce0 con 0x7f8e7409c160 2024-01-20T11:07:45.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.515+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e7404e970 con 0x7f8e7409c160 2024-01-20T11:07:45.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.516+0000 7f8e6b400640 1 -- 172.21.15.162:0/3611013530 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f8e5c019020 con 0x7f8e7409c160 2024-01-20T11:07:45.516 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:45.516 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:07:45.517 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8e4c06aed0 msgr2=0x7f8e4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8e4c06aed0 0x7f8e4c06d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e640016d0 tx=0x7f8e64000f30 comp rx=0 tx=0).stop 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e7409c160 msgr2=0x7f8e7409c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e7409c160 0x7f8e7409c5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00e410 tx=0x7f8e5c00e8d0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 shutdown_connections 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8e4c06aed0 0x7f8e4c06d390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e7406c700 0x7f8e7406cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e7409c160 0x7f8e7409c5c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 --2- 172.21.15.162:0/3611013530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e540051d0 0x7f8e74154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 >> 172.21.15.162:0/3611013530 conn(0x7f8e740b0cd0 msgr2=0x7f8e740ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:45.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.518+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 shutdown_connections 2024-01-20T11:07:45.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.519+0000 7f8e7a800640 1 -- 172.21.15.162:0/3611013530 wait complete. 2024-01-20T11:07:45.537 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:45.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.748+0000 7fa0e5000640 1 Processor -- start 2024-01-20T11:07:45.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.748+0000 7fa0e5000640 1 -- start start 2024-01-20T11:07:45.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0e5000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa0e0070630 0x7fa0e00adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0e5000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa0e015c6e0 0x7fa0e00ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0e5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e0070b60 con 0x7fa0e0155a30 2024-01-20T11:07:45.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0e5000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e015ba10 con 0x7fa0e0070630 2024-01-20T11:07:45.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0e5000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e015bc00 con 0x7fa0e015c6e0 2024-01-20T11:07:45.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0dde00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa0e0155a30 0x7fa0e00ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33818/0 (socket says 172.21.15.162:33818) 2024-01-20T11:07:45.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0dde00640 1 -- 172.21.15.162:0/3822285587 learned_addr learned my addr 172.21.15.162:0/3822285587 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:45.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.750+0000 7fa0dd400640 1 --2- 172.21.15.162:0/3822285587 >> v2:172.21.15.162:3300/0 conn(0x7fa0e0070630 0x7fa0e00adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.751+0000 7fa0de800640 1 --2- 172.21.15.162:0/3822285587 >> v2:172.21.15.179:3300/0 conn(0x7fa0e015c6e0 0x7fa0e00ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.751+0000 7fa0dca00640 1 -- 172.21.15.162:0/3822285587 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866676615 0 0) 0x7fa0e0070b60 con 0x7fa0e0155a30 2024-01-20T11:07:45.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.751+0000 7fa0dca00640 1 -- 172.21.15.162:0/3822285587 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c0003520 con 0x7fa0e0155a30 2024-01-20T11:07:45.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.751+0000 7fa0dd400640 1 -- 172.21.15.162:0/3822285587 >> v2:172.21.15.179:3300/0 conn(0x7fa0e015c6e0 msgr2=0x7fa0e00ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:45.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.751+0000 7fa0dd400640 1 --2- 172.21.15.162:0/3822285587 >> v2:172.21.15.179:3300/0 conn(0x7fa0e015c6e0 0x7fa0e00ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.751+0000 7fa0dd400640 1 -- 172.21.15.162:0/3822285587 >> v1:172.21.15.162:6789/0 conn(0x7fa0e0155a30 legacy=0x7fa0e00ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.751+0000 7fa0dd400640 1 -- 172.21.15.162:0/3822285587 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e015bee0 con 0x7fa0e0070630 2024-01-20T11:07:45.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.752+0000 7fa0dd400640 1 --2- 172.21.15.162:0/3822285587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e00adfa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0071ba0 tx=0x7fa0c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b09000eabd3adc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.752+0000 7fa0dca00640 1 -- 172.21.15.162:0/3822285587 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8031830 con 0x7fa0e0070630 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.752+0000 7fa0dca00640 1 -- 172.21.15.162:0/3822285587 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8031990 con 0x7fa0e0070630 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.752+0000 7fa0dca00640 1 -- 172.21.15.162:0/3822285587 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8031d20 con 0x7fa0e0070630 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 -- 172.21.15.162:0/3822285587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 msgr2=0x7fa0e00adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 --2- 172.21.15.162:0/3822285587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e00adfa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0071ba0 tx=0x7fa0c802b8d0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 -- 172.21.15.162:0/3822285587 shutdown_connections 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 --2- 172.21.15.162:0/3822285587 >> v2:172.21.15.179:3300/0 conn(0x7fa0e015c6e0 0x7fa0e00ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 --2- 172.21.15.162:0/3822285587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e00adfa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 -- 172.21.15.162:0/3822285587 >> 172.21.15.162:0/3822285587 conn(0x7fa0e00b0cd0 msgr2=0x7fa0e00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 -- 172.21.15.162:0/3822285587 shutdown_connections 2024-01-20T11:07:45.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.753+0000 7fa0e5000640 1 -- 172.21.15.162:0/3822285587 wait complete. 2024-01-20T11:07:45.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.755+0000 7fa0e5000640 1 Processor -- start 2024-01-20T11:07:45.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.755+0000 7fa0e5000640 1 -- start start 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0e5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e0148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0e5000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0155a30 0x7fa0e00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0e5000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0e015c6e0 0x7fa0e00c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0e5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0146f60 con 0x7fa0e0070630 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0e5000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0146320 con 0x7fa0e0155a30 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0e5000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01465c0 con 0x7fa0e015c6e0 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0dde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e0148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0dde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e0148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41638/0 (socket says 172.21.15.162:41638) 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.756+0000 7fa0dde00640 1 -- 172.21.15.162:0/948595348 learned_addr learned my addr 172.21.15.162:0/948595348 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0dd400640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0155a30 0x7fa0e00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0de800640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0e015c6e0 0x7fa0e00c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0dde00640 1 -- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0e015c6e0 msgr2=0x7fa0e00c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0dde00640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0e015c6e0 0x7fa0e00c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0dde00640 1 -- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0155a30 msgr2=0x7fa0e00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0dde00640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0155a30 0x7fa0e00c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0dde00640 1 -- 172.21.15.162:0/948595348 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8009400 con 0x7fa0e0070630 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0de800640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0e015c6e0 0x7fa0e00c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0dde00640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e0148ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c430 tx=0x7fa0d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0d6000640 1 -- 172.21.15.162:0/948595348 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0005ce0 con 0x7fa0e0070630 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0d6000640 1 -- 172.21.15.162:0/948595348 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0005e40 con 0x7fa0e0070630 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0d6000640 1 -- 172.21.15.162:0/948595348 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00072f0 con 0x7fa0e0070630 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e0155f90 con 0x7fa0e0070630 2024-01-20T11:07:45.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.757+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e0146b80 con 0x7fa0e0070630 2024-01-20T11:07:45.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.759+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e00c8dd0 con 0x7fa0e0070630 2024-01-20T11:07:45.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.759+0000 7fa0d6000640 1 -- 172.21.15.162:0/948595348 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa0d0007450 con 0x7fa0e0070630 2024-01-20T11:07:45.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.760+0000 7fa0d6000640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa0b806aed0 0x7fa0b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:45.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.760+0000 7fa0d6000640 1 -- 172.21.15.162:0/948595348 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0d0088d80 con 0x7fa0e0070630 2024-01-20T11:07:45.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.761+0000 7fa0dd400640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa0b806aed0 0x7fa0b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:45.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.761+0000 7fa0dd400640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa0b806aed0 0x7fa0b806d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8036000 tx=0x7fa0c8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:45.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.765+0000 7fa0d6000640 1 -- 172.21.15.162:0/948595348 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa0e00c8dd0 con 0x7fa0e0070630 2024-01-20T11:07:45.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.961+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0e00c8dd0 con 0x7fa0e0070630 2024-01-20T11:07:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.962+0000 7fa0d6000640 1 -- 172.21.15.162:0/948595348 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fa0e00c8dd0 con 0x7fa0e0070630 2024-01-20T11:07:45.963 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:45.964 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:45.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa0b806aed0 msgr2=0x7fa0b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa0b806aed0 0x7fa0b806d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8036000 tx=0x7fa0c8008030 comp rx=0 tx=0).stop 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 msgr2=0x7fa0e0148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e0148ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c430 tx=0x7fa0d000c8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 shutdown_connections 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0e015c6e0 0x7fa0e00c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa0b806aed0 0x7fa0b806d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0e0155a30 0x7fa0e00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 --2- 172.21.15.162:0/948595348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e0070630 0x7fa0e0148ea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 >> 172.21.15.162:0/948595348 conn(0x7fa0e00b0cd0 msgr2=0x7fa0e00ac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 shutdown_connections 2024-01-20T11:07:45.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:45.965+0000 7fa0e5000640 1 -- 172.21.15.162:0/948595348 wait complete. 2024-01-20T11:07:45.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:07:45.985 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:07:46.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.198+0000 7f4c53e00640 1 Processor -- start 2024-01-20T11:07:46.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.198+0000 7f4c53e00640 1 -- start start 2024-01-20T11:07:46.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.199+0000 7f4c53e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 0x7f4c540ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.199+0000 7f4c53e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c540cd880 0x7f4c540cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.199+0000 7f4c53e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c54071830 con 0x7f4c54071cc0 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.199+0000 7f4c53e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c54070c20 con 0x7f4c540cd880 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.199+0000 7f4c53e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54070f00 con 0x7f4c54144a10 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c49e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4c54071cc0 0x7f4c540703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33832/0 (socket says 172.21.15.162:33832) 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c49e00640 1 -- 172.21.15.162:0/577658225 learned_addr learned my addr 172.21.15.162:0/577658225 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52a00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 0x7f4c540ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c53400640 1 --2- 172.21.15.162:0/577658225 >> v2:172.21.15.179:3300/0 conn(0x7f4c540cd880 0x7f4c540cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230175884 0 0) 0x7f4c54071830 con 0x7f4c54071cc0 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c34003520 con 0x7f4c54071cc0 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3521122915 0 0) 0x7f4c34003520 con 0x7f4c54071cc0 2024-01-20T11:07:46.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 msgr2=0x7f4c540ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 0x7f4c540ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 >> v2:172.21.15.179:3300/0 conn(0x7f4c540cd880 msgr2=0x7f4c540cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 --2- 172.21.15.162:0/577658225 >> v2:172.21.15.179:3300/0 conn(0x7f4c540cd880 0x7f4c540cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540711e0 con 0x7f4c54071cc0 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.200+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f4c3c001670 con 0x7f4c54071cc0 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 >> v1:172.21.15.162:6789/0 conn(0x7f4c54071cc0 legacy=0x7f4c540703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52000640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 0x7f4c34003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52000640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52000640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c34004d00 0x7f4c34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54070c20 con 0x7f4c34003ef0 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54070f00 con 0x7f4c34004d00 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3400b9d0 con 0x7f4c54144a10 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c53400640 1 --2- 172.21.15.162:0/577658225 >> v2:172.21.15.179:3300/0 conn(0x7f4c540cd880 0x7f4c540cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:46.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c49e00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52a00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 0x7f4c34003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c49e00640 1 -- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 msgr2=0x7f4c34003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c53400640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c34004d00 0x7f4c34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c49e00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 0x7f4c34003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c49e00640 1 -- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c34004d00 msgr2=0x7f4c34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c49e00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c34004d00 0x7f4c34005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c49e00640 1 -- 172.21.15.162:0/577658225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34003520 con 0x7f4c34003ef0 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.201+0000 7f4c52a00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c54144a10 0x7f4c34003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:46.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.202+0000 7f4c49e00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c340047c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c240 tx=0x7f4c340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba3090baac38889 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:46.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c02cb00 con 0x7f4c34003ef0 2024-01-20T11:07:46.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c02cc60 con 0x7f4c34003ef0 2024-01-20T11:07:46.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c52000640 1 -- 172.21.15.162:0/577658225 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c005af0 con 0x7f4c34003ef0 2024-01-20T11:07:46.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c53e00640 1 -- 172.21.15.162:0/577658225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 msgr2=0x7f4c340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c53e00640 1 --2- 172.21.15.162:0/577658225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c340047c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c240 tx=0x7f4c340057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c53400640 1 -- 172.21.15.162:0/577658225 reap_dead start 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c53e00640 1 -- 172.21.15.162:0/577658225 shutdown_connections 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c53e00640 1 -- 172.21.15.162:0/577658225 >> 172.21.15.162:0/577658225 conn(0x7f4c540b0c40 msgr2=0x7f4c540b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c53e00640 1 -- 172.21.15.162:0/577658225 shutdown_connections 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.203+0000 7f4c53e00640 1 -- 172.21.15.162:0/577658225 wait complete. 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.205+0000 7f4c53e00640 1 Processor -- start 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.205+0000 7f4c53e00640 1 -- start start 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.206+0000 7f4c53e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c541f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.206+0000 7f4c53e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5415b820 0x7f4c5414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.206+0000 7f4c53e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c5415bca0 0x7f4c5414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.206+0000 7f4c53e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54141170 con 0x7f4c34003ef0 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.206+0000 7f4c53e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54140880 con 0x7f4c5415b820 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.206+0000 7f4c53e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415e990 con 0x7f4c5415bca0 2024-01-20T11:07:46.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.206+0000 7f4c52a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c541f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c541f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41648/0 (socket says 172.21.15.162:41648) 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 -- 172.21.15.162:0/3669030265 learned_addr learned my addr 172.21.15.162:0/3669030265 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c53400640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c5415bca0 0x7f4c5414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c49e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5415b820 0x7f4c5414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 -- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c5415bca0 msgr2=0x7f4c5414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c5415bca0 0x7f4c5414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 -- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5415b820 msgr2=0x7f4c5414b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5415b820 0x7f4c5414b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 -- 172.21.15.162:0/3669030265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54140b20 con 0x7f4c34003ef0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c53400640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c5415bca0 0x7f4c5414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c52a00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c541f25f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c440108b0 tx=0x7f4c44010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c4b400640 1 -- 172.21.15.162:0/3669030265 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4400eb60 con 0x7f4c34003ef0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c4b400640 1 -- 172.21.15.162:0/3669030265 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4400ecc0 con 0x7f4c34003ef0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c4b400640 1 -- 172.21.15.162:0/3669030265 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4401c400 con 0x7f4c34003ef0 2024-01-20T11:07:46.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.207+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c54140e00 con 0x7f4c34003ef0 2024-01-20T11:07:46.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.208+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c54141600 con 0x7f4c34003ef0 2024-01-20T11:07:46.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.209+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c54074a30 con 0x7f4c34003ef0 2024-01-20T11:07:46.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.209+0000 7f4c4b400640 1 -- 172.21.15.162:0/3669030265 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4c4401c560 con 0x7f4c34003ef0 2024-01-20T11:07:46.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.210+0000 7f4c4b400640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4c2c06aed0 0x7f4c2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.210+0000 7f4c4b400640 1 -- 172.21.15.162:0/3669030265 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c44089c50 con 0x7f4c34003ef0 2024-01-20T11:07:46.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.211+0000 7f4c49e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4c2c06aed0 0x7f4c2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.211+0000 7f4c49e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4c2c06aed0 0x7f4c2c06d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c034000 tx=0x7f4c3c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:46.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.215+0000 7f4c4b400640 1 -- 172.21.15.162:0/3669030265 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4c44054b30 con 0x7f4c34003ef0 2024-01-20T11:07:46.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.407+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c540aefc0 con 0x7f4c34003ef0 2024-01-20T11:07:46.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.408+0000 7f4c4b400640 1 -- 172.21.15.162:0/3669030265 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c44058150 con 0x7f4c34003ef0 2024-01-20T11:07:46.408 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.410+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4c2c06aed0 msgr2=0x7f4c2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.410+0000 7f4c53e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4c2c06aed0 0x7f4c2c06d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c034000 tx=0x7f4c3c007000 comp rx=0 tx=0).stop 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 msgr2=0x7f4c541f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c541f25f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c440108b0 tx=0x7f4c44010d70 comp rx=0 tx=0).stop 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 shutdown_connections 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c5415bca0 0x7f4c5414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4c2c06aed0 0x7f4c2c06d390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5415b820 0x7f4c5414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 --2- 172.21.15.162:0/3669030265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c34003ef0 0x7f4c541f25f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 >> 172.21.15.162:0/3669030265 conn(0x7f4c540b0c40 msgr2=0x7f4c54143940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 shutdown_connections 2024-01-20T11:07:46.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.411+0000 7f4c53e00640 1 -- 172.21.15.162:0/3669030265 wait complete. 2024-01-20T11:07:46.429 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:07:46.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.642+0000 7f17a3a00640 1 Processor -- start 2024-01-20T11:07:46.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.643+0000 7f17a3a00640 1 -- start start 2024-01-20T11:07:46.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f17a3a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f179c0ceaf0 0x7f179c0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f17a3a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c0d30d0 0x7f179c0d3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f17a3a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0cf490 con 0x7f179c15d830 2024-01-20T11:07:46.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f17a3a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c15dc10 con 0x7f179c0ceaf0 2024-01-20T11:07:46.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f17a3a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0d3aa0 con 0x7f179c0d30d0 2024-01-20T11:07:46.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f17a1000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f179c15d830 0x7f179c06baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:47904/0 (socket says 172.21.15.162:47904) 2024-01-20T11:07:46.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f17a1000640 1 -- 172.21.15.162:0/1195338904 learned_addr learned my addr 172.21.15.162:0/1195338904 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:46.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.644+0000 7f179be00640 1 --2- 172.21.15.162:0/1195338904 >> v2:172.21.15.162:3300/0 conn(0x7f179c0ceaf0 0x7f179c0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.645+0000 7f179b400640 1 -- 172.21.15.162:0/1195338904 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800384670 0 0) 0x7f179c0cf490 con 0x7f179c15d830 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.645+0000 7f17a1a00640 1 --2- 172.21.15.162:0/1195338904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c0d30d0 0x7f179c0d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.645+0000 7f179be00640 1 -- 172.21.15.162:0/1195338904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c0d30d0 msgr2=0x7f179c0d3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.645+0000 7f179be00640 1 --2- 172.21.15.162:0/1195338904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c0d30d0 0x7f179c0d3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.645+0000 7f179be00640 1 -- 172.21.15.162:0/1195338904 >> v1:172.21.15.162:6789/0 conn(0x7f179c15d830 legacy=0x7f179c06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.645+0000 7f179be00640 1 -- 172.21.15.162:0/1195338904 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c0d1f70 con 0x7f179c0ceaf0 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.645+0000 7f17a1a00640 1 --2- 172.21.15.162:0/1195338904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c0d30d0 0x7f179c0d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:46.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.646+0000 7f179be00640 1 --2- 172.21.15.162:0/1195338904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c0cef50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f178402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97bc07671451134 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.646+0000 7f179b400640 1 -- 172.21.15.162:0/1195338904 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178402d040 con 0x7f179c0ceaf0 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.646+0000 7f179b400640 1 -- 172.21.15.162:0/1195338904 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1784031810 con 0x7f179c0ceaf0 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.646+0000 7f179b400640 1 -- 172.21.15.162:0/1195338904 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784031ba0 con 0x7f179c0ceaf0 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 -- 172.21.15.162:0/1195338904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 msgr2=0x7f179c0cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 --2- 172.21.15.162:0/1195338904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c0cef50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f178402b8b0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 -- 172.21.15.162:0/1195338904 shutdown_connections 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 --2- 172.21.15.162:0/1195338904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c0d30d0 0x7f179c0d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 --2- 172.21.15.162:0/1195338904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c0cef50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 -- 172.21.15.162:0/1195338904 >> 172.21.15.162:0/1195338904 conn(0x7f179c08afe0 msgr2=0x7f179c09c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 -- 172.21.15.162:0/1195338904 shutdown_connections 2024-01-20T11:07:46.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.647+0000 7f17a3a00640 1 -- 172.21.15.162:0/1195338904 wait complete. 2024-01-20T11:07:46.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.649+0000 7f17a3a00640 1 Processor -- start 2024-01-20T11:07:46.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.649+0000 7f17a3a00640 1 -- start start 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a3a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a3a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f179c0d30d0 0x7f179c0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a3a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c15d830 0x7f179c0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a3a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b43c0 con 0x7f179c0ceaf0 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a3a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1f2d00 con 0x7f179c0d30d0 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a3a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b4660 con 0x7f179c15d830 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c1f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35554/0 (socket says 172.21.15.162:35554) 2024-01-20T11:07:46.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 -- 172.21.15.162:0/3414146122 learned_addr learned my addr 172.21.15.162:0/3414146122 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c15d830 0x7f179c0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 -- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c15d830 msgr2=0x7f179c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c15d830 0x7f179c0b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 -- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f179c0d30d0 msgr2=0x7f179c0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f179be00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f179c0d30d0 0x7f179c0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f179c0d30d0 0x7f179c0cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1000640 1 -- 172.21.15.162:0/3414146122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784009400 con 0x7f179c0ceaf0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.650+0000 7f17a1a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c15d830 0x7f179c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.651+0000 7f17a1000640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c1f27c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c4d0 tx=0x7f178c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.651+0000 7f1798c00640 1 -- 172.21.15.162:0/3414146122 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0074e0 con 0x7f179c0ceaf0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.651+0000 7f1798c00640 1 -- 172.21.15.162:0/3414146122 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c007660 con 0x7f179c0ceaf0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.651+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c0b4940 con 0x7f179c0ceaf0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.651+0000 7f1798c00640 1 -- 172.21.15.162:0/3414146122 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c004a20 con 0x7f179c0ceaf0 2024-01-20T11:07:46.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.651+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c0b4f00 con 0x7f179c0ceaf0 2024-01-20T11:07:46.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.652+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c04e970 con 0x7f179c0ceaf0 2024-01-20T11:07:46.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.653+0000 7f1798c00640 1 -- 172.21.15.162:0/3414146122 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f178c004b80 con 0x7f179c0ceaf0 2024-01-20T11:07:46.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.654+0000 7f1798c00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f177406aed0 0x7f177406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:46.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.654+0000 7f1798c00640 1 -- 172.21.15.162:0/3414146122 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f178c088b70 con 0x7f179c0ceaf0 2024-01-20T11:07:46.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.654+0000 7f179be00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f177406aed0 0x7f177406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:46.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.655+0000 7f179be00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f177406aed0 0x7f177406d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1784036000 tx=0x7f178403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:46.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.658+0000 7f1798c00640 1 -- 172.21.15.162:0/3414146122 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f178c053a40 con 0x7f179c0ceaf0 2024-01-20T11:07:46.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.850+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f179c06b8d0 con 0x7f179c0ceaf0 2024-01-20T11:07:46.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.851+0000 7f1798c00640 1 -- 172.21.15.162:0/3414146122 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f178c0180a0 con 0x7f179c0ceaf0 2024-01-20T11:07:46.851 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:07:46.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.853+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f177406aed0 msgr2=0x7f177406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.853+0000 7f17a3a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f177406aed0 0x7f177406d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1784036000 tx=0x7f178403c040 comp rx=0 tx=0).stop 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.853+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 msgr2=0x7f179c1f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.853+0000 7f17a3a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c1f27c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c4d0 tx=0x7f178c00c990 comp rx=0 tx=0).stop 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 shutdown_connections 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f179c15d830 0x7f179c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f177406aed0 0x7f177406d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f179c0d30d0 0x7f179c0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 --2- 172.21.15.162:0/3414146122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f179c0ceaf0 0x7f179c1f27c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 >> 172.21.15.162:0/3414146122 conn(0x7f179c08afe0 msgr2=0x7f179c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 shutdown_connections 2024-01-20T11:07:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:46.854+0000 7f17a3a00640 1 -- 172.21.15.162:0/3414146122 wait complete. 2024-01-20T11:07:46.875 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:07:47.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.078+0000 7fcd43e00640 1 Processor -- start 2024-01-20T11:07:47.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.078+0000 7fcd43e00640 1 -- start start 2024-01-20T11:07:47.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.079+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c141bb0 0x7fcd3c0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd43e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c0cee70 con 0x7fcd3c0ce6a0 2024-01-20T11:07:47.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd43e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c0cd7a0 con 0x7fcd3c06cdf0 2024-01-20T11:07:47.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd43e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0ceb90 con 0x7fcd3c141bb0 2024-01-20T11:07:47.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd40a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcd3c0ce6a0 0x7fcd3c06c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:47912/0 (socket says 172.21.15.162:47912) 2024-01-20T11:07:47.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd40a00640 1 -- 172.21.15.162:0/3935151654 learned_addr learned my addr 172.21.15.162:0/3935151654 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:47.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd41400640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c141bb0 0x7fcd3c0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595203477 0 0) 0x7fcd24001110 con 0x7fcd3c0ce6a0 2024-01-20T11:07:47.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.080+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c003520 con 0x7fcd3c0ce6a0 2024-01-20T11:07:47.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232117873 0 0) 0x7fcd1c003520 con 0x7fcd3c0ce6a0 2024-01-20T11:07:47.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c141bb0 msgr2=0x7fcd3c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:47.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c141bb0 0x7fcd3c0ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 >> v1:172.21.15.179:6789/0 conn(0x7fcd3c06cdf0 legacy=0x7fcd3c0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0cd150 con 0x7fcd3c0ce6a0 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fcd24001800 con 0x7fcd3c0ce6a0 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 >> v1:172.21.15.162:6789/0 conn(0x7fcd3c0ce6a0 legacy=0x7fcd3c06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c141bb0 0x7fcd1c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd1c003f20 0x7fcd1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c004d00 0x7fcd1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0ceb90 con 0x7fcd1c003f20 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c00bb10 con 0x7fcd1c004d00 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c00bcd0 con 0x7fcd3c141bb0 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd40a00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd1c003f20 0x7fcd1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd40a00640 1 -- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c141bb0 msgr2=0x7fcd1c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd40a00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c141bb0 0x7fcd1c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd40a00640 1 -- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c004d00 msgr2=0x7fcd1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:47.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.081+0000 7fcd41e00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c004d00 0x7fcd1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.082+0000 7fcd40a00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c004d00 0x7fcd1c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.082+0000 7fcd40a00640 1 -- 172.21.15.162:0/3935151654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c003520 con 0x7fcd1c003f20 2024-01-20T11:07:47.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd40a00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd1c003f20 0x7fcd1c0047c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c210 tx=0x7fcd1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24922b8f5ec7f23 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24005ad0 con 0x7fcd1c003f20 2024-01-20T11:07:47.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24005c50 con 0x7fcd1c003f20 2024-01-20T11:07:47.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd3be00640 1 -- 172.21.15.162:0/3935151654 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2402c890 con 0x7fcd1c003f20 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd43e00640 1 -- 172.21.15.162:0/3935151654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd1c003f20 msgr2=0x7fcd1c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd43e00640 1 --2- 172.21.15.162:0/3935151654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd1c003f20 0x7fcd1c0047c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c210 tx=0x7fcd1c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd41e00640 1 -- 172.21.15.162:0/3935151654 reap_dead start 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd43e00640 1 -- 172.21.15.162:0/3935151654 shutdown_connections 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.083+0000 7fcd43e00640 1 -- 172.21.15.162:0/3935151654 >> 172.21.15.162:0/3935151654 conn(0x7fcd3c06a600 msgr2=0x7fcd3c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.084+0000 7fcd43e00640 1 -- 172.21.15.162:0/3935151654 shutdown_connections 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.084+0000 7fcd43e00640 1 -- 172.21.15.162:0/3935151654 wait complete. 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.085+0000 7fcd43e00640 1 Processor -- start 2024-01-20T11:07:47.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.085+0000 7fcd43e00640 1 -- start start 2024-01-20T11:07:47.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.086+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c003f20 0x7fcd3c1ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c13da80 0x7fcd3c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd43e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3c13dee0 0x7fcd3c0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd43e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0b0730 con 0x7fcd3c13dee0 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd43e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c15c020 con 0x7fcd1c003f20 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd43e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c1ef700 con 0x7fcd3c13da80 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3c13dee0 0x7fcd3c0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3c13dee0 0x7fcd3c0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35564/0 (socket says 172.21.15.162:35564) 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 -- 172.21.15.162:0/1372389749 learned_addr learned my addr 172.21.15.162:0/1372389749 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd40a00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c13da80 0x7fcd3c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41400640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c003f20 0x7fcd3c1ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 -- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c13da80 msgr2=0x7fcd3c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c13da80 0x7fcd3c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 -- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c003f20 msgr2=0x7fcd3c1ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c003f20 0x7fcd3c1ef1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd41e00640 1 -- 172.21.15.162:0/1372389749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0af470 con 0x7fcd3c13dee0 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.087+0000 7fcd40a00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c13da80 0x7fcd3c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.088+0000 7fcd41e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3c13dee0 0x7fcd3c0aedf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c074330 tx=0x7fcd3400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.088+0000 7fcd39600640 1 -- 172.21.15.162:0/1372389749 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34003b70 con 0x7fcd3c13dee0 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.088+0000 7fcd39600640 1 -- 172.21.15.162:0/1372389749 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd34003cd0 con 0x7fcd3c13dee0 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.088+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c0b0070 con 0x7fcd3c13dee0 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.088+0000 7fcd39600640 1 -- 172.21.15.162:0/1372389749 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34005290 con 0x7fcd3c13dee0 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.088+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c0af750 con 0x7fcd3c13dee0 2024-01-20T11:07:47.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.089+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c0b0870 con 0x7fcd3c13dee0 2024-01-20T11:07:47.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.090+0000 7fcd39600640 1 -- 172.21.15.162:0/1372389749 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcd340053f0 con 0x7fcd3c13dee0 2024-01-20T11:07:47.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.091+0000 7fcd39600640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd1406aed0 0x7fcd1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.091+0000 7fcd39600640 1 -- 172.21.15.162:0/1372389749 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd34088fe0 con 0x7fcd3c13dee0 2024-01-20T11:07:47.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.091+0000 7fcd41400640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd1406aed0 0x7fcd1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.091+0000 7fcd41400640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd1406aed0 0x7fcd1406d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c004770 tx=0x7fcd2c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.095+0000 7fcd39600640 1 -- 172.21.15.162:0/1372389749 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcd3c0b0870 con 0x7fcd3c13dee0 2024-01-20T11:07:47.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.285+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd3c0b0870 con 0x7fcd3c13dee0 2024-01-20T11:07:47.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.286+0000 7fcd39600640 1 -- 172.21.15.162:0/1372389749 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd3c0b0870 con 0x7fcd3c13dee0 2024-01-20T11:07:47.286 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:07:47.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.288+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd1406aed0 msgr2=0x7fcd1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.288+0000 7fcd43e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd1406aed0 0x7fcd1406d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c004770 tx=0x7fcd2c008040 comp rx=0 tx=0).stop 2024-01-20T11:07:47.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.288+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3c13dee0 msgr2=0x7fcd3c0aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.288+0000 7fcd43e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3c13dee0 0x7fcd3c0aedf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c074330 tx=0x7fcd3400dc00 comp rx=0 tx=0).stop 2024-01-20T11:07:47.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.288+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 shutdown_connections 2024-01-20T11:07:47.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.288+0000 7fcd43e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3c13dee0 0x7fcd3c0aedf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.289+0000 7fcd43e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3c13da80 0x7fcd3c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.289+0000 7fcd43e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd1406aed0 0x7fcd1406d390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.289+0000 7fcd43e00640 1 --2- 172.21.15.162:0/1372389749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1c003f20 0x7fcd3c1ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.289+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 >> 172.21.15.162:0/1372389749 conn(0x7fcd3c06a600 msgr2=0x7fcd3c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:47.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.289+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 shutdown_connections 2024-01-20T11:07:47.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.289+0000 7fcd43e00640 1 -- 172.21.15.162:0/1372389749 wait complete. 2024-01-20T11:07:47.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:07:47.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.503+0000 7f35d8c00640 1 Processor -- start 2024-01-20T11:07:47.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.503+0000 7f35d8c00640 1 -- start start 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d8c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35d4070630 0x7f35d40adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d415c6e0 0x7f35d40ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d8c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d4070b60 con 0x7f35d4155a30 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d8c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d415ba10 con 0x7f35d4070630 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d8c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d415bc00 con 0x7f35d415c6e0 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35cbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35d4070630 0x7f35d40adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d1e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f35d4155a30 0x7f35d40ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:47916/0 (socket says 172.21.15.162:47916) 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d1e00640 1 -- 172.21.15.162:0/2129599012 learned_addr learned my addr 172.21.15.162:0/2129599012 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:47.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.505+0000 7f35d2800640 1 --2- 172.21.15.162:0/2129599012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d415c6e0 0x7f35d40ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.506+0000 7f35cbe00640 1 -- 172.21.15.162:0/2129599012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d415c6e0 msgr2=0x7f35d40ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:47.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.506+0000 7f35cbe00640 1 --2- 172.21.15.162:0/2129599012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d415c6e0 0x7f35d40ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.506+0000 7f35cbe00640 1 -- 172.21.15.162:0/2129599012 >> v1:172.21.15.162:6789/0 conn(0x7f35d4155a30 legacy=0x7f35d40ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.506+0000 7f35cbe00640 1 -- 172.21.15.162:0/2129599012 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d415bee0 con 0x7f35d4070630 2024-01-20T11:07:47.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.506+0000 7f35d2800640 1 --2- 172.21.15.162:0/2129599012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d415c6e0 0x7f35d40ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:47.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.507+0000 7f35cbe00640 1 --2- 172.21.15.162:0/2129599012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d4070630 0x7f35d40adfa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0097a0 tx=0x7f35bc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a75b77922eaf4e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.507+0000 7f35d1400640 1 -- 172.21.15.162:0/2129599012 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc02d040 con 0x7f35d4070630 2024-01-20T11:07:47.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.507+0000 7f35d1400640 1 -- 172.21.15.162:0/2129599012 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc031810 con 0x7f35d4070630 2024-01-20T11:07:47.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.507+0000 7f35d1400640 1 -- 172.21.15.162:0/2129599012 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc031ba0 con 0x7f35d4070630 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.507+0000 7f35d8c00640 1 -- 172.21.15.162:0/2129599012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d4070630 msgr2=0x7f35d40adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.507+0000 7f35d8c00640 1 --2- 172.21.15.162:0/2129599012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d4070630 0x7f35d40adfa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0097a0 tx=0x7f35bc02b8b0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.508+0000 7f35d8c00640 1 -- 172.21.15.162:0/2129599012 shutdown_connections 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.508+0000 7f35d8c00640 1 --2- 172.21.15.162:0/2129599012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d415c6e0 0x7f35d40ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.508+0000 7f35d8c00640 1 --2- 172.21.15.162:0/2129599012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d4070630 0x7f35d40adfa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.508+0000 7f35d8c00640 1 -- 172.21.15.162:0/2129599012 >> 172.21.15.162:0/2129599012 conn(0x7f35d40b0cd0 msgr2=0x7f35d40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.508+0000 7f35d8c00640 1 -- 172.21.15.162:0/2129599012 shutdown_connections 2024-01-20T11:07:47.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.508+0000 7f35d8c00640 1 -- 172.21.15.162:0/2129599012 wait complete. 2024-01-20T11:07:47.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.509+0000 7f35d8c00640 1 Processor -- start 2024-01-20T11:07:47.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.509+0000 7f35d8c00640 1 -- start start 2024-01-20T11:07:47.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.510+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d4070630 0x7f35d40caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.510+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d4155a30 0x7f35d414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.510+0000 7f35d8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d415c6e0 0x7f35d41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.510+0000 7f35d8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d41500b0 con 0x7f35d415c6e0 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.510+0000 7f35d8c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4153620 con 0x7f35d4070630 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.510+0000 7f35d8c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40cb100 con 0x7f35d4155a30 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d415c6e0 0x7f35d41530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d415c6e0 0x7f35d41530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35578/0 (socket says 172.21.15.162:35578) 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 -- 172.21.15.162:0/3628290335 learned_addr learned my addr 172.21.15.162:0/3628290335 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35cbe00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d4155a30 0x7f35d414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d1e00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d4070630 0x7f35d40caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 -- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d4155a30 msgr2=0x7f35d414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d4155a30 0x7f35d414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 -- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d4070630 msgr2=0x7f35d40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d4070630 0x7f35d40caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 -- 172.21.15.162:0/3628290335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc009400 con 0x7f35d415c6e0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.511+0000 7f35d2800640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d415c6e0 0x7f35d41530e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00cd50 tx=0x7f35cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.512+0000 7f35ca000640 1 -- 172.21.15.162:0/3628290335 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00f680 con 0x7f35d415c6e0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.512+0000 7f35ca000640 1 -- 172.21.15.162:0/3628290335 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc00f800 con 0x7f35d415c6e0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.512+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d4155f90 con 0x7f35d415c6e0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.512+0000 7f35ca000640 1 -- 172.21.15.162:0/3628290335 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00fbb0 con 0x7f35d415c6e0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.512+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d40c97b0 con 0x7f35d415c6e0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.513+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d40cb620 con 0x7f35d415c6e0 2024-01-20T11:07:47.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.514+0000 7f35ca000640 1 -- 172.21.15.162:0/3628290335 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f35cc00b040 con 0x7f35d415c6e0 2024-01-20T11:07:47.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.515+0000 7f35ca000640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35ac06af00 0x7f35ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.515+0000 7f35ca000640 1 -- 172.21.15.162:0/3628290335 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35cc08a000 con 0x7f35d415c6e0 2024-01-20T11:07:47.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.515+0000 7f35d1e00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35ac06af00 0x7f35ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.515+0000 7f35d1e00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35ac06af00 0x7f35ac06d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35d415ea30 tx=0x7f35c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.519+0000 7f35ca000640 1 -- 172.21.15.162:0/3628290335 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f35d40cb620 con 0x7f35d415c6e0 2024-01-20T11:07:47.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.739+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35d40cb620 con 0x7f35d415c6e0 2024-01-20T11:07:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.739+0000 7f35ca000640 1 -- 172.21.15.162:0/3628290335 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f35d40cb620 con 0x7f35d415c6e0 2024-01-20T11:07:47.740 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:47.740 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:07:47.740 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35ac06af00 msgr2=0x7f35ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35ac06af00 0x7f35ac06d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35d415ea30 tx=0x7f35c4009040 comp rx=0 tx=0).stop 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d415c6e0 msgr2=0x7f35d41530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d415c6e0 0x7f35d41530e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00cd50 tx=0x7f35cc00a650 comp rx=0 tx=0).stop 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 shutdown_connections 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35d415c6e0 0x7f35d41530e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d4155a30 0x7f35d414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f35ac06af00 0x7f35ac06d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 --2- 172.21.15.162:0/3628290335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d4070630 0x7f35d40caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 >> 172.21.15.162:0/3628290335 conn(0x7f35d40b0cd0 msgr2=0x7f35d406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 shutdown_connections 2024-01-20T11:07:47.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.742+0000 7f35d8c00640 1 -- 172.21.15.162:0/3628290335 wait complete. 2024-01-20T11:07:47.758 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:07:47.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.952+0000 7f8800600640 1 Processor -- start 2024-01-20T11:07:47.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.952+0000 7f8800600640 1 -- start start 2024-01-20T11:07:47.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.953+0000 7f8800600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87f8155a30 0x7f87f80ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.953+0000 7f8800600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87f8070630 0x7f87f80adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.953+0000 7f8800600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f815c6e0 0x7f87f80ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.953+0000 7f8800600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f815ba10 con 0x7f87f8070630 2024-01-20T11:07:47.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.953+0000 7f8800600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f8070b60 con 0x7f87f8155a30 2024-01-20T11:07:47.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.953+0000 7f8800600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f815bc00 con 0x7f87f815c6e0 2024-01-20T11:07:47.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87f8070630 0x7f87f80adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87f8070630 0x7f87f80adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35588/0 (socket says 172.21.15.162:35588) 2024-01-20T11:07:47.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 -- 172.21.15.162:0/955867002 learned_addr learned my addr 172.21.15.162:0/955867002 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:47.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fe600640 1 --2- 172.21.15.162:0/955867002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f815c6e0 0x7f87f80ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fdc00640 1 --2- 172.21.15.162:0/955867002 >> v2:172.21.15.179:3300/0 conn(0x7f87f8155a30 0x7f87f80ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 -- 172.21.15.162:0/955867002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f815c6e0 msgr2=0x7f87f80ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:47.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 --2- 172.21.15.162:0/955867002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f815c6e0 0x7f87f80ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 -- 172.21.15.162:0/955867002 >> v2:172.21.15.179:3300/0 conn(0x7f87f8155a30 msgr2=0x7f87f80ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:47.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 --2- 172.21.15.162:0/955867002 >> v2:172.21.15.179:3300/0 conn(0x7f87f8155a30 0x7f87f80ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fd200640 1 -- 172.21.15.162:0/955867002 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f815bee0 con 0x7f87f8070630 2024-01-20T11:07:47.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.954+0000 7f87fe600640 1 --2- 172.21.15.162:0/955867002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f815c6e0 0x7f87f80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:07:47.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.956+0000 7f87fd200640 1 --2- 172.21.15.162:0/955867002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f8070630 0x7f87f80adfa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f87f80ccb20 tx=0x7f87e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbdef8e36809c95 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.956+0000 7f87f7e00640 1 -- 172.21.15.162:0/955867002 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0031870 con 0x7f87f8070630 2024-01-20T11:07:47.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.956+0000 7f87f7e00640 1 -- 172.21.15.162:0/955867002 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00319d0 con 0x7f87f8070630 2024-01-20T11:07:47.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.956+0000 7f87f7e00640 1 -- 172.21.15.162:0/955867002 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0031d60 con 0x7f87f8070630 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 -- 172.21.15.162:0/955867002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f8070630 msgr2=0x7f87f80adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 --2- 172.21.15.162:0/955867002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f8070630 0x7f87f80adfa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f87f80ccb20 tx=0x7f87e002b910 comp rx=0 tx=0).stop 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 -- 172.21.15.162:0/955867002 shutdown_connections 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 --2- 172.21.15.162:0/955867002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f815c6e0 0x7f87f80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 --2- 172.21.15.162:0/955867002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f8070630 0x7f87f80adfa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 --2- 172.21.15.162:0/955867002 >> v2:172.21.15.179:3300/0 conn(0x7f87f8155a30 0x7f87f80ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 -- 172.21.15.162:0/955867002 >> 172.21.15.162:0/955867002 conn(0x7f87f80b0cd0 msgr2=0x7f87f80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 -- 172.21.15.162:0/955867002 shutdown_connections 2024-01-20T11:07:47.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.957+0000 7f8800600640 1 -- 172.21.15.162:0/955867002 wait complete. 2024-01-20T11:07:47.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.959+0000 7f8800600640 1 Processor -- start 2024-01-20T11:07:47.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.959+0000 7f8800600640 1 -- start start 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f8800600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8070630 0x7f87f8140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f8800600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8155a30 0x7f87f80aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f8800600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f815c6e0 0x7f87f809b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f8800600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80af490 con 0x7f87f815c6e0 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f8800600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80af770 con 0x7f87f8070630 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f8800600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80afa50 con 0x7f87f8155a30 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f87fe600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f815c6e0 0x7f87f809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f87fe600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f815c6e0 0x7f87f809b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35598/0 (socket says 172.21.15.162:35598) 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f87fe600640 1 -- 172.21.15.162:0/1573189006 learned_addr learned my addr 172.21.15.162:0/1573189006 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.960+0000 7f87fdc00640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8070630 0x7f87f8140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fd200640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8155a30 0x7f87f80aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fe600640 1 -- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8155a30 msgr2=0x7f87f80aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fe600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8155a30 0x7f87f80aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fe600640 1 -- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8070630 msgr2=0x7f87f8140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fe600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8070630 0x7f87f8140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fe600640 1 -- 172.21.15.162:0/1573189006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00094d0 con 0x7f87f815c6e0 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fd200640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8155a30 0x7f87f80aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87fe600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f815c6e0 0x7f87f809b880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87f0007ef0 tx=0x7f87f000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87f5600640 1 -- 172.21.15.162:0/1573189006 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0003b90 con 0x7f87f815c6e0 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87f5600640 1 -- 172.21.15.162:0/1573189006 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f000f040 con 0x7f87f815c6e0 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f87f5600640 1 -- 172.21.15.162:0/1573189006 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f000de80 con 0x7f87f815c6e0 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f80afd30 con 0x7f87f815c6e0 2024-01-20T11:07:47.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.961+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f815e160 con 0x7f87f815c6e0 2024-01-20T11:07:47.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.962+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f815e3b0 con 0x7f87f815c6e0 2024-01-20T11:07:47.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.963+0000 7f87f5600640 1 -- 172.21.15.162:0/1573189006 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f87f0004030 con 0x7f87f815c6e0 2024-01-20T11:07:47.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.965+0000 7f87f5600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f87d006aed0 0x7f87d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:47.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.965+0000 7f87f5600640 1 -- 172.21.15.162:0/1573189006 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87f00898d0 con 0x7f87f815c6e0 2024-01-20T11:07:47.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.965+0000 7f87fdc00640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f87d006aed0 0x7f87d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:47.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.965+0000 7f87fdc00640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f87d006aed0 0x7f87d006d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:47.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:47.969+0000 7f87f5600640 1 -- 172.21.15.162:0/1573189006 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f87f0054830 con 0x7f87f815c6e0 2024-01-20T11:07:48.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.160+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87f80b0250 con 0x7f87f815c6e0 2024-01-20T11:07:48.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.162+0000 7f87f5600640 1 -- 172.21.15.162:0/1573189006 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f87f80b0250 con 0x7f87f815c6e0 2024-01-20T11:07:48.163 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:48.163 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:07:48.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f87d006aed0 msgr2=0x7f87d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f87d006aed0 0x7f87d006d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8008040 comp rx=0 tx=0).stop 2024-01-20T11:07:48.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f815c6e0 msgr2=0x7f87f809b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f815c6e0 0x7f87f809b880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87f0007ef0 tx=0x7f87f000d4a0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 shutdown_connections 2024-01-20T11:07:48.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f815c6e0 0x7f87f809b880 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8155a30 0x7f87f80aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f87d006aed0 0x7f87d006d390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 --2- 172.21.15.162:0/1573189006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8070630 0x7f87f8140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.164+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 >> 172.21.15.162:0/1573189006 conn(0x7f87f80b0cd0 msgr2=0x7f87f80cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:48.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.165+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 shutdown_connections 2024-01-20T11:07:48.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.165+0000 7f8800600640 1 -- 172.21.15.162:0/1573189006 wait complete. 2024-01-20T11:07:48.183 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:07:48.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.386+0000 7fe5d9600640 1 Processor -- start 2024-01-20T11:07:48.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.386+0000 7fe5d9600640 1 -- start start 2024-01-20T11:07:48.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.387+0000 7fe5d9600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5d415a530 0x7fe5d40cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.387+0000 7fe5d9600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d415a910 con 0x7fe5d4071260 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.387+0000 7fe5d9600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d4072960 con 0x7fe5d406deb0 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.387+0000 7fe5d9600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d40ca390 con 0x7fe5d415a530 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.388+0000 7fe5d2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5d415a530 0x7fe5d40cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.388+0000 7fe5d2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5d415a530 0x7fe5d40cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35612/0 (socket says 172.21.15.162:35612) 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.388+0000 7fe5d2a00640 1 -- 172.21.15.162:0/972413532 learned_addr learned my addr 172.21.15.162:0/972413532 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.388+0000 7fe5d2a00640 1 -- 172.21.15.162:0/972413532 >> v1:172.21.15.179:6789/0 conn(0x7fe5d406deb0 legacy=0x7fe5d40ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.388+0000 7fe5d2a00640 1 -- 172.21.15.162:0/972413532 >> v1:172.21.15.162:6789/0 conn(0x7fe5d4071260 legacy=0x7fe5d406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.388+0000 7fe5d2a00640 1 -- 172.21.15.162:0/972413532 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40ce730 con 0x7fe5d415a530 2024-01-20T11:07:48.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.389+0000 7fe5d2a00640 1 --2- 172.21.15.162:0/972413532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d415a530 0x7fe5d40cddb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40098a0 tx=0x7fe5c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e354def424a309da server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:48.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.389+0000 7fe5d1600640 1 -- 172.21.15.162:0/972413532 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4031640 con 0x7fe5d415a530 2024-01-20T11:07:48.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d1600640 1 -- 172.21.15.162:0/972413532 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c40317a0 con 0x7fe5d415a530 2024-01-20T11:07:48.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d1600640 1 -- 172.21.15.162:0/972413532 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4031b30 con 0x7fe5d415a530 2024-01-20T11:07:48.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d9600640 1 -- 172.21.15.162:0/972413532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d415a530 msgr2=0x7fe5d40cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d9600640 1 --2- 172.21.15.162:0/972413532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d415a530 0x7fe5d40cddb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40098a0 tx=0x7fe5c402b8f0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d9600640 1 -- 172.21.15.162:0/972413532 shutdown_connections 2024-01-20T11:07:48.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d9600640 1 --2- 172.21.15.162:0/972413532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d415a530 0x7fe5d40cddb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d9600640 1 -- 172.21.15.162:0/972413532 >> 172.21.15.162:0/972413532 conn(0x7fe5d40b0cd0 msgr2=0x7fe5d40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:48.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d9600640 1 -- 172.21.15.162:0/972413532 shutdown_connections 2024-01-20T11:07:48.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.390+0000 7fe5d9600640 1 -- 172.21.15.162:0/972413532 wait complete. 2024-01-20T11:07:48.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.392+0000 7fe5d9600640 1 Processor -- start 2024-01-20T11:07:48.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.392+0000 7fe5d9600640 1 -- start start 2024-01-20T11:07:48.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d406deb0 0x7fe5d41579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:48.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d9600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d4071260 0x7fe5d415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:48.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d9600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d415a530 0x7fe5d415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:48.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d9600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d415d570 con 0x7fe5d406deb0 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d9600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4155ac0 con 0x7fe5d415a530 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d9600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4155790 con 0x7fe5d4071260 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d406deb0 0x7fe5d41579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d406deb0 0x7fe5d41579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35616/0 (socket says 172.21.15.162:35616) 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.393+0000 7fe5d2a00640 1 -- 172.21.15.162:0/1379671515 learned_addr learned my addr 172.21.15.162:0/1379671515 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d2000640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d4071260 0x7fe5d415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d3400640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d415a530 0x7fe5d415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d2a00640 1 -- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d4071260 msgr2=0x7fe5d415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d2a00640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d4071260 0x7fe5d415caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d2a00640 1 -- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d415a530 msgr2=0x7fe5d415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d2a00640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d415a530 0x7fe5d415d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d2a00640 1 -- 172.21.15.162:0/1379671515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40094d0 con 0x7fe5d406deb0 2024-01-20T11:07:48.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d2a00640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d406deb0 0x7fe5d41579c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40098a0 tx=0x7fe5c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:48.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5caa00640 1 -- 172.21.15.162:0/1379671515 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c403ac60 con 0x7fe5d406deb0 2024-01-20T11:07:48.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5caa00640 1 -- 172.21.15.162:0/1379671515 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c403ade0 con 0x7fe5d406deb0 2024-01-20T11:07:48.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d415d790 con 0x7fe5d406deb0 2024-01-20T11:07:48.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.394+0000 7fe5caa00640 1 -- 172.21.15.162:0/1379671515 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4044630 con 0x7fe5d406deb0 2024-01-20T11:07:48.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.395+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d415dd50 con 0x7fe5d406deb0 2024-01-20T11:07:48.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.396+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d404e970 con 0x7fe5d406deb0 2024-01-20T11:07:48.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.397+0000 7fe5caa00640 1 -- 172.21.15.162:0/1379671515 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe5c402f050 con 0x7fe5d406deb0 2024-01-20T11:07:48.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.397+0000 7fe5caa00640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe5ac06aed0 0x7fe5ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:48.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.398+0000 7fe5caa00640 1 -- 172.21.15.162:0/1379671515 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5c40ab800 con 0x7fe5d406deb0 2024-01-20T11:07:48.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.398+0000 7fe5d2000640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe5ac06aed0 0x7fe5ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:48.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.398+0000 7fe5d2000640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe5ac06aed0 0x7fe5ac06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40cfeb0 tx=0x7fe5bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:48.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.402+0000 7fe5caa00640 1 -- 172.21.15.162:0/1379671515 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe5c4076630 con 0x7fe5d406deb0 2024-01-20T11:07:48.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.638+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5d40cd680 con 0x7fe5d406deb0 2024-01-20T11:07:48.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.639+0000 7fe5caa00640 1 -- 172.21.15.162:0/1379671515 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fe5c4079c50 con 0x7fe5d406deb0 2024-01-20T11:07:48.640 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:07:48.640 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:07:48.640 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:07:48.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.641+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe5ac06aed0 msgr2=0x7fe5ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.641+0000 7fe5d9600640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe5ac06aed0 0x7fe5ac06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40cfeb0 tx=0x7fe5bc009040 comp rx=0 tx=0).stop 2024-01-20T11:07:48.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.641+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d406deb0 msgr2=0x7fe5d41579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:48.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.641+0000 7fe5d9600640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d406deb0 0x7fe5d41579c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40098a0 tx=0x7fe5c40046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 shutdown_connections 2024-01-20T11:07:48.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe5ac06aed0 0x7fe5ac06d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d415a530 0x7fe5d415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d4071260 0x7fe5d415caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 --2- 172.21.15.162:0/1379671515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5d406deb0 0x7fe5d41579c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:48.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 >> 172.21.15.162:0/1379671515 conn(0x7fe5d40b0cd0 msgr2=0x7fe5d4099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:48.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 shutdown_connections 2024-01-20T11:07:48.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:48.642+0000 7fe5d9600640 1 -- 172.21.15.162:0/1379671515 wait complete. 2024-01-20T11:07:49.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-20T11:07:31.927045+0000', 'modified': '2024-01-20T11:07:35.046211+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/2704155734', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 2704155734}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 2704155734}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-20T11:07:49.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-20T11:07:49.063 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-20T11:07:49.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.281+0000 7fd44aa00640 1 Processor -- start 2024-01-20T11:07:49.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.281+0000 7fd44aa00640 1 -- start start 2024-01-20T11:07:49.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd44aa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd444072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd44aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd44406d600 0x7fd4440b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd44aa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4440b2820 0x7fd4440703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd44aa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440acca0 con 0x7fd44406d600 2024-01-20T11:07:49.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd44aa00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44415d9a0 con 0x7fd4440b2820 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd44aa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440b2c50 con 0x7fd44415d5c0 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd448c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd44406d600 0x7fd4440b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd448c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd44406d600 0x7fd4440b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35626/0 (socket says 172.21.15.162:35626) 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.283+0000 7fd448c00640 1 -- 172.21.15.162:0/176472677 learned_addr learned my addr 172.21.15.162:0/176472677 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd449600640 1 --2- 172.21.15.162:0/176472677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd444072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd44a000640 1 --2- 172.21.15.162:0/176472677 >> v2:172.21.15.179:3300/0 conn(0x7fd4440b2820 0x7fd4440703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd448c00640 1 -- 172.21.15.162:0/176472677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 msgr2=0x7fd444072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd448c00640 1 --2- 172.21.15.162:0/176472677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd444072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd448c00640 1 -- 172.21.15.162:0/176472677 >> v2:172.21.15.179:3300/0 conn(0x7fd4440b2820 msgr2=0x7fd4440703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd448c00640 1 --2- 172.21.15.162:0/176472677 >> v2:172.21.15.179:3300/0 conn(0x7fd4440b2820 0x7fd4440703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd448c00640 1 -- 172.21.15.162:0/176472677 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44406dba0 con 0x7fd44406d600 2024-01-20T11:07:49.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.284+0000 7fd44a000640 1 --2- 172.21.15.162:0/176472677 >> v2:172.21.15.179:3300/0 conn(0x7fd4440b2820 0x7fd4440703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:49.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.285+0000 7fd448c00640 1 --2- 172.21.15.162:0/176472677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440b22e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd44406be90 tx=0x7fd42c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853c04a839bda4c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:49.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.285+0000 7fd443e00640 1 -- 172.21.15.162:0/176472677 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c030850 con 0x7fd44406d600 2024-01-20T11:07:49.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.285+0000 7fd443e00640 1 -- 172.21.15.162:0/176472677 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0309b0 con 0x7fd44406d600 2024-01-20T11:07:49.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.285+0000 7fd443e00640 1 -- 172.21.15.162:0/176472677 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c030d40 con 0x7fd44406d600 2024-01-20T11:07:49.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 -- 172.21.15.162:0/176472677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 msgr2=0x7fd4440b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 --2- 172.21.15.162:0/176472677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440b22e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd44406be90 tx=0x7fd42c02b990 comp rx=0 tx=0).stop 2024-01-20T11:07:49.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 -- 172.21.15.162:0/176472677 shutdown_connections 2024-01-20T11:07:49.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 --2- 172.21.15.162:0/176472677 >> v2:172.21.15.179:3300/0 conn(0x7fd4440b2820 0x7fd4440703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 --2- 172.21.15.162:0/176472677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440b22e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 --2- 172.21.15.162:0/176472677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd444072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 -- 172.21.15.162:0/176472677 >> 172.21.15.162:0/176472677 conn(0x7fd4440b0c40 msgr2=0x7fd4440b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:49.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 -- 172.21.15.162:0/176472677 shutdown_connections 2024-01-20T11:07:49.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.286+0000 7fd44aa00640 1 -- 172.21.15.162:0/176472677 wait complete. 2024-01-20T11:07:49.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.288+0000 7fd44aa00640 1 Processor -- start 2024-01-20T11:07:49.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.288+0000 7fd44aa00640 1 -- start start 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.289+0000 7fd44aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.289+0000 7fd44aa00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4440b2820 0x7fd444151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.289+0000 7fd44aa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd4440ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.289+0000 7fd44aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440ccf30 con 0x7fd44406d600 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.289+0000 7fd44aa00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd444151fb0 con 0x7fd4440b2820 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.289+0000 7fd44aa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440cae30 con 0x7fd44415d5c0 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35638/0 (socket says 172.21.15.162:35638) 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 -- 172.21.15.162:0/301368934 learned_addr learned my addr 172.21.15.162:0/301368934 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd448c00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4440b2820 0x7fd444151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd44a000640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd4440ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 -- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 msgr2=0x7fd4440ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd4440ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 -- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4440b2820 msgr2=0x7fd444151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4440b2820 0x7fd444151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 -- 172.21.15.162:0/301368934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0094d0 con 0x7fd44406d600 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd448c00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4440b2820 0x7fd444151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd449600640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440c7d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd43400d620 tx=0x7fd43400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.290+0000 7fd441600640 1 -- 172.21.15.162:0/301368934 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400b620 con 0x7fd44406d600 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.291+0000 7fd441600640 1 -- 172.21.15.162:0/301368934 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400b780 con 0x7fd44406d600 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.291+0000 7fd441600640 1 -- 172.21.15.162:0/301368934 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400bb30 con 0x7fd44406d600 2024-01-20T11:07:49.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.291+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4440cc870 con 0x7fd44406d600 2024-01-20T11:07:49.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.291+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4441f40d0 con 0x7fd44406d600 2024-01-20T11:07:49.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.293+0000 7fd441600640 1 -- 172.21.15.162:0/301368934 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd43400bc90 con 0x7fd44406d600 2024-01-20T11:07:49.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.294+0000 7fd441600640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd41c06aed0 0x7fd41c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.294+0000 7fd441600640 1 -- 172.21.15.162:0/301368934 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd434089b20 con 0x7fd44406d600 2024-01-20T11:07:49.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.294+0000 7fd448c00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd41c06aed0 0x7fd41c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.295+0000 7fd44ec06740 1 Processor -- start 2024-01-20T11:07:49.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.295+0000 7fd44ec06740 1 -- start start 2024-01-20T11:07:49.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.295+0000 7fd448c00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd41c06aed0 0x7fd41c06d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd42c036000 tx=0x7fd42c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:49.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f4789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4a8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f478f10 0x55855f4a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd44ec06740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f3ead80 con 0x55855f4a5b80 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f3e8470 con 0x55855f478f10 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55855f3e3d60 con 0x55855f4a57a0 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd448c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd448c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4a8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35646/0 (socket says 172.21.15.162:35646) 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.296+0000 7fd448c00640 1 -- 172.21.15.162:0/2530437163 learned_addr learned my addr 172.21.15.162:0/2530437163 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd44a000640 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f478f10 0x55855f4a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd449600640 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f4789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd448c00640 1 -- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 msgr2=0x55855f4789d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd448c00640 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f4789d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd448c00640 1 -- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f478f10 msgr2=0x55855f4a8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd448c00640 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f478f10 0x55855f4a8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd448c00640 1 -- 172.21.15.162:0/2530437163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55855f399280 con 0x55855f4a5b80 2024-01-20T11:07:49.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd448c00640 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4a8530 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd42c030d20 tx=0x7fd42c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7292e490496dc10a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:49.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd439c00640 1 -- 172.21.15.162:0/2530437163 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c04a070 con 0x55855f4a5b80 2024-01-20T11:07:49.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd439c00640 1 -- 172.21.15.162:0/2530437163 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c045980 con 0x55855f4a5b80 2024-01-20T11:07:49.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.297+0000 7fd439c00640 1 -- 172.21.15.162:0/2530437163 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c045cf0 con 0x55855f4a5b80 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 -- 172.21.15.162:0/2530437163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 msgr2=0x55855f4a8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4a8530 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd42c030d20 tx=0x7fd42c030000 comp rx=0 tx=0).stop 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 -- 172.21.15.162:0/2530437163 shutdown_connections 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f478f10 0x55855f4a8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4a8530 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 --2- 172.21.15.162:0/2530437163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f4789d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 -- 172.21.15.162:0/2530437163 >> 172.21.15.162:0/2530437163 conn(0x55855f47ac40 msgr2=0x55855f4c3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 -- 172.21.15.162:0/2530437163 shutdown_connections 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.298+0000 7fd44ec06740 1 -- 172.21.15.162:0/2530437163 wait complete. 2024-01-20T11:07:49.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.299+0000 7fd44ec06740 1 -- start start 2024-01-20T11:07:49.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.299+0000 7fd44ec06740 1 Processor -- start 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f492df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4924e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4d3620 0x55855f4d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd44ec06740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f37f740 con 0x55855f4a5b80 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f39d0c0 con 0x55855f4d3620 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55855f145f20 con 0x55855f4a57a0 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd44ec06740 10 client.0 _ll_register_callbacks cb 0x55855f3da200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd448c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4924e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd448c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4924e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35652/0 (socket says 172.21.15.162:35652) 2024-01-20T11:07:49.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.300+0000 7fd448c00640 1 -- 172.21.15.162:0/1140834092 learned_addr learned my addr 172.21.15.162:0/1140834092 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd449600640 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f492df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd44a000640 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4d3620 0x55855f4d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd448c00640 1 -- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 msgr2=0x55855f492df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd448c00640 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f492df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd448c00640 1 -- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4d3620 msgr2=0x55855f4d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd448c00640 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4d3620 0x55855f4d3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd448c00640 1 -- 172.21.15.162:0/1140834092 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44406dba0 con 0x55855f4a5b80 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd448c00640 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4924e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd42c006da0 tx=0x7fd42c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0eaa283b51b3c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd432000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd432000640 1 -- 172.21.15.162:0/1140834092 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c04a040 con 0x55855f4a5b80 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd432000640 1 -- 172.21.15.162:0/1140834092 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd42c03e040 con 0x55855f4a5b80 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.301+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55855f3dcbf0 con 0x55855f4a5b80 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd432000640 1 -- 172.21.15.162:0/1140834092 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd42c003610 con 0x55855f4a5b80 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 10 client.4638 fetch_fsmap learned FSMap version 8 2024-01-20T11:07:49.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55855f3e23e0 con 0x55855f4a5b80 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd432000640 1 -- 172.21.15.162:0/1140834092 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55855f3dcbf0 con 0x55855f4a5b80 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd432000640 1 -- 172.21.15.162:0/1140834092 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd42c042050 con 0x55855f4a5b80 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 10 client.4638 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 20 client.4638 populate_metadata read hostname 'smithi162' 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a6cc0 0x55855f4a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 4 client.4638 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.302+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 --> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55855f3dc910 con 0x55855f4a6cc0 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.303+0000 7fd449600640 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a6cc0 0x55855f4a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.303+0000 7fd449600640 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a6cc0 0x55855f4a70a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f46ebd7ed2fe9093 server_cookie=687fdfda2484f673 in_seq=0 out_seq=0 2024-01-20T11:07:49.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.303+0000 7fd432000640 10 client.4638 ms_handle_connect on v2:172.21.15.179:6833/2704155734 2024-01-20T11:07:49.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.305+0000 7fd432000640 1 -- 172.21.15.162:0/1140834092 <== mds.0 v2:172.21.15.179:6833/2704155734 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55855f3dc910 con 0x55855f4a6cc0 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.305+0000 7fd432000640 10 client.4638 handle_command_reply: tid=0 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 client.4638 shutdown 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 msgr2=0x55855f4924e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4924e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd42c006da0 tx=0x7fd42c004730 comp rx=0 tx=0).stop 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 shutdown_connections 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a6cc0 0x55855f4a70a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4d3620 0x55855f4d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4a5b80 0x55855f4924e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1140834092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f492df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd432000640 0 client.4638 ms_handle_reset on v2:172.21.15.179:6833/2704155734 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 >> 172.21.15.162:0/1140834092 conn(0x55855f478f10 msgr2=0x55855f47c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 shutdown_connections 2024-01-20T11:07:49.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 1 -- 172.21.15.162:0/1140834092 wait complete. 2024-01-20T11:07:49.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.306+0000 7fd44ec06740 20 client.4638 trim_cache size 0 max 16384 2024-01-20T11:07:49.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.323+0000 7fd44ec06740 1 Processor -- start 2024-01-20T11:07:49.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.323+0000 7fd44ec06740 1 -- start start 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f49f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a5b80 0x55855f4c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f47f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44ec06740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f4d3a00 con 0x55855f4d3620 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f4d3160 con 0x55855f4a5b80 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55855f49fa90 con 0x55855f4a57a0 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f47f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f47f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35656/0 (socket says 172.21.15.162:35656) 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.324+0000 7fd44a000640 1 -- 172.21.15.162:0/1838869378 learned_addr learned my addr 172.21.15.162:0/1838869378 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd448c00640 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a5b80 0x55855f4c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd44a000640 1 -- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 msgr2=0x55855f49f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd449600640 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f49f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd44a000640 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f49f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd44a000640 1 -- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a5b80 msgr2=0x55855f4c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd44a000640 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a5b80 0x55855f4c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd44a000640 1 -- 172.21.15.162:0/1838869378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55855f37efd0 con 0x55855f4d3620 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd448c00640 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a5b80 0x55855f4c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd449600640 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f49f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd44a000640 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f47f470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd43c008d80 tx=0x7fd43c00e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32973bc003873e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd439200640 1 -- 172.21.15.162:0/1838869378 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c013070 con 0x55855f4d3620 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd439200640 1 -- 172.21.15.162:0/1838869378 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c018420 con 0x55855f4d3620 2024-01-20T11:07:49.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.325+0000 7fd439200640 1 -- 172.21.15.162:0/1838869378 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00e2e0 con 0x55855f4d3620 2024-01-20T11:07:49.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 -- 172.21.15.162:0/1838869378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 msgr2=0x55855f47f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f47f470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd43c008d80 tx=0x7fd43c00e810 comp rx=0 tx=0).stop 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 -- 172.21.15.162:0/1838869378 shutdown_connections 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f47f470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a5b80 0x55855f4c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1838869378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a57a0 0x55855f49f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 -- 172.21.15.162:0/1838869378 >> 172.21.15.162:0/1838869378 conn(0x55855f478f10 msgr2=0x55855f4741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 -- 172.21.15.162:0/1838869378 shutdown_connections 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.326+0000 7fd44ec06740 1 -- 172.21.15.162:0/1838869378 wait complete. 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.327+0000 7fd44ec06740 1 -- start start 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.327+0000 7fd44ec06740 1 Processor -- start 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a57a0 0x55855f52cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a5b80 0x55855f4a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44ec06740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f52de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44ec06740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f4c5920 con 0x55855f4d3620 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855f4c7a60 con 0x55855f4a57a0 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44ec06740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55855f4d2ca0 con 0x55855f4a5b80 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44ec06740 10 client.0 _ll_register_callbacks cb 0x7fd42c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f52de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f52de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35666/0 (socket says 172.21.15.162:35666) 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd44a000640 1 -- 172.21.15.162:0/1776545593 learned_addr learned my addr 172.21.15.162:0/1776545593 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd448c00640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a5b80 0x55855f4a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.328+0000 7fd449600640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a57a0 0x55855f52cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44a000640 1 -- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a5b80 msgr2=0x55855f4a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44a000640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a5b80 0x55855f4a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44a000640 1 -- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a57a0 msgr2=0x55855f52cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44a000640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a57a0 0x55855f52cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44a000640 1 -- 172.21.15.162:0/1776545593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c008a30 con 0x55855f4d3620 2024-01-20T11:07:49.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd449600640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a57a0 0x55855f52cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44a000640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f52de90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009010 tx=0x7fd43c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabc4d0795dccd2c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd432000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd432000640 1 -- 172.21.15.162:0/1776545593 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00e2e0 con 0x55855f4d3620 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd432000640 1 -- 172.21.15.162:0/1776545593 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd43c018e10 con 0x55855f4d3620 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd42c045980 con 0x55855f4d3620 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd432000640 1 -- 172.21.15.162:0/1776545593 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43c008320 con 0x55855f4d3620 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44ec06740 10 client.4644 fetch_fsmap learned FSMap version 8 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.329+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55855f3a45c0 con 0x55855f4d3620 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd432000640 1 -- 172.21.15.162:0/1776545593 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c045980 con 0x55855f4d3620 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd432000640 1 -- 172.21.15.162:0/1776545593 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd43c008040 con 0x55855f4d3620 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd44ec06740 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd44ec06740 10 client.4644 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd44ec06740 20 client.4644 populate_metadata read hostname 'smithi162' 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a39b0 0x55855f4a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:49.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd44ec06740 4 client.4644 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-20T11:07:49.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 --> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55855f0e36c0 con 0x55855f4a39b0 2024-01-20T11:07:49.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.330+0000 7fd449600640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a39b0 0x55855f4a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.331+0000 7fd449600640 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a39b0 0x55855f4a3d90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9cf9da0f3b8776 server_cookie=446243bb0d1191cc in_seq=0 out_seq=0 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.331+0000 7fd432000640 10 client.4644 ms_handle_connect on v2:172.21.15.179:6833/2704155734 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd432000640 1 -- 172.21.15.162:0/1776545593 <== mds.0 v2:172.21.15.179:6833/2704155734 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55855f0e36c0 con 0x55855f4a39b0 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd432000640 10 client.4644 handle_command_reply: tid=0 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 client.4644 shutdown 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 msgr2=0x55855f52de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f52de90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009010 tx=0x7fd43c004ab0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 shutdown_connections 2024-01-20T11:07:49.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:6833/2704155734,v1:172.21.15.179:6835/2704155734] conn(0x55855f4a39b0 0x55855f4a3d90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55855f4d3620 0x55855f52de90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55855f4a5b80 0x55855f4a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 --2- 172.21.15.162:0/1776545593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55855f4a57a0 0x55855f52cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd432000640 0 client.4644 ms_handle_reset on v2:172.21.15.179:6833/2704155734 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 >> 172.21.15.162:0/1776545593 conn(0x55855f478f10 msgr2=0x55855f49f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 shutdown_connections 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 1 -- 172.21.15.162:0/1776545593 wait complete. 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.332+0000 7fd44ec06740 20 client.4644 trim_cache size 0 max 16384 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "c5cb0dc2-b452-4376-8c48-87e4df6f2999", 2024-01-20T11:07:49.336 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 0, 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4288, 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 16.844289688, 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 8, 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 22, 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 22, 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 24.447029257000001 2024-01-20T11:07:49.337 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd41c06aed0 msgr2=0x7fd41c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd41c06aed0 0x7fd41c06d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd42c036000 tx=0x7fd42c03b040 comp rx=0 tx=0).stop 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 msgr2=0x7fd4440c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440c7d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd43400d620 tx=0x7fd43400dae0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 shutdown_connections 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd44415d5c0 0x7fd4440ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd41c06aed0 0x7fd41c06d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4440b2820 0x7fd444151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 --2- 172.21.15.162:0/301368934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44406d600 0x7fd4440c7d00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:49.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 >> 172.21.15.162:0/301368934 conn(0x7fd4440b0c40 msgr2=0x7fd4440af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:49.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 shutdown_connections 2024-01-20T11:07:49.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:49.333+0000 7fd44aa00640 1 -- 172.21.15.162:0/301368934 wait complete. 2024-01-20T11:07:49.350 INFO:teuthology.run_tasks:Running task kclient... 2024-01-20T11:07:49.374 INFO:tasks.kclient:Mounting kernel clients... 2024-01-20T11:07:49.374 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-20T11:07:49.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.374 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:07:49.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.430 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-01-20T11:07:49.524 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-01-20T11:07:49.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:07:49.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.529 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:07:49.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.582 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-01-20T11:07:49.675 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-01-20T11:07:49.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:07:49.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.679 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-01-20T11:07:49.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-01-20T11:07:49.825 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-01-20T11:07:49.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:07:49.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.829 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-01-20T11:07:49.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:49.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-01-20T11:07:49.970 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-01-20T11:07:49.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:07:49.974 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-01-20T11:07:49.974 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-20T11:07:49.974 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T11:07:49.974 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T11:07:50.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.187+0000 7fbeb5c00640 1 Processor -- start 2024-01-20T11:07:50.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.187+0000 7fbeb5c00640 1 -- start start 2024-01-20T11:07:50.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.188+0000 7fbeb5c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbeb015b520 0x7fbeb00b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.188+0000 7fbeb5c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb00b3fb0 0x7fbeb00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.188+0000 7fbeb5c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb00b43f0 con 0x7fbeb015a320 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.188+0000 7fbeb5c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb015b980 con 0x7fbeb015b520 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.188+0000 7fbeb5c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb0071260 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbea5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbeb015b520 0x7fbeb00b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbea5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbeb015b520 0x7fbeb00b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35670/0 (socket says 172.21.15.162:35670) 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbea5e00640 1 -- 172.21.15.162:0/2201839751 learned_addr learned my addr 172.21.15.162:0/2201839751 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbeaf400640 1 --2- 172.21.15.162:0/2201839751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb00b3fb0 0x7fbeb00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbea5e00640 1 -- 172.21.15.162:0/2201839751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb00b3fb0 msgr2=0x7fbeb00cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbea5e00640 1 --2- 172.21.15.162:0/2201839751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb00b3fb0 0x7fbeb00cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbea5e00640 1 -- 172.21.15.162:0/2201839751 >> v1:172.21.15.179:6789/0 conn(0x7fbeb015a320 legacy=0x7fbeb015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:50.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.189+0000 7fbea5e00640 1 -- 172.21.15.162:0/2201839751 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb00709f0 con 0x7fbeb015b520 2024-01-20T11:07:50.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.190+0000 7fbea5e00640 1 --2- 172.21.15.162:0/2201839751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb015b520 0x7fbeb00b3a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e50 tx=0x7fbe9802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71455cacbc7b0d71 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:50.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.191+0000 7fbeae000640 1 -- 172.21.15.162:0/2201839751 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9802ca70 con 0x7fbeb015b520 2024-01-20T11:07:50.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.191+0000 7fbeae000640 1 -- 172.21.15.162:0/2201839751 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9802cbd0 con 0x7fbeb015b520 2024-01-20T11:07:50.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.191+0000 7fbeae000640 1 -- 172.21.15.162:0/2201839751 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980343f0 con 0x7fbeb015b520 2024-01-20T11:07:50.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.191+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2201839751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb015b520 msgr2=0x7fbeb00b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:50.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.191+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2201839751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb015b520 0x7fbeb00b3a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e50 tx=0x7fbe9802bed0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.192+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2201839751 shutdown_connections 2024-01-20T11:07:50.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.192+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2201839751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb00b3fb0 0x7fbeb00cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.192+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2201839751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb015b520 0x7fbeb00b3a70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.192+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2201839751 >> 172.21.15.162:0/2201839751 conn(0x7fbeb006a600 msgr2=0x7fbeb006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:50.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.192+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2201839751 shutdown_connections 2024-01-20T11:07:50.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.192+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2201839751 wait complete. 2024-01-20T11:07:50.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.193+0000 7fbeb5c00640 1 Processor -- start 2024-01-20T11:07:50.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.194+0000 7fbeb5c00640 1 -- start start 2024-01-20T11:07:50.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.194+0000 7fbeb5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb00b3fb0 0x7fbeb01f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:50.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.194+0000 7fbeb5c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb015a320 0x7fbeb0158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:50.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.194+0000 7fbeb5c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb015b520 0x7fbeb01f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:50.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.194+0000 7fbeb5c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f40a0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.194+0000 7fbeb5c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f3230 con 0x7fbeb015a320 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.194+0000 7fbeb5c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f7770 con 0x7fbeb015b520 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb00b3fb0 0x7fbeb01f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb00b3fb0 0x7fbeb01f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35680/0 (socket says 172.21.15.162:35680) 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 -- 172.21.15.162:0/2508186034 learned_addr learned my addr 172.21.15.162:0/2508186034 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 -- 172.21.15.162:0/2508186034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb015b520 msgr2=0x7fbeb01f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb015b520 0x7fbeb01f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 -- 172.21.15.162:0/2508186034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb015a320 msgr2=0x7fbeb0158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb015a320 0x7fbeb0158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 -- 172.21.15.162:0/2508186034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009b30 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.195+0000 7fbeaea00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb00b3fb0 0x7fbeb01f7230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c460 tx=0x7fbea000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.196+0000 7fbea7400640 1 -- 172.21.15.162:0/2508186034 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0012830 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.196+0000 7fbea7400640 1 -- 172.21.15.162:0/2508186034 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea00129d0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.196+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb01f3420 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.196+0000 7fbea7400640 1 -- 172.21.15.162:0/2508186034 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0012d80 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.196+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb01f39e0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.197+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb01f41e0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.198+0000 7fbea7400640 1 -- 172.21.15.162:0/2508186034 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbea001a3b0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.199+0000 7fbea7400640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe8806aed0 0x7fbe8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:50.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.199+0000 7fbea7400640 1 -- 172.21.15.162:0/2508186034 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbea00892a0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.200+0000 7fbea5e00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe8806aed0 0x7fbe8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:50.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.200+0000 7fbea5e00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe8806aed0 0x7fbe8806d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe98035000 tx=0x7fbe9802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:50.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.204+0000 7fbea7400640 1 -- 172.21.15.162:0/2508186034 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbeb01f41e0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.435+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbeb01f41e0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.435+0000 7fbea7400640 1 -- 172.21.15.162:0/2508186034 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbeb01f41e0 con 0x7fbeb00b3fb0 2024-01-20T11:07:50.436 INFO:teuthology.orchestra.run.smithi162.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T11:07:50.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe8806aed0 msgr2=0x7fbe8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:50.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe8806aed0 0x7fbe8806d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe98035000 tx=0x7fbe9802e000 comp rx=0 tx=0).stop 2024-01-20T11:07:50.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb00b3fb0 msgr2=0x7fbeb01f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:50.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb00b3fb0 0x7fbeb01f7230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c460 tx=0x7fbea000c920 comp rx=0 tx=0).stop 2024-01-20T11:07:50.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 shutdown_connections 2024-01-20T11:07:50.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb015b520 0x7fbeb01f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbe8806aed0 0x7fbe8806d390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb015a320 0x7fbeb0158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 --2- 172.21.15.162:0/2508186034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbeb00b3fb0 0x7fbeb01f7230 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:50.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 >> 172.21.15.162:0/2508186034 conn(0x7fbeb006a600 msgr2=0x7fbeb00b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:50.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.438+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 shutdown_connections 2024-01-20T11:07:50.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:50.439+0000 7fbeb5c00640 1 -- 172.21.15.162:0/2508186034 wait complete. 2024-01-20T11:07:50.458 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-20T11:07:50.458 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T11:07:50.458 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-01-20T11:07:50.458 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-20T11:07:50.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T11:07:50.459 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-20T11:07:50.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-20T11:07:50.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T11:07:50.459 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:07:50.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:50.459 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-01-20T11:07:50.507 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:07:50.507 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:07:50.507 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:07:50.507 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:50.507 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-01-20T11:07:50.507 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42479sec preferred_lft 42479sec 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-01-20T11:07:50.508 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:50.509 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-20T11:07:50.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2024-01-20T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2024-01-20T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2024-01-20T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-20T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:50.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:50.962 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T11:07:51.037 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-01-20T11:07:51.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:51.040 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-01-20T11:07:51.095 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-01-20T11:07:51.095 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T11:07:51.095 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T11:07:51.095 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T11:07:51.095 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T11:07:51.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:51.096 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:51.096 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:51.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T11:07:51.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T11:07:51.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T11:07:51.096 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:51.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:51.744 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:07:51.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:51.789 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-01-20T11:07:51.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:51.872 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:51.872 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:51.872 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T11:07:51.872 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-20T11:07:51.872 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:52.045 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-20T11:07:52.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-20T11:07:52.046 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:52.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:52.300 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:52.300 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:52.300 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-01-20T11:07:52.300 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2024-01-20T11:07:52.300 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:52.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:07:52.448 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T11:07:52.489 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:07:52.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:07:52.489 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T11:07:52.580 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-20T11:07:52.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:52.580 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:07:52.758 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:07:52.758 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:07:52.759 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:07:53.348 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:07:53.348 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:07:53.349 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:07:53.349 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:07:53.349 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:07:53.382 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:07:53.382 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:07:53.382 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:07:53.382 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:07:53.382 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:07:53.383 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-01-20T11:07:53.383 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-01-20T11:07:53.383 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c5cb0dc2-b452-4376-8c48-87e4df6f2999" will pass to kernel 2024-01-20T11:07:53.385 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T11:07:53.386 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-01-20T11:07:53.386 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T11:07:53.386 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T11:07:53.386 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T11:07:53.391 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T11:07:53.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:53.392 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T11:07:53.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:53.481 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:07:53.557 INFO:teuthology.orchestra.run.smithi162.stdout:client4540 2024-01-20T11:07:53.558 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:53.558 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:07:53.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:53.614 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:07:53.689 INFO:teuthology.orchestra.run.smithi162.stdout:client4540 2024-01-20T11:07:53.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:53.689 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:07:53.767 INFO:teuthology.orchestra.run.smithi162.stdout:client4540 2024-01-20T11:07:53.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:53.767 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c5cb0dc2-b452-4376-8c48-87e4df6f2999.client4540/status') 2024-01-20T11:07:53.876 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4540 (3)172.21.15.162:0/878532699 2024-01-20T11:07:53.876 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-01-20T11:07:53.876 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-01-20T11:07:53.876 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-01-20T11:07:53.877 INFO:teuthology.orchestra.run.smithi162.stderr:70 bytes copied, 6.4866e-05 s, 1.1 MB/s 2024-01-20T11:07:53.881 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-01-20T11:07:53.881 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-20T11:07:53.881 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-20T11:07:53.881 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T11:07:54.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.093+0000 7f5ab4800640 1 Processor -- start 2024-01-20T11:07:54.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.093+0000 7f5ab4800640 1 -- start start 2024-01-20T11:07:54.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.094+0000 7f5ab4800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5aac13e380 0x7f5aac15efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:54.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.094+0000 7f5ab4800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac15f520 0x7f5aac06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:54.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.094+0000 7f5ab4800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5aac06cb10 0x7f5aac140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:54.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.094+0000 7f5ab4800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac06d3a0 con 0x7f5aac06cb10 2024-01-20T11:07:54.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.094+0000 7f5ab4800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac0ccc70 con 0x7f5aac13e380 2024-01-20T11:07:54.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.094+0000 7f5ab4800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0b3390 con 0x7f5aac15f520 2024-01-20T11:07:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5aac06cb10 0x7f5aac140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5aac06cb10 0x7f5aac140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35688/0 (socket says 172.21.15.162:35688) 2024-01-20T11:07:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 -- 172.21.15.162:0/1316184987 learned_addr learned my addr 172.21.15.162:0/1316184987 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab1400640 1 --2- 172.21.15.162:0/1316184987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac15f520 0x7f5aac06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab1e00640 1 --2- 172.21.15.162:0/1316184987 >> v2:172.21.15.179:3300/0 conn(0x7f5aac13e380 0x7f5aac15efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 -- 172.21.15.162:0/1316184987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac15f520 msgr2=0x7f5aac06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 --2- 172.21.15.162:0/1316184987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac15f520 0x7f5aac06c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 -- 172.21.15.162:0/1316184987 >> v2:172.21.15.179:3300/0 conn(0x7f5aac13e380 msgr2=0x7f5aac15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:54.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 --2- 172.21.15.162:0/1316184987 >> v2:172.21.15.179:3300/0 conn(0x7f5aac13e380 0x7f5aac15efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.095+0000 7f5ab2800640 1 -- 172.21.15.162:0/1316184987 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac15f960 con 0x7f5aac06cb10 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.096+0000 7f5ab2800640 1 --2- 172.21.15.162:0/1316184987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac06cb10 0x7f5aac140c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06be70 tx=0x7f5aa402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50ccd94c2ea2782 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab0a00640 1 -- 172.21.15.162:0/1316184987 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4031870 con 0x7f5aac06cb10 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab0a00640 1 -- 172.21.15.162:0/1316184987 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa40319d0 con 0x7f5aac06cb10 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab0a00640 1 -- 172.21.15.162:0/1316184987 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4031d60 con 0x7f5aac06cb10 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 -- 172.21.15.162:0/1316184987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac06cb10 msgr2=0x7f5aac140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1316184987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac06cb10 0x7f5aac140c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06be70 tx=0x7f5aa402b910 comp rx=0 tx=0).stop 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 -- 172.21.15.162:0/1316184987 shutdown_connections 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1316184987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac06cb10 0x7f5aac140c10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1316184987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac15f520 0x7f5aac06c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1316184987 >> v2:172.21.15.179:3300/0 conn(0x7f5aac13e380 0x7f5aac15efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 -- 172.21.15.162:0/1316184987 >> 172.21.15.162:0/1316184987 conn(0x7f5aac06a600 msgr2=0x7f5aac06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:54.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 -- 172.21.15.162:0/1316184987 shutdown_connections 2024-01-20T11:07:54.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.097+0000 7f5ab4800640 1 -- 172.21.15.162:0/1316184987 wait complete. 2024-01-20T11:07:54.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.099+0000 7f5ab4800640 1 Processor -- start 2024-01-20T11:07:54.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.099+0000 7f5ab4800640 1 -- start start 2024-01-20T11:07:54.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.100+0000 7f5ab4800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aac06cb10 0x7f5aac0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:54.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.100+0000 7f5ab4800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac13e380 0x7f5aac1e8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:54.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.100+0000 7f5ab4800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac15f520 0x7f5aac1e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:54.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.100+0000 7f5ab4800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac12b3e0 con 0x7f5aac15f520 2024-01-20T11:07:54.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.100+0000 7f5ab4800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac12b6c0 con 0x7f5aac06cb10 2024-01-20T11:07:54.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.100+0000 7f5ab4800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac12b9a0 con 0x7f5aac13e380 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac15f520 0x7f5aac1e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac15f520 0x7f5aac1e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35700/0 (socket says 172.21.15.162:35700) 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 -- 172.21.15.162:0/1940433272 learned_addr learned my addr 172.21.15.162:0/1940433272 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab1e00640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aac06cb10 0x7f5aac0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab1400640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac13e380 0x7f5aac1e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 -- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac13e380 msgr2=0x7f5aac1e8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac13e380 0x7f5aac1e8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 -- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aac06cb10 msgr2=0x7f5aac0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aac06cb10 0x7f5aac0b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 -- 172.21.15.162:0/1940433272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40094d0 con 0x7f5aac15f520 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab1400640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac13e380 0x7f5aac1e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.101+0000 7f5ab2800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac15f520 0x7f5aac1e8d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40090b0 tx=0x7f5aa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.102+0000 7f5aaa000640 1 -- 172.21.15.162:0/1940433272 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa403ac60 con 0x7f5aac15f520 2024-01-20T11:07:54.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.102+0000 7f5aaa000640 1 -- 172.21.15.162:0/1940433272 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa403adc0 con 0x7f5aac15f520 2024-01-20T11:07:54.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.102+0000 7f5aaa000640 1 -- 172.21.15.162:0/1940433272 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4044630 con 0x7f5aac15f520 2024-01-20T11:07:54.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.102+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aac12bc80 con 0x7f5aac15f520 2024-01-20T11:07:54.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.102+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aac0b0720 con 0x7f5aac15f520 2024-01-20T11:07:54.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.103+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aac0b0910 con 0x7f5aac15f520 2024-01-20T11:07:54.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.104+0000 7f5aaa000640 1 -- 172.21.15.162:0/1940433272 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5aa404d450 con 0x7f5aac15f520 2024-01-20T11:07:54.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.105+0000 7f5aaa000640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5a8406aed0 0x7f5a8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:54.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.105+0000 7f5aaa000640 1 -- 172.21.15.162:0/1940433272 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5aa402d040 con 0x7f5aac15f520 2024-01-20T11:07:54.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.105+0000 7f5ab1e00640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5a8406aed0 0x7f5a8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:54.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.106+0000 7f5ab1e00640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5a8406aed0 0x7f5a8406d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009a60 tx=0x7f5a9c003990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:54.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.110+0000 7f5aaa000640 1 -- 172.21.15.162:0/1940433272 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5aa4076ac0 con 0x7f5aac15f520 2024-01-20T11:07:54.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.342+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5aac12c1a0 con 0x7f5aac15f520 2024-01-20T11:07:54.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.343+0000 7f5aaa000640 1 -- 172.21.15.162:0/1940433272 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5aac12c1a0 con 0x7f5aac15f520 2024-01-20T11:07:54.344 INFO:teuthology.orchestra.run.smithi162.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T11:07:54.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.345+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5a8406aed0 msgr2=0x7f5a8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:54.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.345+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5a8406aed0 0x7f5a8406d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009a60 tx=0x7f5a9c003990 comp rx=0 tx=0).stop 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.345+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac15f520 msgr2=0x7f5aac1e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.345+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac15f520 0x7f5aac1e8d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40090b0 tx=0x7f5aa40046c0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 shutdown_connections 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aac15f520 0x7f5aac1e8d80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5aac13e380 0x7f5aac1e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5a8406aed0 0x7f5a8406d390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 --2- 172.21.15.162:0/1940433272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aac06cb10 0x7f5aac0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 >> 172.21.15.162:0/1940433272 conn(0x7f5aac06a600 msgr2=0x7f5aac0cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 shutdown_connections 2024-01-20T11:07:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:54.346+0000 7f5ab4800640 1 -- 172.21.15.162:0/1940433272 wait complete. 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-20T11:07:54.365 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T11:07:54.366 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-20T11:07:54.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:54.366 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:54.416 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42475sec preferred_lft 42475sec 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 92:5b:34:cf:51:d2 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:54.417 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T11:07:54.418 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:54.418 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::f816:dfff:fe99:c645/64 scope link 2024-01-20T11:07:54.418 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:54.418 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T11:07:54.418 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 92:5b:34:cf:51:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T11:07:54.418 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::905b:34ff:fecf:51d2/64 scope link 2024-01-20T11:07:54.418 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:54.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:54.419 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T11:07:54.505 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-01-20T11:07:54.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:54.509 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-01-20T11:07:54.557 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-01-20T11:07:54.557 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T11:07:54.557 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T11:07:54.558 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T11:07:54.558 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T11:07:54.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:54.559 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:54.559 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:54.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T11:07:54.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T11:07:54.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T11:07:54.559 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:54.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:54.738 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:07:54.785 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T11:07:54.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:54.786 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-01-20T11:07:54.831 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-20T11:07:54.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:54.832 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:54.832 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:54.832 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-20T11:07:54.832 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-20T11:07:54.832 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:55.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:55.020 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-20T11:07:55.110 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:07:55.110 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:07:55.110 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:07:55.110 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.110 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-01-20T11:07:55.110 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.111 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:07:55.111 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 92:4a:f2:fe:61:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-20T11:07:55.111 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-20T11:07:55.111 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.111 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::904a:f2ff:fefe:61ae/64 scope link 2024-01-20T11:07:55.111 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:55.115 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:07:55.208 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 92:4a:f2:fe:61:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-20T11:07:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-20T11:07:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::904a:f2ff:fefe:61ae/64 scope link 2024-01-20T11:07:55.209 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:55.213 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-20T11:07:55.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:55.213 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:55.213 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:55.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-20T11:07:55.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-20T11:07:55.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-20T11:07:55.214 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-20T11:07:55.214 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-20T11:07:55.214 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:55.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:55.476 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:07:55.476 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:07:55.476 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2024-01-20T11:07:55.476 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2024-01-20T11:07:55.476 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:07:55.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:07:55.642 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-01-20T11:07:55.690 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-01-20T11:07:55.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:07:55.691 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-01-20T11:07:55.740 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-20T11:07:55.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:55.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-01-20T11:07:55.869 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-01-20T11:07:55.869 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-01-20T11:07:55.869 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:07:55.890 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-01-20T11:07:55.890 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-01-20T11:07:55.891 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:07:55.891 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:07:55.891 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:07:55.917 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-01-20T11:07:55.917 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-01-20T11:07:55.917 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:07:55.917 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:07:55.917 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:07:55.917 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-01-20T11:07:55.917 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-01-20T11:07:55.918 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c5cb0dc2-b452-4376-8c48-87e4df6f2999" will pass to kernel 2024-01-20T11:07:55.919 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-01-20T11:07:55.920 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-01-20T11:07:55.920 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T11:07:55.920 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T11:07:55.920 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T11:07:55.923 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T11:07:55.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:55.924 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-20T11:07:56.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:56.012 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:07:56.064 INFO:teuthology.orchestra.run.smithi162.stdout:client4659 2024-01-20T11:07:56.064 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:07:56.064 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:07:56.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:56.112 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:07:56.213 INFO:teuthology.orchestra.run.smithi162.stdout:client4659 2024-01-20T11:07:56.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:56.214 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:07:56.273 INFO:teuthology.orchestra.run.smithi162.stdout:client4659 2024-01-20T11:07:56.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:56.273 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c5cb0dc2-b452-4376-8c48-87e4df6f2999.client4659/status') 2024-01-20T11:07:56.363 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4659 (3)192.168.0.2:0/3674853375 2024-01-20T11:07:56.363 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-01-20T11:07:56.363 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-01-20T11:07:56.363 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-01-20T11:07:56.363 INFO:teuthology.orchestra.run.smithi162.stderr:69 bytes copied, 6.8907e-05 s, 1.0 MB/s 2024-01-20T11:07:56.367 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-01-20T11:07:56.367 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-20T11:07:56.367 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T11:07:56.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T11:07:56.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.580+0000 7f306b200640 1 Processor -- start 2024-01-20T11:07:56.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.580+0000 7f306b200640 1 -- start start 2024-01-20T11:07:56.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f306b200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f306415f6f0 0x7f306406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f306b200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 0x7f3064140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f306b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306413e760 con 0x7f306413e380 2024-01-20T11:07:56.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f306b200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306406d3a0 con 0x7f306415f6f0 2024-01-20T11:07:56.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f306b200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640ccc70 con 0x7f306406cb10 2024-01-20T11:07:56.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f3063e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f306413e380 0x7f306415efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44316/0 (socket says 172.21.15.162:44316) 2024-01-20T11:07:56.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f3063e00640 1 -- 172.21.15.162:0/3074274548 learned_addr learned my addr 172.21.15.162:0/3074274548 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:07:56.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f3063400640 1 --2- 172.21.15.162:0/3074274548 >> v2:172.21.15.179:3300/0 conn(0x7f306415f6f0 0x7f306406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f3069200640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 0x7f3064140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796398823 0 0) 0x7f306413e760 con 0x7f306413e380 2024-01-20T11:07:56.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.582+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3044003520 con 0x7f306413e380 2024-01-20T11:07:56.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809557393 0 0) 0x7f3044003520 con 0x7f306413e380 2024-01-20T11:07:56.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 msgr2=0x7f3064140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:56.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 0x7f3064140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 >> v2:172.21.15.179:3300/0 conn(0x7f306415f6f0 msgr2=0x7f306406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 --2- 172.21.15.162:0/3074274548 >> v2:172.21.15.179:3300/0 conn(0x7f306415f6f0 0x7f306406c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306413fa50 con 0x7f306413e380 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f3054001670 con 0x7f306413e380 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 >> v1:172.21.15.162:6789/0 conn(0x7f306413e380 legacy=0x7f306415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 0x7f3044003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3044003ef0 0x7f30440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3044005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306406d3a0 con 0x7f3044004d00 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640ccc70 con 0x7f3044003ef0 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304400b980 con 0x7f306406cb10 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.583+0000 7f3069200640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3044005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.584+0000 7f3063e00640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 0x7f3044003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.584+0000 7f3063400640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3044003ef0 0x7f30440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.584+0000 7f3069200640 1 -- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 msgr2=0x7f3044003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:56.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.584+0000 7f3069200640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306406cb10 0x7f3044003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.584+0000 7f3069200640 1 -- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3044003ef0 msgr2=0x7f30440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:07:56.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.584+0000 7f3069200640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3044003ef0 0x7f30440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.584+0000 7f3069200640 1 -- 172.21.15.162:0/3074274548 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044003520 con 0x7f3044004d00 2024-01-20T11:07:56.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.585+0000 7f3069200640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3044005180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f305c009fc0 tx=0x7f30440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbdbadb85791454 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.585+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c02cc00 con 0x7f3044004d00 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.585+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00f040 con 0x7f3044004d00 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.585+0000 7f3062a00640 1 -- 172.21.15.162:0/3074274548 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c034440 con 0x7f3044004d00 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.586+0000 7f306b200640 1 -- 172.21.15.162:0/3074274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 msgr2=0x7f3044005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.586+0000 7f306b200640 1 --2- 172.21.15.162:0/3074274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3044005180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f305c009fc0 tx=0x7f30440057f0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.586+0000 7f3069200640 1 -- 172.21.15.162:0/3074274548 reap_dead start 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.586+0000 7f306b200640 1 -- 172.21.15.162:0/3074274548 shutdown_connections 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.586+0000 7f306b200640 1 -- 172.21.15.162:0/3074274548 >> 172.21.15.162:0/3074274548 conn(0x7f306406a600 msgr2=0x7f306406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.586+0000 7f306b200640 1 -- 172.21.15.162:0/3074274548 shutdown_connections 2024-01-20T11:07:56.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.586+0000 7f306b200640 1 -- 172.21.15.162:0/3074274548 wait complete. 2024-01-20T11:07:56.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.588+0000 7f306b200640 1 Processor -- start 2024-01-20T11:07:56.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.588+0000 7f306b200640 1 -- start start 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f306b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3064071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f306b200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306413c870 0x7f3064139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f306b200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30640705a0 0x7f3064070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f306b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3064070f60 con 0x7f3044004d00 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f306b200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306413d0e0 con 0x7f30640705a0 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f306b200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306413d3c0 con 0x7f306413c870 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3064071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3064071a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46620/0 (socket says 172.21.15.162:46620) 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063e00640 1 -- 172.21.15.162:0/2245992156 learned_addr learned my addr 172.21.15.162:0/2245992156 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063400640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306413c870 0x7f3064139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063e00640 1 -- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306413c870 msgr2=0x7f3064139190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063e00640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306413c870 0x7f3064139190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063e00640 1 -- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30640705a0 msgr2=0x7f3064070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:56.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3069200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30640705a0 0x7f3064070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.589+0000 7f3063e00640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30640705a0 0x7f3064070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f3063e00640 1 -- 172.21.15.162:0/2245992156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306413d6a0 con 0x7f3044004d00 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f3069200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30640705a0 0x7f3064070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f3063e00640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3064071a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3054001eb0 tx=0x7f305400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f305be00640 1 -- 172.21.15.162:0/2245992156 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054004ab0 con 0x7f3044004d00 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f305be00640 1 -- 172.21.15.162:0/2245992156 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054004c10 con 0x7f3044004d00 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306413d980 con 0x7f3044004d00 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f305be00640 1 -- 172.21.15.162:0/2245992156 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054005050 con 0x7f3044004d00 2024-01-20T11:07:56.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.590+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30641396d0 con 0x7f3044004d00 2024-01-20T11:07:56.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.591+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306413dea0 con 0x7f3044004d00 2024-01-20T11:07:56.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.592+0000 7f305be00640 1 -- 172.21.15.162:0/2245992156 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f30540051b0 con 0x7f3044004d00 2024-01-20T11:07:56.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.593+0000 7f305be00640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:07:56.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.593+0000 7f305be00640 1 -- 172.21.15.162:0/2245992156 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3054089150 con 0x7f3044004d00 2024-01-20T11:07:56.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.593+0000 7f3063400640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:07:56.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.594+0000 7f3063400640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f303c06af00 0x7f303c06d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f306413f940 tx=0x7f304c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:07:56.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.597+0000 7f305be00640 1 -- 172.21.15.162:0/2245992156 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f306413dea0 con 0x7f3044004d00 2024-01-20T11:07:56.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.832+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f306404e970 con 0x7f3044004d00 2024-01-20T11:07:56.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.833+0000 7f305be00640 1 -- 172.21.15.162:0/2245992156 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3054019070 con 0x7f3044004d00 2024-01-20T11:07:56.833 INFO:teuthology.orchestra.run.smithi162.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T11:07:56.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.835+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f303c06af00 msgr2=0x7f303c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.835+0000 7f306b200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f303c06af00 0x7f303c06d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f306413f940 tx=0x7f304c008040 comp rx=0 tx=0).stop 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 msgr2=0x7f3064071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3064071a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3054001eb0 tx=0x7f305400ed70 comp rx=0 tx=0).stop 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 shutdown_connections 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30640705a0 0x7f3064070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f306413c870 0x7f3064139190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 --2- 172.21.15.162:0/2245992156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d00 0x7f3064071a80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 >> 172.21.15.162:0/2245992156 conn(0x7f306406a600 msgr2=0x7f306415e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 shutdown_connections 2024-01-20T11:07:56.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:07:56.836+0000 7f306b200640 1 -- 172.21.15.162:0/2245992156 wait complete. 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T11:07:56.856 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T11:07:56.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:56.856 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-01-20T11:07:56.914 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2024-01-20T11:07:56.915 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:07:56.916 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-20T11:07:56.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:56.916 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:07:56.916 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:07:56.916 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2024-01-20T11:07:56.917 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2024-01-20T11:07:56.917 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2024-01-20T11:07:56.917 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-20T11:07:56.917 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:07:57.187 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:07:57.195 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:07:57.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:57.345 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T11:07:57.425 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-01-20T11:07:57.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:57.429 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-01-20T11:07:57.489 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-01-20T11:07:57.489 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T11:07:57.489 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T11:07:57.489 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T11:07:57.489 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T11:07:57.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:57.490 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:07:57.490 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:07:57.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T11:07:57.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T11:07:57.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T11:07:57.490 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:07:58.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:58.158 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-01-20T11:07:58.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:58.211 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-01-20T11:07:58.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:58.262 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:07:58.262 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:07:58.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T11:07:58.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-20T11:07:58.262 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:07:58.405 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-20T11:07:58.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-20T11:07:58.406 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:07:58.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:58.684 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:07:58.684 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:07:58.684 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-01-20T11:07:58.684 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2024-01-20T11:07:58.684 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:07:58.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:07:58.847 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T11:07:58.892 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T11:07:58.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:07:58.893 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T11:07:58.984 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-20T11:07:58.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:58.984 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-20T11:07:59.122 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-20T11:07:59.122 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-20T11:07:59.122 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-01-20T11:07:59.723 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-20T11:07:59.724 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-20T11:07:59.724 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-01-20T11:07:59.724 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:07:59.724 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:07:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-01-20T11:07:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-01-20T11:07:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-01-20T11:07:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:07:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:07:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-01-20T11:07:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-01-20T11:07:59.762 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c5cb0dc2-b452-4376-8c48-87e4df6f2999" will pass to kernel 2024-01-20T11:07:59.766 INFO:teuthology.orchestra.run.smithi179.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T11:07:59.766 INFO:teuthology.orchestra.run.smithi179.stdout: You just mounted a file system that supports labels which does not 2024-01-20T11:07:59.767 INFO:teuthology.orchestra.run.smithi179.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T11:07:59.767 INFO:teuthology.orchestra.run.smithi179.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T11:07:59.767 INFO:teuthology.orchestra.run.smithi179.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T11:07:59.772 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T11:07:59.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:59.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T11:07:59.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:59.863 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:07:59.918 INFO:teuthology.orchestra.run.smithi179.stdout:client4668 2024-01-20T11:07:59.919 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:07:59.919 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:07:59.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:07:59.967 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:08:00.065 INFO:teuthology.orchestra.run.smithi179.stdout:client4668 2024-01-20T11:08:00.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:00.066 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:08:00.121 INFO:teuthology.orchestra.run.smithi179.stdout:client4668 2024-01-20T11:08:00.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:00.122 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c5cb0dc2-b452-4376-8c48-87e4df6f2999.client4668/status') 2024-01-20T11:08:00.199 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4668 (3)172.21.15.179:0/1825245326 2024-01-20T11:08:00.200 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2024-01-20T11:08:00.200 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2024-01-20T11:08:00.200 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2024-01-20T11:08:00.200 INFO:teuthology.orchestra.run.smithi179.stderr:71 bytes copied, 5.7594e-05 s, 1.2 MB/s 2024-01-20T11:08:00.203 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-01-20T11:08:00.203 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-20T11:08:00.204 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-20T11:08:00.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T11:08:00.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.429+0000 7f76ab200640 1 Processor -- start 2024-01-20T11:08:00.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.429+0000 7f76ab200640 1 -- start start 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76ab200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f76a415a320 0x7f76a415b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76ab200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a415e930 0x7f76a40b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76ab200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76a40b3fb0 0x7f76a40cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76ab200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a40b4420 con 0x7f76a415a320 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76ab200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a4071260 con 0x7f76a40b3fb0 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76ab200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40709f0 con 0x7f76a415e930 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76a3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f76a415a320 0x7f76a415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76a3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f76a415a320 0x7f76a415b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46632/0 (socket says 172.21.15.162:46632) 2024-01-20T11:08:00.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.431+0000 7f76a3e00640 1 -- 172.21.15.162:0/463574704 learned_addr learned my addr 172.21.15.162:0/463574704 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:00.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f76a9200640 1 --2- 172.21.15.162:0/463574704 >> v2:172.21.15.179:3300/0 conn(0x7f76a40b3fb0 0x7f76a40cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:00.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f769b200640 1 --2- 172.21.15.162:0/463574704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a415e930 0x7f76a40b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:00.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f76a3e00640 1 -- 172.21.15.162:0/463574704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a415e930 msgr2=0x7f76a40b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:00.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f76a3e00640 1 --2- 172.21.15.162:0/463574704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a415e930 0x7f76a40b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f76a3e00640 1 -- 172.21.15.162:0/463574704 >> v2:172.21.15.179:3300/0 conn(0x7f76a40b3fb0 msgr2=0x7f76a40cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:00.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f76a3e00640 1 --2- 172.21.15.162:0/463574704 >> v2:172.21.15.179:3300/0 conn(0x7f76a40b3fb0 0x7f76a40cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f76a3e00640 1 -- 172.21.15.162:0/463574704 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4070cd0 con 0x7f76a415a320 2024-01-20T11:08:00.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f76a9200640 1 --2- 172.21.15.162:0/463574704 >> v2:172.21.15.179:3300/0 conn(0x7f76a40b3fb0 0x7f76a40cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:00.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.432+0000 7f769b200640 1 --2- 172.21.15.162:0/463574704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a415e930 0x7f76a40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:00.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.433+0000 7f76a3e00640 1 --2- 172.21.15.162:0/463574704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415a320 0x7f76a415b520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76a4072990 tx=0x7f769402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbece4434b4bf817 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.433+0000 7f76a3400640 1 -- 172.21.15.162:0/463574704 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694031870 con 0x7f76a415a320 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.433+0000 7f76a3400640 1 -- 172.21.15.162:0/463574704 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76940319d0 con 0x7f76a415a320 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.433+0000 7f76a3400640 1 -- 172.21.15.162:0/463574704 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694031d60 con 0x7f76a415a320 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 -- 172.21.15.162:0/463574704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415a320 msgr2=0x7f76a415b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 --2- 172.21.15.162:0/463574704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415a320 0x7f76a415b520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76a4072990 tx=0x7f769402b910 comp rx=0 tx=0).stop 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 -- 172.21.15.162:0/463574704 shutdown_connections 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 --2- 172.21.15.162:0/463574704 >> v2:172.21.15.179:3300/0 conn(0x7f76a40b3fb0 0x7f76a40cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 --2- 172.21.15.162:0/463574704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a415e930 0x7f76a40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 --2- 172.21.15.162:0/463574704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415a320 0x7f76a415b520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 -- 172.21.15.162:0/463574704 >> 172.21.15.162:0/463574704 conn(0x7f76a406a600 msgr2=0x7f76a406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 -- 172.21.15.162:0/463574704 shutdown_connections 2024-01-20T11:08:00.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.434+0000 7f76ab200640 1 -- 172.21.15.162:0/463574704 wait complete. 2024-01-20T11:08:00.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.436+0000 7f76ab200640 1 Processor -- start 2024-01-20T11:08:00.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.436+0000 7f76ab200640 1 -- start start 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.437+0000 7f76ab200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a40b3fb0 0x7f76a4146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.437+0000 7f76ab200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a415a320 0x7f76a4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.437+0000 7f76ab200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415e930 0x7f76a40ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.437+0000 7f76ab200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4147050 con 0x7f76a415e930 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.437+0000 7f76ab200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4158c70 con 0x7f76a415a320 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.437+0000 7f76ab200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a41f69a0 con 0x7f76a40b3fb0 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415e930 0x7f76a40ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415e930 0x7f76a40ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46646/0 (socket says 172.21.15.162:46646) 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 -- 172.21.15.162:0/684423654 learned_addr learned my addr 172.21.15.162:0/684423654 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a3e00640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a40b3fb0 0x7f76a4146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 -- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a40b3fb0 msgr2=0x7f76a4146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a40b3fb0 0x7f76a4146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 -- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a415a320 msgr2=0x7f76a4158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a415a320 0x7f76a4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a9200640 1 -- 172.21.15.162:0/684423654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940094d0 con 0x7f76a415e930 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.438+0000 7f76a3e00640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a40b3fb0 0x7f76a4146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.439+0000 7f76a9200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415e930 0x7f76a40ad910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f769c00c7f0 tx=0x7f769c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.439+0000 7f76a0c00640 1 -- 172.21.15.162:0/684423654 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c007820 con 0x7f76a415e930 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.439+0000 7f76a0c00640 1 -- 172.21.15.162:0/684423654 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c007980 con 0x7f76a415e930 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.439+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a41f6c80 con 0x7f76a415e930 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.439+0000 7f76a0c00640 1 -- 172.21.15.162:0/684423654 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c007d30 con 0x7f76a415e930 2024-01-20T11:08:00.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.439+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a41f7240 con 0x7f76a415e930 2024-01-20T11:08:00.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.440+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a41473b0 con 0x7f76a415e930 2024-01-20T11:08:00.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.441+0000 7f76a0c00640 1 -- 172.21.15.162:0/684423654 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f769c0113f0 con 0x7f76a415e930 2024-01-20T11:08:00.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.442+0000 7f76a0c00640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f767c06aed0 0x7f767c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:00.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.443+0000 7f76a0c00640 1 -- 172.21.15.162:0/684423654 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f769c089980 con 0x7f76a415e930 2024-01-20T11:08:00.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.443+0000 7f76a3e00640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f767c06aed0 0x7f767c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:00.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.444+0000 7f76a3e00640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f767c06aed0 0x7f767c06d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7694036000 tx=0x7f769403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:00.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.448+0000 7f76a0c00640 1 -- 172.21.15.162:0/684423654 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f76a41473b0 con 0x7f76a415e930 2024-01-20T11:08:00.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.677+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76a41473b0 con 0x7f76a415e930 2024-01-20T11:08:00.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.678+0000 7f76a0c00640 1 -- 172.21.15.162:0/684423654 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f76a41473b0 con 0x7f76a415e930 2024-01-20T11:08:00.680 INFO:teuthology.orchestra.run.smithi162.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T11:08:00.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.680+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f767c06aed0 msgr2=0x7f767c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:00.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.680+0000 7f76ab200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f767c06aed0 0x7f767c06d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7694036000 tx=0x7f769403c040 comp rx=0 tx=0).stop 2024-01-20T11:08:00.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.680+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415e930 msgr2=0x7f76a40ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:00.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.680+0000 7f76ab200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415e930 0x7f76a40ad910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f769c00c7f0 tx=0x7f769c00ccb0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 shutdown_connections 2024-01-20T11:08:00.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76a415e930 0x7f76a40ad910 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f767c06aed0 0x7f767c06d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a415a320 0x7f76a4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 --2- 172.21.15.162:0/684423654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76a40b3fb0 0x7f76a4146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:00.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 >> 172.21.15.162:0/684423654 conn(0x7f76a406a600 msgr2=0x7f76a406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:00.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 shutdown_connections 2024-01-20T11:08:00.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:00.681+0000 7f76ab200640 1 -- 172.21.15.162:0/684423654 wait complete. 2024-01-20T11:08:00.701 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-20T11:08:00.701 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T11:08:00.701 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-01-20T11:08:00.701 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-20T11:08:00.702 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-20T11:08:00.702 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-20T11:08:00.702 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-20T11:08:00.702 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T11:08:00.702 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-20T11:08:00.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:00.702 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-01-20T11:08:00.749 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:00.750 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42444sec preferred_lft 42444sec 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether fa:cf:e5:9c:76:76 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:00.751 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::7c9e:81ff:fea2:f130/64 scope link 2024-01-20T11:08:00.752 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:00.752 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T11:08:00.752 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether fa:cf:e5:9c:76:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T11:08:00.752 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::f8cf:e5ff:fe9c:7676/64 scope link 2024-01-20T11:08:00.752 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:00.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:00.752 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T11:08:00.873 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-01-20T11:08:00.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:00.877 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-01-20T11:08:00.922 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-01-20T11:08:00.922 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T11:08:00.922 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T11:08:00.922 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T11:08:00.922 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T11:08:00.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:00.923 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:08:00.923 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:08:00.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T11:08:00.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T11:08:00.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T11:08:00.923 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:08:01.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:01.127 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-01-20T11:08:01.170 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T11:08:01.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:01.170 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-01-20T11:08:01.259 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-20T11:08:01.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:01.260 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:08:01.260 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:08:01.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-20T11:08:01.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-20T11:08:01.260 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:08:01.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:01.426 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-20T11:08:01.505 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether a6:09:66:01:9c:71 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::a409:66ff:fe01:9c71/64 scope link 2024-01-20T11:08:01.506 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:01.510 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-20T11:08:01.592 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:08:01.592 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:08:01.592 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:08:01.592 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether a6:09:66:01:9c:71 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::a409:66ff:fe01:9c71/64 scope link 2024-01-20T11:08:01.593 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:01.596 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-20T11:08:01.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:01.596 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:08:01.596 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:08:01.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-20T11:08:01.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-20T11:08:01.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-20T11:08:01.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-20T11:08:01.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-20T11:08:01.597 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:08:01.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:01.845 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-01-20T11:08:01.845 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-01-20T11:08:01.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2024-01-20T11:08:01.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2024-01-20T11:08:01.845 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-01-20T11:08:02.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:08:02.007 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-01-20T11:08:02.054 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-01-20T11:08:02.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:08:02.054 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-01-20T11:08:02.149 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-20T11:08:02.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:02.149 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-01-20T11:08:02.286 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-01-20T11:08:02.287 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-01-20T11:08:02.287 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-01-20T11:08:02.307 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-01-20T11:08:02.308 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-01-20T11:08:02.308 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-01-20T11:08:02.308 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:08:02.308 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:08:02.334 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-01-20T11:08:02.335 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-01-20T11:08:02.335 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-01-20T11:08:02.335 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:08:02.335 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:08:02.335 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-01-20T11:08:02.335 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-01-20T11:08:02.335 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c5cb0dc2-b452-4376-8c48-87e4df6f2999" will pass to kernel 2024-01-20T11:08:02.340 INFO:teuthology.orchestra.run.smithi179.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-01-20T11:08:02.340 INFO:teuthology.orchestra.run.smithi179.stdout: You just mounted a file system that supports labels which does not 2024-01-20T11:08:02.340 INFO:teuthology.orchestra.run.smithi179.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T11:08:02.340 INFO:teuthology.orchestra.run.smithi179.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T11:08:02.340 INFO:teuthology.orchestra.run.smithi179.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T11:08:02.344 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T11:08:02.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:02.345 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-20T11:08:02.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:02.431 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:08:02.486 INFO:teuthology.orchestra.run.smithi179.stdout:client4552 2024-01-20T11:08:02.486 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:08:02.486 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:02.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:02.536 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:08:02.633 INFO:teuthology.orchestra.run.smithi179.stdout:client4552 2024-01-20T11:08:02.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:02.634 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:08:02.689 INFO:teuthology.orchestra.run.smithi179.stdout:client4552 2024-01-20T11:08:02.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:02.689 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c5cb0dc2-b452-4376-8c48-87e4df6f2999.client4552/status') 2024-01-20T11:08:02.773 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4552 (3)192.168.0.2:0/2656396077 2024-01-20T11:08:02.773 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2024-01-20T11:08:02.773 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2024-01-20T11:08:02.773 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2024-01-20T11:08:02.773 INFO:teuthology.orchestra.run.smithi179.stderr:69 bytes copied, 6.8435e-05 s, 1.0 MB/s 2024-01-20T11:08:02.777 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-20T11:08:02.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:03.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.009+0000 7f593dc00640 1 Processor -- start 2024-01-20T11:08:03.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.009+0000 7f593dc00640 1 -- start start 2024-01-20T11:08:03.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.010+0000 7f593dc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f59380ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.010+0000 7f593dc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5938070630 0x7f59380adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.010+0000 7f593dc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5938070b60 con 0x7f593815c6e0 2024-01-20T11:08:03.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.010+0000 7f593dc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593815ba10 con 0x7f5938070630 2024-01-20T11:08:03.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.010+0000 7f593dc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593815bc00 con 0x7f5938155a30 2024-01-20T11:08:03.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f5937400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f593815c6e0 0x7f593806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44328/0 (socket says 172.21.15.162:44328) 2024-01-20T11:08:03.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f5937400640 1 -- 172.21.15.162:0/77210113 learned_addr learned my addr 172.21.15.162:0/77210113 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:03.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f592fe00640 1 --2- 172.21.15.162:0/77210113 >> v2:172.21.15.162:3300/0 conn(0x7f5938070630 0x7f59380adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f5936000640 1 -- 172.21.15.162:0/77210113 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367549970 0 0) 0x7f5938070b60 con 0x7f593815c6e0 2024-01-20T11:08:03.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f5936a00640 1 --2- 172.21.15.162:0/77210113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f59380ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f5936000640 1 -- 172.21.15.162:0/77210113 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5918003520 con 0x7f593815c6e0 2024-01-20T11:08:03.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f592fe00640 1 -- 172.21.15.162:0/77210113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 msgr2=0x7f59380ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:03.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f592fe00640 1 --2- 172.21.15.162:0/77210113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f59380ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f592fe00640 1 -- 172.21.15.162:0/77210113 >> v1:172.21.15.162:6789/0 conn(0x7f593815c6e0 legacy=0x7f593806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f592fe00640 1 -- 172.21.15.162:0/77210113 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593815bee0 con 0x7f5938070630 2024-01-20T11:08:03.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.011+0000 7f5936a00640 1 --2- 172.21.15.162:0/77210113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f59380ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.012+0000 7f592fe00640 1 --2- 172.21.15.162:0/77210113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938070630 0x7f59380adfa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f59200097a0 tx=0x7f592002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e9b29059ef9d66 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f5936000640 1 -- 172.21.15.162:0/77210113 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920031780 con 0x7f5938070630 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f5936000640 1 -- 172.21.15.162:0/77210113 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200318e0 con 0x7f5938070630 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f5936000640 1 -- 172.21.15.162:0/77210113 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920031c70 con 0x7f5938070630 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 -- 172.21.15.162:0/77210113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938070630 msgr2=0x7f59380adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 --2- 172.21.15.162:0/77210113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938070630 0x7f59380adfa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f59200097a0 tx=0x7f592002b820 comp rx=0 tx=0).stop 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 -- 172.21.15.162:0/77210113 shutdown_connections 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 --2- 172.21.15.162:0/77210113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5938070630 0x7f59380adfa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 --2- 172.21.15.162:0/77210113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f59380ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 -- 172.21.15.162:0/77210113 >> 172.21.15.162:0/77210113 conn(0x7f59380b0cd0 msgr2=0x7f59380b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:03.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 -- 172.21.15.162:0/77210113 shutdown_connections 2024-01-20T11:08:03.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.013+0000 7f593dc00640 1 -- 172.21.15.162:0/77210113 wait complete. 2024-01-20T11:08:03.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.015+0000 7f593dc00640 1 Processor -- start 2024-01-20T11:08:03.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.015+0000 7f593dc00640 1 -- start start 2024-01-20T11:08:03.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.016+0000 7f593dc00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5938070630 0x7f593809ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.016+0000 7f593dc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f593814de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.016+0000 7f593dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f593815c6e0 0x7f59380b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.016+0000 7f593dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938150ae0 con 0x7f593815c6e0 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.016+0000 7f593dc00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593809b2c0 con 0x7f5938070630 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.016+0000 7f593dc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593809b5a0 con 0x7f5938155a30 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f593815c6e0 0x7f59380b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f593815c6e0 0x7f59380b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46660/0 (socket says 172.21.15.162:46660) 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 -- 172.21.15.162:0/1154824241 learned_addr learned my addr 172.21.15.162:0/1154824241 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5936a00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5938070630 0x7f593809ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 -- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 msgr2=0x7f593814de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f593814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 -- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5938070630 msgr2=0x7f593809ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5938070630 0x7f593809ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5937400640 1 -- 172.21.15.162:0/1154824241 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009400 con 0x7f593815c6e0 2024-01-20T11:08:03.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.017+0000 7f5936a00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5938070630 0x7f593809ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.018+0000 7f5937400640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f593815c6e0 0x7f59380b0510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f593000caa0 tx=0x7f593000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.018+0000 7f592ea00640 1 -- 172.21.15.162:0/1154824241 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000ac00 con 0x7f593815c6e0 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.018+0000 7f592ea00640 1 -- 172.21.15.162:0/1154824241 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593000ad60 con 0x7f593815c6e0 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.018+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593809b880 con 0x7f593815c6e0 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.018+0000 7f592ea00640 1 -- 172.21.15.162:0/1154824241 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930012620 con 0x7f593815c6e0 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.018+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593809be40 con 0x7f593815c6e0 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.019+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593804e970 con 0x7f593815c6e0 2024-01-20T11:08:03.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.020+0000 7f592ea00640 1 -- 172.21.15.162:0/1154824241 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5930007070 con 0x7f593815c6e0 2024-01-20T11:08:03.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.021+0000 7f592ea00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f591006aed0 0x7f591006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.022+0000 7f592ea00640 1 -- 172.21.15.162:0/1154824241 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59300896c0 con 0x7f593815c6e0 2024-01-20T11:08:03.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.022+0000 7f5936a00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f591006aed0 0x7f591006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.022+0000 7f5936a00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f591006aed0 0x7f591006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5928006fd0 tx=0x7f5928008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.026+0000 7f592ea00640 1 -- 172.21.15.162:0/1154824241 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f59300544f0 con 0x7f593815c6e0 2024-01-20T11:08:03.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.222+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f593809c030 con 0x7f593815c6e0 2024-01-20T11:08:03.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.225+0000 7f592ea00640 1 -- 172.21.15.162:0/1154824241 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f5930057b10 con 0x7f593815c6e0 2024-01-20T11:08:03.227 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:03.227 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:03.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f591006aed0 msgr2=0x7f591006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f591006aed0 0x7f591006d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5928006fd0 tx=0x7f5928008040 comp rx=0 tx=0).stop 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f593815c6e0 msgr2=0x7f59380b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f593815c6e0 0x7f59380b0510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f593000caa0 tx=0x7f593000cf60 comp rx=0 tx=0).stop 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 shutdown_connections 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f593815c6e0 0x7f59380b0510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5938155a30 0x7f593814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f591006aed0 0x7f591006d390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 --2- 172.21.15.162:0/1154824241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5938070630 0x7f593809ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 >> 172.21.15.162:0/1154824241 conn(0x7f59380b0cd0 msgr2=0x7f593806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 shutdown_connections 2024-01-20T11:08:03.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.228+0000 7f593dc00640 1 -- 172.21.15.162:0/1154824241 wait complete. 2024-01-20T11:08:03.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:03.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:03.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.455+0000 7f97b1e00640 1 Processor -- start 2024-01-20T11:08:03.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.455+0000 7f97b1e00640 1 -- start start 2024-01-20T11:08:03.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97b1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97ac141bb0 0x7f97ac0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97b1e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97ac06cdf0 0x7f97ac0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97b1e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac0cee70 con 0x7f97ac0ce6a0 2024-01-20T11:08:03.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97b1e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac0cd7a0 con 0x7f97ac141bb0 2024-01-20T11:08:03.459 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97b1e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac0ceb90 con 0x7f97ac06cdf0 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97aaa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97ac141bb0 0x7f97ac0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97aaa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97ac141bb0 0x7f97ac0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46662/0 (socket says 172.21.15.162:46662) 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.457+0000 7f97aaa00640 1 -- 172.21.15.162:0/4098716920 learned_addr learned my addr 172.21.15.162:0/4098716920 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.458+0000 7f97ab400640 1 --2- 172.21.15.162:0/4098716920 >> v2:172.21.15.179:3300/0 conn(0x7f97ac06cdf0 0x7f97ac0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.458+0000 7f97aaa00640 1 -- 172.21.15.162:0/4098716920 >> v2:172.21.15.179:3300/0 conn(0x7f97ac06cdf0 msgr2=0x7f97ac0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.458+0000 7f97aaa00640 1 --2- 172.21.15.162:0/4098716920 >> v2:172.21.15.179:3300/0 conn(0x7f97ac06cdf0 0x7f97ac0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.458+0000 7f97aaa00640 1 -- 172.21.15.162:0/4098716920 >> v1:172.21.15.179:6789/0 conn(0x7f97ac0ce6a0 legacy=0x7f97ac06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:03.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.458+0000 7f97aaa00640 1 -- 172.21.15.162:0/4098716920 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0cd150 con 0x7f97ac141bb0 2024-01-20T11:08:03.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.459+0000 7f97aaa00640 1 --2- 172.21.15.162:0/4098716920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0ce160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0704c0 tx=0x7f979c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddda0b56b4eab6f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.459+0000 7f97aa000640 1 -- 172.21.15.162:0/4098716920 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0317e0 con 0x7f97ac141bb0 2024-01-20T11:08:03.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.459+0000 7f97aa000640 1 -- 172.21.15.162:0/4098716920 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c031940 con 0x7f97ac141bb0 2024-01-20T11:08:03.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.459+0000 7f97aa000640 1 -- 172.21.15.162:0/4098716920 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c031cd0 con 0x7f97ac141bb0 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 -- 172.21.15.162:0/4098716920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 msgr2=0x7f97ac0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 --2- 172.21.15.162:0/4098716920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0ce160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0704c0 tx=0x7f979c02b880 comp rx=0 tx=0).stop 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 -- 172.21.15.162:0/4098716920 shutdown_connections 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 --2- 172.21.15.162:0/4098716920 >> v2:172.21.15.179:3300/0 conn(0x7f97ac06cdf0 0x7f97ac0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 --2- 172.21.15.162:0/4098716920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0ce160 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 -- 172.21.15.162:0/4098716920 >> 172.21.15.162:0/4098716920 conn(0x7f97ac06a600 msgr2=0x7f97ac06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 -- 172.21.15.162:0/4098716920 shutdown_connections 2024-01-20T11:08:03.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.460+0000 7f97b1e00640 1 -- 172.21.15.162:0/4098716920 wait complete. 2024-01-20T11:08:03.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.462+0000 7f97b1e00640 1 Processor -- start 2024-01-20T11:08:03.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.462+0000 7f97b1e00640 1 -- start start 2024-01-20T11:08:03.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.463+0000 7f97b1e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ac06cdf0 0x7f97ac13db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.463+0000 7f97b1e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ac0ce6a0 0x7f97ac1f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.463+0000 7f97b1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.463+0000 7f97b1e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0b2140 con 0x7f97ac141bb0 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.463+0000 7f97b1e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0b29e0 con 0x7f97ac06cdf0 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.463+0000 7f97b1e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac13e090 con 0x7f97ac0ce6a0 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.463+0000 7f97ab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46668/0 (socket says 172.21.15.162:46668) 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 -- 172.21.15.162:0/3312440676 learned_addr learned my addr 172.21.15.162:0/3312440676 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97aaa00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ac06cdf0 0x7f97ac13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97a3e00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ac0ce6a0 0x7f97ac1f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 -- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ac0ce6a0 msgr2=0x7f97ac1f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ac0ce6a0 0x7f97ac1f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 -- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ac06cdf0 msgr2=0x7f97ac13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ac06cdf0 0x7f97ac13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 -- 172.21.15.162:0/3312440676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0094d0 con 0x7f97ac141bb0 2024-01-20T11:08:03.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.464+0000 7f97ab400640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0afea0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f97a4007e60 tx=0x7f97a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.465+0000 7f97a3400640 1 -- 172.21.15.162:0/3312440676 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4014620 con 0x7f97ac141bb0 2024-01-20T11:08:03.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.465+0000 7f97a3400640 1 -- 172.21.15.162:0/3312440676 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a4014780 con 0x7f97ac141bb0 2024-01-20T11:08:03.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.465+0000 7f97a3400640 1 -- 172.21.15.162:0/3312440676 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4014b30 con 0x7f97ac141bb0 2024-01-20T11:08:03.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.465+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac1f3fa0 con 0x7f97ac141bb0 2024-01-20T11:08:03.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.465+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac0b2390 con 0x7f97ac141bb0 2024-01-20T11:08:03.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.466+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac0b2b70 con 0x7f97ac141bb0 2024-01-20T11:08:03.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.467+0000 7f97a3400640 1 -- 172.21.15.162:0/3312440676 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f97a4014c90 con 0x7f97ac141bb0 2024-01-20T11:08:03.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.468+0000 7f97a3400640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f978406aed0 0x7f978406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.468+0000 7f97a3400640 1 -- 172.21.15.162:0/3312440676 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97a4089f00 con 0x7f97ac141bb0 2024-01-20T11:08:03.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.468+0000 7f97aaa00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f978406aed0 0x7f978406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.469+0000 7f97aaa00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f978406aed0 0x7f978406d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f979c036000 tx=0x7f979c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.472+0000 7f97a3400640 1 -- 172.21.15.162:0/3312440676 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f97a4054e60 con 0x7f97ac141bb0 2024-01-20T11:08:03.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.667+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97ac0cff80 con 0x7f97ac141bb0 2024-01-20T11:08:03.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.668+0000 7f97a3400640 1 -- 172.21.15.162:0/3312440676 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97a4058480 con 0x7f97ac141bb0 2024-01-20T11:08:03.669 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f978406aed0 msgr2=0x7f978406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f978406aed0 0x7f978406d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f979c036000 tx=0x7f979c03d040 comp rx=0 tx=0).stop 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 msgr2=0x7f97ac0afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0afea0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f97a4007e60 tx=0x7f97a400e4b0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 shutdown_connections 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97ac141bb0 0x7f97ac0afea0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ac0ce6a0 0x7f97ac1f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f978406aed0 0x7f978406d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 --2- 172.21.15.162:0/3312440676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ac06cdf0 0x7f97ac13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 >> 172.21.15.162:0/3312440676 conn(0x7f97ac06a600 msgr2=0x7f97ac06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 shutdown_connections 2024-01-20T11:08:03.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.671+0000 7f97b1e00640 1 -- 172.21.15.162:0/3312440676 wait complete. 2024-01-20T11:08:03.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:03.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.901+0000 7f834f200640 1 Processor -- start 2024-01-20T11:08:03.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.901+0000 7f834f200640 1 -- start start 2024-01-20T11:08:03.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.903+0000 7f834f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f834815a320 0x7f834815b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.903+0000 7f834f200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8348071260 con 0x7f834815e930 2024-01-20T11:08:03.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.903+0000 7f834f200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83480709f0 con 0x7f83480b4180 2024-01-20T11:08:03.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.903+0000 7f834f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8348070cd0 con 0x7f834815a320 2024-01-20T11:08:03.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.903+0000 7f8347e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f834815a320 0x7f834815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.903+0000 7f8347e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f834815a320 0x7f834815b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46670/0 (socket says 172.21.15.162:46670) 2024-01-20T11:08:03.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.903+0000 7f8347e00640 1 -- 172.21.15.162:0/3121951301 learned_addr learned my addr 172.21.15.162:0/3121951301 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:03.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.904+0000 7f8347e00640 1 -- 172.21.15.162:0/3121951301 >> v1:172.21.15.179:6789/0 conn(0x7f83480b4180 legacy=0x7f83480cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:03.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.904+0000 7f8347e00640 1 -- 172.21.15.162:0/3121951301 >> v1:172.21.15.162:6789/0 conn(0x7f834815e930 legacy=0x7f83480b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.904+0000 7f8346a00640 1 -- 172.21.15.162:0/3121951301 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898507319 0 0) 0x7f8348071260 con 0x7f834815e930 2024-01-20T11:08:03.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.904+0000 7f8347e00640 1 -- 172.21.15.162:0/3121951301 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834815aa40 con 0x7f834815a320 2024-01-20T11:08:03.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.905+0000 7f8347e00640 1 --2- 172.21.15.162:0/3121951301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815a320 0x7f834815b520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8338009870 tx=0x7f833802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8131272cff43aa12 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.905+0000 7f8346a00640 1 -- 172.21.15.162:0/3121951301 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338030860 con 0x7f834815a320 2024-01-20T11:08:03.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.905+0000 7f8346a00640 1 -- 172.21.15.162:0/3121951301 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83380309c0 con 0x7f834815a320 2024-01-20T11:08:03.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.905+0000 7f8346a00640 1 -- 172.21.15.162:0/3121951301 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338030d50 con 0x7f834815a320 2024-01-20T11:08:03.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.906+0000 7f834f200640 1 -- 172.21.15.162:0/3121951301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815a320 msgr2=0x7f834815b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.906+0000 7f834f200640 1 --2- 172.21.15.162:0/3121951301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815a320 0x7f834815b520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8338009870 tx=0x7f833802b9a0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.906+0000 7f834f200640 1 -- 172.21.15.162:0/3121951301 shutdown_connections 2024-01-20T11:08:03.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.906+0000 7f834f200640 1 --2- 172.21.15.162:0/3121951301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815a320 0x7f834815b520 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.906+0000 7f834f200640 1 -- 172.21.15.162:0/3121951301 >> 172.21.15.162:0/3121951301 conn(0x7f834806a600 msgr2=0x7f834806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:03.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.906+0000 7f834f200640 1 -- 172.21.15.162:0/3121951301 shutdown_connections 2024-01-20T11:08:03.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.906+0000 7f834f200640 1 -- 172.21.15.162:0/3121951301 wait complete. 2024-01-20T11:08:03.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.908+0000 7f834f200640 1 Processor -- start 2024-01-20T11:08:03.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.908+0000 7f834f200640 1 -- start start 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834f200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83480b4180 0x7f8348147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834f200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f834815a320 0x7f8348147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815e930 0x7f83481492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348148250 con 0x7f834815e930 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834f200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348148530 con 0x7f83480b4180 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834f200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8348148810 con 0x7f834815a320 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815e930 0x7f83481492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815e930 0x7f83481492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46678/0 (socket says 172.21.15.162:46678) 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.909+0000 7f834d200640 1 -- 172.21.15.162:0/2915530353 learned_addr learned my addr 172.21.15.162:0/2915530353 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:03.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f8347e00640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83480b4180 0x7f8348147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f8347400640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f834815a320 0x7f8348147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f834d200640 1 -- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f834815a320 msgr2=0x7f8348147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f834d200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f834815a320 0x7f8348147b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f834d200640 1 -- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83480b4180 msgr2=0x7f8348147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f834d200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83480b4180 0x7f8348147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f834d200640 1 -- 172.21.15.162:0/2915530353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380094d0 con 0x7f834815e930 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f834d200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815e930 0x7f83481492f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f834000c780 tx=0x7f834000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f833fe00640 1 -- 172.21.15.162:0/2915530353 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340004b60 con 0x7f834815e930 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f833fe00640 1 -- 172.21.15.162:0/2915530353 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000ce90 con 0x7f834815e930 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f833fe00640 1 -- 172.21.15.162:0/2915530353 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000a850 con 0x7f834815e930 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.910+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8348148af0 con 0x7f834815e930 2024-01-20T11:08:03.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.911+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8348149830 con 0x7f834815e930 2024-01-20T11:08:03.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.912+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8348149010 con 0x7f834815e930 2024-01-20T11:08:03.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.913+0000 7f833fe00640 1 -- 172.21.15.162:0/2915530353 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f834000a9b0 con 0x7f834815e930 2024-01-20T11:08:03.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.913+0000 7f833fe00640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f832006af00 0x7f832006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:03.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.914+0000 7f833fe00640 1 -- 172.21.15.162:0/2915530353 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8340089920 con 0x7f834815e930 2024-01-20T11:08:03.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.914+0000 7f8347e00640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f832006af00 0x7f832006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:03.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.915+0000 7f8347e00640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f832006af00 0x7f832006d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8338036000 tx=0x7f8338008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:03.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:03.918+0000 7f833fe00640 1 -- 172.21.15.162:0/2915530353 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8348149010 con 0x7f834815e930 2024-01-20T11:08:04.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.114+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8348149010 con 0x7f834815e930 2024-01-20T11:08:04.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.115+0000 7f833fe00640 1 -- 172.21.15.162:0/2915530353 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8348149010 con 0x7f834815e930 2024-01-20T11:08:04.117 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:04.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f832006af00 msgr2=0x7f832006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f832006af00 0x7f832006d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8338036000 tx=0x7f8338008030 comp rx=0 tx=0).stop 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815e930 msgr2=0x7f83481492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815e930 0x7f83481492f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f834000c780 tx=0x7f834000cc40 comp rx=0 tx=0).stop 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 shutdown_connections 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f834815e930 0x7f83481492f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f834815a320 0x7f8348147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f832006af00 0x7f832006d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 --2- 172.21.15.162:0/2915530353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83480b4180 0x7f8348147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 >> 172.21.15.162:0/2915530353 conn(0x7f834806a600 msgr2=0x7f834806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 shutdown_connections 2024-01-20T11:08:04.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.118+0000 7f834f200640 1 -- 172.21.15.162:0/2915530353 wait complete. 2024-01-20T11:08:04.138 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:04.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.341+0000 7f1e08c00640 1 Processor -- start 2024-01-20T11:08:04.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.342+0000 7f1e08c00640 1 -- start start 2024-01-20T11:08:04.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.343+0000 7f1e08c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e0415d5a0 0x7f1e040b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.343+0000 7f1e08c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e040cec90 con 0x7f1e040d0400 2024-01-20T11:08:04.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.343+0000 7f1e08c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e040d2730 con 0x7f1e040d2250 2024-01-20T11:08:04.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.343+0000 7f1e08c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040d2a10 con 0x7f1e0415d5a0 2024-01-20T11:08:04.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.343+0000 7f1e02800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1e040d0400 0x7f1e040d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44344/0 (socket says 172.21.15.162:44344) 2024-01-20T11:08:04.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.343+0000 7f1e02800640 1 -- 172.21.15.162:0/1187621202 learned_addr learned my addr 172.21.15.162:0/1187621202 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01e00640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e0415d5a0 0x7f1e040b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765059517 0 0) 0x7f1e040cec90 con 0x7f1e040d0400 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de4003520 con 0x7f1e040d0400 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1180425459 0 0) 0x7f1de4003520 con 0x7f1e040d0400 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e0415d5a0 msgr2=0x7f1e040b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e0415d5a0 0x7f1e040b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 >> v1:172.21.15.179:6789/0 conn(0x7f1e040d2250 legacy=0x7f1e040ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040d2cf0 con 0x7f1e040d0400 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f1dfc0019f0 con 0x7f1e040d0400 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 >> v1:172.21.15.162:6789/0 conn(0x7f1e040d0400 legacy=0x7f1e040d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e0415d5a0 0x7f1de40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de4003f70 0x7f1de40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de4004d00 0x7f1de4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040d2a10 con 0x7f1de4003f70 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de400bac0 con 0x7f1de4004d00 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.344+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de400bc80 con 0x7f1e0415d5a0 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1dfbe00640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de4003f70 0x7f1de40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1e02800640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de4004d00 0x7f1de4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1dfbe00640 1 -- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e0415d5a0 msgr2=0x7f1de40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1dfbe00640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e0415d5a0 0x7f1de40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1dfbe00640 1 -- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de4004d00 msgr2=0x7f1de4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1dfbe00640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de4004d00 0x7f1de4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1dfbe00640 1 -- 172.21.15.162:0/1187621202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de4003520 con 0x7f1de4003f70 2024-01-20T11:08:04.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.345+0000 7f1e02800640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de4004d00 0x7f1de4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.346+0000 7f1dfbe00640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de4003f70 0x7f1de40047c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001750 tx=0x7f1de40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986da25fa9ca77a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.346+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0052d0 con 0x7f1de4003f70 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.346+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec02e050 con 0x7f1de4003f70 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.346+0000 7f1e01400640 1 -- 172.21.15.162:0/1187621202 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec003830 con 0x7f1de4003f70 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.347+0000 7f1e08c00640 1 -- 172.21.15.162:0/1187621202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de4003f70 msgr2=0x7f1de40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.347+0000 7f1e08c00640 1 --2- 172.21.15.162:0/1187621202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de4003f70 0x7f1de40047c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001750 tx=0x7f1de40057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.347+0000 7f1e02800640 1 -- 172.21.15.162:0/1187621202 reap_dead start 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.347+0000 7f1e08c00640 1 -- 172.21.15.162:0/1187621202 shutdown_connections 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.347+0000 7f1e08c00640 1 -- 172.21.15.162:0/1187621202 >> 172.21.15.162:0/1187621202 conn(0x7f1e04066760 msgr2=0x7f1e04066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.347+0000 7f1e08c00640 1 -- 172.21.15.162:0/1187621202 shutdown_connections 2024-01-20T11:08:04.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.347+0000 7f1e08c00640 1 -- 172.21.15.162:0/1187621202 wait complete. 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.349+0000 7f1e08c00640 1 Processor -- start 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.349+0000 7f1e08c00640 1 -- start start 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1e08c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de4003f70 0x7f1e040cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1e08c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e040aaa20 0x7f1e040caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1e08c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04159420 0x7f1e040c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1e08c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040caa90 con 0x7f1e040aaa20 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1e08c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040ab4e0 con 0x7f1e04159420 2024-01-20T11:08:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1e08c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040aaf20 con 0x7f1de4003f70 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1dfbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e040aaa20 0x7f1e040caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1dfbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e040aaa20 0x7f1e040caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46700/0 (socket says 172.21.15.162:46700) 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.350+0000 7f1dfbe00640 1 -- 172.21.15.162:0/3015900556 learned_addr learned my addr 172.21.15.162:0/3015900556 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1e01e00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de4003f70 0x7f1e040cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1e02800640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04159420 0x7f1e040c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfbe00640 1 -- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de4003f70 msgr2=0x7f1e040cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfbe00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de4003f70 0x7f1e040cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfbe00640 1 -- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04159420 msgr2=0x7f1e040c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfbe00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04159420 0x7f1e040c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfbe00640 1 -- 172.21.15.162:0/3015900556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040ab200 con 0x7f1e040aaa20 2024-01-20T11:08:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfbe00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e040aaa20 0x7f1e040caeb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1dec008fd0 tx=0x7f1dec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfa000640 1 -- 172.21.15.162:0/3015900556 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec007a30 con 0x7f1e040aaa20 2024-01-20T11:08:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfa000640 1 -- 172.21.15.162:0/3015900556 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec0069e0 con 0x7f1e040aaa20 2024-01-20T11:08:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1dfa000640 1 -- 172.21.15.162:0/3015900556 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec006d90 con 0x7f1e040aaa20 2024-01-20T11:08:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.351+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e040ca6b0 con 0x7f1e040aaa20 2024-01-20T11:08:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.352+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e040cb3f0 con 0x7f1e040aaa20 2024-01-20T11:08:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.353+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0404e970 con 0x7f1e040aaa20 2024-01-20T11:08:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.354+0000 7f1dfa000640 1 -- 172.21.15.162:0/3015900556 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1dec0035f0 con 0x7f1e040aaa20 2024-01-20T11:08:04.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.354+0000 7f1dfa000640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ddc06aed0 0x7f1ddc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.355+0000 7f1dfa000640 1 -- 172.21.15.162:0/3015900556 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dec0ab580 con 0x7f1e040aaa20 2024-01-20T11:08:04.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.355+0000 7f1e01e00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ddc06aed0 0x7f1ddc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.355+0000 7f1e01e00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ddc06aed0 0x7f1ddc06d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009a50 tx=0x7f1df4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:04.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.359+0000 7f1dfa000640 1 -- 172.21.15.162:0/3015900556 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1dec076440 con 0x7f1e040aaa20 2024-01-20T11:08:04.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.556+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e040ce2f0 con 0x7f1e040aaa20 2024-01-20T11:08:04.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.557+0000 7f1dfa000640 1 -- 172.21.15.162:0/3015900556 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1dec079a60 con 0x7f1e040aaa20 2024-01-20T11:08:04.558 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ddc06aed0 msgr2=0x7f1ddc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ddc06aed0 0x7f1ddc06d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009a50 tx=0x7f1df4008040 comp rx=0 tx=0).stop 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e040aaa20 msgr2=0x7f1e040caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e040aaa20 0x7f1e040caeb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1dec008fd0 tx=0x7f1dec001120 comp rx=0 tx=0).stop 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 shutdown_connections 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ddc06aed0 0x7f1ddc06d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04159420 0x7f1e040c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e040aaa20 0x7f1e040caeb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 --2- 172.21.15.162:0/3015900556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de4003f70 0x7f1e040cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 >> 172.21.15.162:0/3015900556 conn(0x7f1e04066760 msgr2=0x7f1e0415e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 shutdown_connections 2024-01-20T11:08:04.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.560+0000 7f1e08c00640 1 -- 172.21.15.162:0/3015900556 wait complete. 2024-01-20T11:08:04.580 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:04.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.789+0000 7fd7c6800640 1 Processor -- start 2024-01-20T11:08:04.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.789+0000 7fd7c6800640 1 -- start start 2024-01-20T11:08:04.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7c6800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7c00b51d0 0x7fd7c00cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7c6800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c00b55b0 0x7fd7c00ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7c6800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c006ce20 con 0x7fd7c006d040 2024-01-20T11:08:04.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7c6800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c006c210 con 0x7fd7c00b51d0 2024-01-20T11:08:04.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7c6800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c006c4f0 con 0x7fd7c00b55b0 2024-01-20T11:08:04.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7bfe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd7c006d040 0x7fd7c0161770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44352/0 (socket says 172.21.15.162:44352) 2024-01-20T11:08:04.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7bfe00640 1 -- 172.21.15.162:0/289740155 learned_addr learned my addr 172.21.15.162:0/289740155 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:04.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.791+0000 7fd7bf400640 1 --2- 172.21.15.162:0/289740155 >> v2:172.21.15.162:3300/0 conn(0x7fd7c00b51d0 0x7fd7c00cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.792+0000 7fd7b7e00640 1 --2- 172.21.15.162:0/289740155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c00b55b0 0x7fd7c00ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.792+0000 7fd7bea00640 1 -- 172.21.15.162:0/289740155 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657897958 0 0) 0x7fd7c006ce20 con 0x7fd7c006d040 2024-01-20T11:08:04.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.792+0000 7fd7bea00640 1 -- 172.21.15.162:0/289740155 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a0003520 con 0x7fd7c006d040 2024-01-20T11:08:04.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.792+0000 7fd7bf400640 1 -- 172.21.15.162:0/289740155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c00b55b0 msgr2=0x7fd7c00ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:04.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.792+0000 7fd7bf400640 1 --2- 172.21.15.162:0/289740155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c00b55b0 0x7fd7c00ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.792+0000 7fd7bf400640 1 -- 172.21.15.162:0/289740155 >> v1:172.21.15.162:6789/0 conn(0x7fd7c006d040 legacy=0x7fd7c0161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.792+0000 7fd7bf400640 1 -- 172.21.15.162:0/289740155 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c006c7d0 con 0x7fd7c00b51d0 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.793+0000 7fd7bf400640 1 --2- 172.21.15.162:0/289740155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b51d0 0x7fd7c00cde60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00097a0 tx=0x7fd7b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71134a410e947605 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.793+0000 7fd7bea00640 1 -- 172.21.15.162:0/289740155 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b002e070 con 0x7fd7c00b51d0 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.793+0000 7fd7bea00640 1 -- 172.21.15.162:0/289740155 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b00315a0 con 0x7fd7c00b51d0 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.793+0000 7fd7bea00640 1 -- 172.21.15.162:0/289740155 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0031930 con 0x7fd7c00b51d0 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 -- 172.21.15.162:0/289740155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b51d0 msgr2=0x7fd7c00cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 --2- 172.21.15.162:0/289740155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b51d0 0x7fd7c00cde60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00097a0 tx=0x7fd7b002b840 comp rx=0 tx=0).stop 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 -- 172.21.15.162:0/289740155 shutdown_connections 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 --2- 172.21.15.162:0/289740155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c00b55b0 0x7fd7c00ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 --2- 172.21.15.162:0/289740155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b51d0 0x7fd7c00cde60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 -- 172.21.15.162:0/289740155 >> 172.21.15.162:0/289740155 conn(0x7fd7c009c790 msgr2=0x7fd7c00d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 -- 172.21.15.162:0/289740155 shutdown_connections 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.794+0000 7fd7c6800640 1 -- 172.21.15.162:0/289740155 wait complete. 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.796+0000 7fd7c6800640 1 Processor -- start 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.796+0000 7fd7c6800640 1 -- start start 2024-01-20T11:08:04.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7c6800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c006d040 0x7fd7c00c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7c6800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7c00b51d0 0x7fd7c015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7c6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b55b0 0x7fd7c015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7c6800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00b8340 con 0x7fd7c00b55b0 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7c6800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00b76c0 con 0x7fd7c00b51d0 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7c6800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00b79a0 con 0x7fd7c006d040 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b55b0 0x7fd7c015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b55b0 0x7fd7c015a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46716/0 (socket says 172.21.15.162:46716) 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.797+0000 7fd7bfe00640 1 -- 172.21.15.162:0/1370055778 learned_addr learned my addr 172.21.15.162:0/1370055778 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7bf400640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c006d040 0x7fd7c00c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7b7e00640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7c00b51d0 0x7fd7c015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7bfe00640 1 -- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c006d040 msgr2=0x7fd7c00c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7bfe00640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c006d040 0x7fd7c00c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7bfe00640 1 -- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7c00b51d0 msgr2=0x7fd7c015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7bfe00640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7c00b51d0 0x7fd7c015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7bfe00640 1 -- 172.21.15.162:0/1370055778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0009400 con 0x7fd7c00b55b0 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7bfe00640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b55b0 0x7fd7c015a530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cb40 tx=0x7fd7b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7b7400640 1 -- 172.21.15.162:0/1370055778 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800aca0 con 0x7fd7c00b55b0 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7b7400640 1 -- 172.21.15.162:0/1370055778 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b800ae00 con 0x7fd7c00b55b0 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7b7400640 1 -- 172.21.15.162:0/1370055778 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8012620 con 0x7fd7c00b55b0 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.798+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c00b7c80 con 0x7fd7c00b55b0 2024-01-20T11:08:04.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.799+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c015d7b0 con 0x7fd7c00b55b0 2024-01-20T11:08:04.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.800+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c00b8480 con 0x7fd7c00b55b0 2024-01-20T11:08:04.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.801+0000 7fd7b7400640 1 -- 172.21.15.162:0/1370055778 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd7b8007070 con 0x7fd7c00b55b0 2024-01-20T11:08:04.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.801+0000 7fd7b7400640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd79806aed0 0x7fd79806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:04.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.802+0000 7fd7b7400640 1 -- 172.21.15.162:0/1370055778 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7b8089720 con 0x7fd7c00b55b0 2024-01-20T11:08:04.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.802+0000 7fd7bf400640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd79806aed0 0x7fd79806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:04.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.802+0000 7fd7bf400640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd79806aed0 0x7fd79806d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0036000 tx=0x7fd7b003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:04.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.806+0000 7fd7b7400640 1 -- 172.21.15.162:0/1370055778 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd7c00b8480 con 0x7fd7c00b55b0 2024-01-20T11:08:05.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:04.999+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c00b8480 con 0x7fd7c00b55b0 2024-01-20T11:08:05.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.001+0000 7fd7b7400640 1 -- 172.21.15.162:0/1370055778 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fd7c00b8480 con 0x7fd7c00b55b0 2024-01-20T11:08:05.003 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:05.003 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:05.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.003+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd79806aed0 msgr2=0x7fd79806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.003+0000 7fd7c6800640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd79806aed0 0x7fd79806d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0036000 tx=0x7fd7b003d040 comp rx=0 tx=0).stop 2024-01-20T11:08:05.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.003+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b55b0 msgr2=0x7fd7c015a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.003+0000 7fd7c6800640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b55b0 0x7fd7c015a530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cb40 tx=0x7fd7b800a060 comp rx=0 tx=0).stop 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 shutdown_connections 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00b55b0 0x7fd7c015a530 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd79806aed0 0x7fd79806d390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7c00b51d0 0x7fd7c015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 --2- 172.21.15.162:0/1370055778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7c006d040 0x7fd7c00c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 >> 172.21.15.162:0/1370055778 conn(0x7fd7c009c790 msgr2=0x7fd7c00d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 shutdown_connections 2024-01-20T11:08:05.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.004+0000 7fd7c6800640 1 -- 172.21.15.162:0/1370055778 wait complete. 2024-01-20T11:08:05.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:05.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:05.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.235+0000 7f936e400640 1 Processor -- start 2024-01-20T11:08:05.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.235+0000 7f936e400640 1 -- start start 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f936e400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93680b2040 0x7f936815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f936e400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f93680cf060 0x7f93680cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f936e400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680b2ec0 con 0x7f936815a380 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f936e400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9368070eb0 con 0x7f93680cf060 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f936e400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936815ee30 con 0x7f93680b2040 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f9367400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f936815a380 0x7f93680707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44366/0 (socket says 172.21.15.162:44366) 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f9367400640 1 -- 172.21.15.162:0/1268055458 learned_addr learned my addr 172.21.15.162:0/1268055458 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:05.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.237+0000 7f9367e00640 1 --2- 172.21.15.162:0/1268055458 >> v2:172.21.15.162:3300/0 conn(0x7f93680cf060 0x7f93680cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.238+0000 7f935fe00640 1 --2- 172.21.15.162:0/1268055458 >> v2:172.21.15.179:3300/0 conn(0x7f93680b2040 0x7f936815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.238+0000 7f9366a00640 1 -- 172.21.15.162:0/1268055458 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667983375 0 0) 0x7f9358001110 con 0x7f936815a380 2024-01-20T11:08:05.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.238+0000 7f9367e00640 1 -- 172.21.15.162:0/1268055458 >> v2:172.21.15.179:3300/0 conn(0x7f93680b2040 msgr2=0x7f936815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:05.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.238+0000 7f9367e00640 1 --2- 172.21.15.162:0/1268055458 >> v2:172.21.15.179:3300/0 conn(0x7f93680b2040 0x7f936815e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.238+0000 7f9367e00640 1 -- 172.21.15.162:0/1268055458 >> v1:172.21.15.162:6789/0 conn(0x7f936815a380 legacy=0x7f93680707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.238+0000 7f9367e00640 1 -- 172.21.15.162:0/1268055458 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680cf9f0 con 0x7f93680cf060 2024-01-20T11:08:05.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.239+0000 7f9367e00640 1 --2- 172.21.15.162:0/1268055458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f93680cf4b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93680671c0 tx=0x7f936002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4066302b68313615 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:05.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.239+0000 7f9366a00640 1 -- 172.21.15.162:0/1268055458 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936002cbe0 con 0x7f93680cf060 2024-01-20T11:08:05.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.239+0000 7f9366a00640 1 -- 172.21.15.162:0/1268055458 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936002cd40 con 0x7f93680cf060 2024-01-20T11:08:05.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.239+0000 7f9366a00640 1 -- 172.21.15.162:0/1268055458 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360034660 con 0x7f93680cf060 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 -- 172.21.15.162:0/1268055458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 msgr2=0x7f93680cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 --2- 172.21.15.162:0/1268055458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f93680cf4b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93680671c0 tx=0x7f936002be30 comp rx=0 tx=0).stop 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 -- 172.21.15.162:0/1268055458 shutdown_connections 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 --2- 172.21.15.162:0/1268055458 >> v2:172.21.15.179:3300/0 conn(0x7f93680b2040 0x7f936815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 --2- 172.21.15.162:0/1268055458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f93680cf4b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 -- 172.21.15.162:0/1268055458 >> 172.21.15.162:0/1268055458 conn(0x7f936806a600 msgr2=0x7f936806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 -- 172.21.15.162:0/1268055458 shutdown_connections 2024-01-20T11:08:05.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.240+0000 7f936e400640 1 -- 172.21.15.162:0/1268055458 wait complete. 2024-01-20T11:08:05.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.242+0000 7f936e400640 1 Processor -- start 2024-01-20T11:08:05.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.242+0000 7f936e400640 1 -- start start 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f936e400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93680b2040 0x7f9368150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f936e400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f9368151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f936e400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936815a380 0x7f9368154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f936e400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9368151680 con 0x7f93680cf060 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f936e400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93681518b0 con 0x7f93680b2040 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f936e400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9368151b90 con 0x7f936815a380 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f935fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f9368151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f935fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f9368151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46726/0 (socket says 172.21.15.162:46726) 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f935fe00640 1 -- 172.21.15.162:0/2320122514 learned_addr learned my addr 172.21.15.162:0/2320122514 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.243+0000 7f9367400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93680b2040 0x7f9368150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f9367e00640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936815a380 0x7f9368154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935fe00640 1 -- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936815a380 msgr2=0x7f9368154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935fe00640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936815a380 0x7f9368154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935fe00640 1 -- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93680b2040 msgr2=0x7f9368150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935fe00640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93680b2040 0x7f9368150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935fe00640 1 -- 172.21.15.162:0/2320122514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360009a70 con 0x7f93680cf060 2024-01-20T11:08:05.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935fe00640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f9368151140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f935000d800 tx=0x7f935000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:05.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935f400640 1 -- 172.21.15.162:0/2320122514 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935000b6c0 con 0x7f93680cf060 2024-01-20T11:08:05.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935f400640 1 -- 172.21.15.162:0/2320122514 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935000b820 con 0x7f93680cf060 2024-01-20T11:08:05.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f935f400640 1 -- 172.21.15.162:0/2320122514 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935000bbb0 con 0x7f93680cf060 2024-01-20T11:08:05.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9368151e70 con 0x7f93680cf060 2024-01-20T11:08:05.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.244+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9368152430 con 0x7f93680cf060 2024-01-20T11:08:05.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.245+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936804e970 con 0x7f93680cf060 2024-01-20T11:08:05.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.246+0000 7f935f400640 1 -- 172.21.15.162:0/2320122514 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f935000bd10 con 0x7f93680cf060 2024-01-20T11:08:05.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.247+0000 7f935f400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f934006aed0 0x7f934006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.247+0000 7f935f400640 1 -- 172.21.15.162:0/2320122514 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9350089c80 con 0x7f93680cf060 2024-01-20T11:08:05.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.247+0000 7f9367400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f934006aed0 0x7f934006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.248+0000 7f9367400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f934006aed0 0x7f934006d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9358000f60 tx=0x7f9358007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:05.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.251+0000 7f935f400640 1 -- 172.21.15.162:0/2320122514 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9350054ab0 con 0x7f93680cf060 2024-01-20T11:08:05.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.442+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f936806d550 con 0x7f93680cf060 2024-01-20T11:08:05.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.443+0000 7f935f400640 1 -- 172.21.15.162:0/2320122514 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93500580d0 con 0x7f93680cf060 2024-01-20T11:08:05.445 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:05.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f934006aed0 msgr2=0x7f934006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f934006aed0 0x7f934006d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9358000f60 tx=0x7f9358007c00 comp rx=0 tx=0).stop 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 msgr2=0x7f9368151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f9368151140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f935000d800 tx=0x7f935000dcc0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 shutdown_connections 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936815a380 0x7f9368154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680cf060 0x7f9368151140 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f934006aed0 0x7f934006d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 --2- 172.21.15.162:0/2320122514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93680b2040 0x7f9368150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 >> 172.21.15.162:0/2320122514 conn(0x7f936806a600 msgr2=0x7f936806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 shutdown_connections 2024-01-20T11:08:05.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.446+0000 7f936e400640 1 -- 172.21.15.162:0/2320122514 wait complete. 2024-01-20T11:08:05.466 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:05.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.679+0000 7f6f92e00640 1 Processor -- start 2024-01-20T11:08:05.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.679+0000 7f6f92e00640 1 -- start start 2024-01-20T11:08:05.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.680+0000 7f6f92e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f8c13e380 0x7f6f8c15efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.680+0000 7f6f92e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c06d150 con 0x7f6f8c06cce0 2024-01-20T11:08:05.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.680+0000 7f6f92e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c13fa50 con 0x7f6f8c15f520 2024-01-20T11:08:05.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.680+0000 7f6f92e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c06d3a0 con 0x7f6f8c13e380 2024-01-20T11:08:05.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.681+0000 7f6f90e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6f8c06cce0 0x7f6f8c140c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44370/0 (socket says 172.21.15.162:44370) 2024-01-20T11:08:05.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.681+0000 7f6f90e00640 1 -- 172.21.15.162:0/2965228544 learned_addr learned my addr 172.21.15.162:0/2965228544 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.681+0000 7f6f8be00640 1 --2- 172.21.15.162:0/2965228544 >> v2:172.21.15.179:3300/0 conn(0x7f6f8c13e380 0x7f6f8c15efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.681+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946555289 0 0) 0x7f6f8c06d150 con 0x7f6f8c06cce0 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.681+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f6c003520 con 0x7f6f8c06cce0 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2348366998 0 0) 0x7f6f6c003520 con 0x7f6f8c06cce0 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 >> v2:172.21.15.179:3300/0 conn(0x7f6f8c13e380 msgr2=0x7f6f8c15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 --2- 172.21.15.162:0/2965228544 >> v2:172.21.15.179:3300/0 conn(0x7f6f8c13e380 0x7f6f8c15efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 >> v1:172.21.15.179:6789/0 conn(0x7f6f8c15f520 legacy=0x7f6f8c06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c13e760 con 0x7f6f8c06cce0 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f6f84001670 con 0x7f6f8c06cce0 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 >> v1:172.21.15.162:6789/0 conn(0x7f6f8c06cce0 legacy=0x7f6f8c140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c003970 0x7f6f6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6c0047c0 0x7f6f6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6c005180 0x7f6f6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c06d3a0 con 0x7f6f6c005180 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c00c020 con 0x7f6f6c0047c0 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c00c1e0 con 0x7f6f6c003970 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.682+0000 7f6f90e00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6c005180 0x7f6f6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f8be00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c003970 0x7f6f6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f8b400640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6c0047c0 0x7f6f6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f90e00640 1 -- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c003970 msgr2=0x7f6f6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f90e00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c003970 0x7f6f6c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f90e00640 1 -- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6c0047c0 msgr2=0x7f6f6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f90e00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6c0047c0 0x7f6f6c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f90e00640 1 -- 172.21.15.162:0/2965228544 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c003520 con 0x7f6f6c005180 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f8be00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c003970 0x7f6f6c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:05.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.683+0000 7f6f8b400640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6c0047c0 0x7f6f6c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.684+0000 7f6f90e00640 1 -- 172.21.15.162:0/2965228544 reap_dead start 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.684+0000 7f6f90e00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6c005180 0x7f6f6c00b980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c240 tx=0x7f6f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d45497eeaa5a893 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.684+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84005ad0 con 0x7f6f6c005180 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.684+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84005c70 con 0x7f6f6c005180 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.684+0000 7f6f8aa00640 1 -- 172.21.15.162:0/2965228544 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8402c8b0 con 0x7f6f6c005180 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.685+0000 7f6f92e00640 1 -- 172.21.15.162:0/2965228544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6c005180 msgr2=0x7f6f6c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.685+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6c005180 0x7f6f6c00b980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c240 tx=0x7f6f6c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.685+0000 7f6f92e00640 1 -- 172.21.15.162:0/2965228544 shutdown_connections 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.685+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2965228544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f6c005180 0x7f6f6c00b980 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.685+0000 7f6f92e00640 1 -- 172.21.15.162:0/2965228544 >> 172.21.15.162:0/2965228544 conn(0x7f6f8c06a600 msgr2=0x7f6f8c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:05.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.685+0000 7f6f92e00640 1 -- 172.21.15.162:0/2965228544 shutdown_connections 2024-01-20T11:08:05.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.685+0000 7f6f92e00640 1 -- 172.21.15.162:0/2965228544 wait complete. 2024-01-20T11:08:05.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.687+0000 7f6f92e00640 1 Processor -- start 2024-01-20T11:08:05.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.687+0000 7f6f92e00640 1 -- start start 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f92e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c005180 0x7f6f8c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f92e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c13d8c0 0x7f6f8c0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f92e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c13dd20 0x7f6f8c0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f92e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1563b0 con 0x7f6f8c13dd20 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f92e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0ae240 con 0x7f6f8c13d8c0 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f92e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0acc60 con 0x7f6f6c005180 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c13dd20 0x7f6f8c0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c13dd20 0x7f6f8c0714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46746/0 (socket says 172.21.15.162:46746) 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 -- 172.21.15.162:0/2323130655 learned_addr learned my addr 172.21.15.162:0/2323130655 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 -- 172.21.15.162:0/2323130655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c005180 msgr2=0x7f6f8c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f8b400640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c13d8c0 0x7f6f8c0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c005180 0x7f6f8c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 -- 172.21.15.162:0/2323130655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c13d8c0 msgr2=0x7f6f8c0b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c13d8c0 0x7f6f8c0b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.688+0000 7f6f90e00640 1 -- 172.21.15.162:0/2323130655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0acf40 con 0x7f6f8c13dd20 2024-01-20T11:08:05.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.689+0000 7f6f90e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c13dd20 0x7f6f8c0714c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6f8402c520 tx=0x7f6f84001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:05.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.689+0000 7f6f83e00640 1 -- 172.21.15.162:0/2323130655 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840049e0 con 0x7f6f8c13dd20 2024-01-20T11:08:05.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.689+0000 7f6f83e00640 1 -- 172.21.15.162:0/2323130655 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84004b40 con 0x7f6f8c13dd20 2024-01-20T11:08:05.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.689+0000 7f6f83e00640 1 -- 172.21.15.162:0/2323130655 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8402de80 con 0x7f6f8c13dd20 2024-01-20T11:08:05.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.689+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c0ad220 con 0x7f6f8c13dd20 2024-01-20T11:08:05.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.689+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c0ad7e0 con 0x7f6f8c13dd20 2024-01-20T11:08:05.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.690+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c04e970 con 0x7f6f8c13dd20 2024-01-20T11:08:05.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.691+0000 7f6f83e00640 1 -- 172.21.15.162:0/2323130655 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6f84032070 con 0x7f6f8c13dd20 2024-01-20T11:08:05.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.692+0000 7f6f83e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6f6406aed0 0x7f6f6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:05.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.692+0000 7f6f83e00640 1 -- 172.21.15.162:0/2323130655 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f8403c070 con 0x7f6f8c13dd20 2024-01-20T11:08:05.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.692+0000 7f6f8be00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6f6406aed0 0x7f6f6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:05.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.693+0000 7f6f8be00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6f6406aed0 0x7f6f6406d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007460 tx=0x7f6f7c009750 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:05.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.696+0000 7f6f83e00640 1 -- 172.21.15.162:0/2323130655 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6f840755b0 con 0x7f6f8c13dd20 2024-01-20T11:08:05.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.890+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f8c0cdea0 con 0x7f6f8c13dd20 2024-01-20T11:08:05.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.891+0000 7f6f83e00640 1 -- 172.21.15.162:0/2323130655 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f84078bd0 con 0x7f6f8c13dd20 2024-01-20T11:08:05.893 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:05.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.893+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6f6406aed0 msgr2=0x7f6f6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.893+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6f6406aed0 0x7f6f6406d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007460 tx=0x7f6f7c009750 comp rx=0 tx=0).stop 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.893+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c13dd20 msgr2=0x7f6f8c0714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.893+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c13dd20 0x7f6f8c0714c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6f8402c520 tx=0x7f6f84001a00 comp rx=0 tx=0).stop 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 shutdown_connections 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f8c13dd20 0x7f6f8c0714c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6f6406aed0 0x7f6f6406d390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c13d8c0 0x7f6f8c0b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 --2- 172.21.15.162:0/2323130655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6c005180 0x7f6f8c0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 >> 172.21.15.162:0/2323130655 conn(0x7f6f8c06a600 msgr2=0x7f6f8c15df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 shutdown_connections 2024-01-20T11:08:05.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:05.894+0000 7f6f92e00640 1 -- 172.21.15.162:0/2323130655 wait complete. 2024-01-20T11:08:05.912 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:06.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.120+0000 7fa1aa800640 1 Processor -- start 2024-01-20T11:08:06.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.120+0000 7fa1aa800640 1 -- start start 2024-01-20T11:08:06.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.121+0000 7fa1aa800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 0x7fa1a40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.121+0000 7fa1aa800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa1a415d720 0x7fa1a40d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.121+0000 7fa1aa800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a40d22f0 con 0x7fa1a40d1000 2024-01-20T11:08:06.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.121+0000 7fa1aa800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a40d3b20 con 0x7fa1a415d720 2024-01-20T11:08:06.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.121+0000 7fa1aa800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40d1d30 con 0x7fa1a40d3200 2024-01-20T11:08:06.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.122+0000 7fa1a9e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa1a40d1000 0x7fa1a40d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44384/0 (socket says 172.21.15.162:44384) 2024-01-20T11:08:06.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.122+0000 7fa1a9e00640 1 -- 172.21.15.162:0/1766710577 learned_addr learned my addr 172.21.15.162:0/1766710577 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:06.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.122+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175694492 0 0) 0x7fa1a40d22f0 con 0x7fa1a40d1000 2024-01-20T11:08:06.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.122+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa184003520 con 0x7fa1a40d1000 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.122+0000 7fa1a9400640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 0x7fa1a40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1603462585 0 0) 0x7fa184003520 con 0x7fa1a40d1000 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 msgr2=0x7fa1a40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 0x7fa1a40cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 >> v2:172.21.15.179:3300/0 conn(0x7fa1a415d720 msgr2=0x7fa1a40d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 --2- 172.21.15.162:0/1766710577 >> v2:172.21.15.179:3300/0 conn(0x7fa1a415d720 0x7fa1a40d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a40d2010 con 0x7fa1a40d1000 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fa19c0019f0 con 0x7fa1a40d1000 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 >> v1:172.21.15.162:6789/0 conn(0x7fa1a40d1000 legacy=0x7fa1a40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 0x7fa184003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184003fa0 0x7fa1840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184004d00 0x7fa184005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40d3b20 con 0x7fa184003fa0 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40d1d30 con 0x7fa184004d00 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18400bb90 con 0x7fa1a40d3200 2024-01-20T11:08:06.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a8a00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184003fa0 0x7fa1840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.123+0000 7fa1a9e00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184004d00 0x7fa184005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.124+0000 7fa1a9400640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 0x7fa184003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.124+0000 7fa1a8a00640 1 -- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 msgr2=0x7fa184003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:06.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.124+0000 7fa1a8a00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a40d3200 0x7fa184003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.124+0000 7fa1a8a00640 1 -- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184004d00 msgr2=0x7fa184005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:06.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.124+0000 7fa1a8a00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184004d00 0x7fa184005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.124+0000 7fa1a8a00640 1 -- 172.21.15.162:0/1766710577 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184003520 con 0x7fa184003fa0 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.125+0000 7fa1a8a00640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184003fa0 0x7fa1840047c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa1a415db20 tx=0x7fa1840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781bce7bf2b4e74a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.125+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c032600 con 0x7fa184003fa0 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.125+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c02e050 con 0x7fa184003fa0 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.125+0000 7fa1a3e00640 1 -- 172.21.15.162:0/1766710577 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0329c0 con 0x7fa184003fa0 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.126+0000 7fa1aa800640 1 -- 172.21.15.162:0/1766710577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184003fa0 msgr2=0x7fa1840047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.126+0000 7fa1aa800640 1 --2- 172.21.15.162:0/1766710577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184003fa0 0x7fa1840047c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa1a415db20 tx=0x7fa1840057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.126+0000 7fa1a9e00640 1 -- 172.21.15.162:0/1766710577 reap_dead start 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.126+0000 7fa1aa800640 1 -- 172.21.15.162:0/1766710577 shutdown_connections 2024-01-20T11:08:06.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.126+0000 7fa1aa800640 1 -- 172.21.15.162:0/1766710577 >> 172.21.15.162:0/1766710577 conn(0x7fa1a408cc80 msgr2=0x7fa1a409c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:06.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.126+0000 7fa1aa800640 1 -- 172.21.15.162:0/1766710577 shutdown_connections 2024-01-20T11:08:06.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.126+0000 7fa1aa800640 1 -- 172.21.15.162:0/1766710577 wait complete. 2024-01-20T11:08:06.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.128+0000 7fa1aa800640 1 Processor -- start 2024-01-20T11:08:06.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.128+0000 7fa1aa800640 1 -- start start 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1aa800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184003fa0 0x7fa1a41585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1aa800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1a4157d20 0x7fa1a415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1aa800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a4155a90 0x7fa1a4155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1aa800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4156460 con 0x7fa1a4157d20 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1aa800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a415ee30 con 0x7fa184003fa0 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1aa800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a415f110 con 0x7fa1a4155a90 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1a4157d20 0x7fa1a415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1a4157d20 0x7fa1a415e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46772/0 (socket says 172.21.15.162:46772) 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a8a00640 1 -- 172.21.15.162:0/1191230360 learned_addr learned my addr 172.21.15.162:0/1191230360 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a9400640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184003fa0 0x7fa1a41585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a9e00640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a4155a90 0x7fa1a4155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a8a00640 1 -- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a4155a90 msgr2=0x7fa1a4155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a8a00640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a4155a90 0x7fa1a4155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a8a00640 1 -- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184003fa0 msgr2=0x7fa1a41585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.129+0000 7fa1a8a00640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184003fa0 0x7fa1a41585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1a8a00640 1 -- 172.21.15.162:0/1191230360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a415f3f0 con 0x7fa1a4157d20 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1a9e00640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a4155a90 0x7fa1a4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:06.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1a8a00640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1a4157d20 0x7fa1a415e4e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa18c000c00 tx=0x7fa18c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:06.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1a1600640 1 -- 172.21.15.162:0/1191230360 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c03d620 con 0x7fa1a4157d20 2024-01-20T11:08:06.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1a1600640 1 -- 172.21.15.162:0/1191230360 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c03d780 con 0x7fa1a4157d20 2024-01-20T11:08:06.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1a1600640 1 -- 172.21.15.162:0/1191230360 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c03db50 con 0x7fa1a4157d20 2024-01-20T11:08:06.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a415f6d0 con 0x7fa1a4157d20 2024-01-20T11:08:06.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.130+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a4158b00 con 0x7fa1a4157d20 2024-01-20T11:08:06.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.131+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a4074a30 con 0x7fa1a4157d20 2024-01-20T11:08:06.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.132+0000 7fa1a1600640 1 -- 172.21.15.162:0/1191230360 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa18c03dcb0 con 0x7fa1a4157d20 2024-01-20T11:08:06.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.133+0000 7fa1a1600640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa17c06aed0 0x7fa17c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.133+0000 7fa1a1600640 1 -- 172.21.15.162:0/1191230360 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa18c0ab2d0 con 0x7fa1a4157d20 2024-01-20T11:08:06.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.133+0000 7fa1a9400640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa17c06aed0 0x7fa17c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.134+0000 7fa1a9400640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa17c06aed0 0x7fa17c06d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fd0 tx=0x7fa194008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:06.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.138+0000 7fa1a1600640 1 -- 172.21.15.162:0/1191230360 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa18c0761b0 con 0x7fa1a4157d20 2024-01-20T11:08:06.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.331+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1a40d4180 con 0x7fa1a4157d20 2024-01-20T11:08:06.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.332+0000 7fa1a1600640 1 -- 172.21.15.162:0/1191230360 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa18c0797d0 con 0x7fa1a4157d20 2024-01-20T11:08:06.336 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:06.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa17c06aed0 msgr2=0x7fa17c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa17c06aed0 0x7fa17c06d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fd0 tx=0x7fa194008040 comp rx=0 tx=0).stop 2024-01-20T11:08:06.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1a4157d20 msgr2=0x7fa1a415e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1a4157d20 0x7fa1a415e4e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa18c000c00 tx=0x7fa18c0047d0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 shutdown_connections 2024-01-20T11:08:06.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1a4155a90 0x7fa1a4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1a4157d20 0x7fa1a415e4e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa17c06aed0 0x7fa17c06d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 --2- 172.21.15.162:0/1191230360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184003fa0 0x7fa1a41585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.334+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 >> 172.21.15.162:0/1191230360 conn(0x7fa1a408cc80 msgr2=0x7fa1a40b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:06.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.335+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 shutdown_connections 2024-01-20T11:08:06.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.335+0000 7fa1aa800640 1 -- 172.21.15.162:0/1191230360 wait complete. 2024-01-20T11:08:06.355 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:06.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.563+0000 7fb695e00640 1 Processor -- start 2024-01-20T11:08:06.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.563+0000 7fb695e00640 1 -- start start 2024-01-20T11:08:06.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb695e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69015a530 0x7fb6900cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb695e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb690071260 0x7fb6900716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb695e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb69006d7a0 0x7fb69006dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb695e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900ca390 con 0x7fb690071260 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb695e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69006e170 con 0x7fb69006d7a0 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb695e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015a910 con 0x7fb69015a530 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb685e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb690071260 0x7fb6900716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb685e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb690071260 0x7fb6900716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:59980/0 (socket says 172.21.15.162:59980) 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.564+0000 7fb685e00640 1 -- 172.21.15.162:0/3511618823 learned_addr learned my addr 172.21.15.162:0/3511618823 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb68ea00640 1 --2- 172.21.15.162:0/3511618823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69015a530 0x7fb6900cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb685e00640 1 -- 172.21.15.162:0/3511618823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69015a530 msgr2=0x7fb6900cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb685e00640 1 --2- 172.21.15.162:0/3511618823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69015a530 0x7fb6900cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb685e00640 1 -- 172.21.15.162:0/3511618823 >> v2:172.21.15.179:3300/0 conn(0x7fb69006d7a0 msgr2=0x7fb69006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb68f400640 1 --2- 172.21.15.162:0/3511618823 >> v2:172.21.15.179:3300/0 conn(0x7fb69006d7a0 0x7fb69006dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb685e00640 1 --2- 172.21.15.162:0/3511618823 >> v2:172.21.15.179:3300/0 conn(0x7fb69006d7a0 0x7fb69006dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb685e00640 1 -- 172.21.15.162:0/3511618823 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690072960 con 0x7fb690071260 2024-01-20T11:08:06.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.565+0000 7fb68f400640 1 --2- 172.21.15.162:0/3511618823 >> v2:172.21.15.179:3300/0 conn(0x7fb69006d7a0 0x7fb69006dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.566+0000 7fb685e00640 1 --2- 172.21.15.162:0/3511618823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb690071260 0x7fb6900716a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb69006ea80 tx=0x7fb67802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8435526a009863cc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.566+0000 7fb68e000640 1 -- 172.21.15.162:0/3511618823 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780317c0 con 0x7fb690071260 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.566+0000 7fb68e000640 1 -- 172.21.15.162:0/3511618823 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678031920 con 0x7fb690071260 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.566+0000 7fb68e000640 1 -- 172.21.15.162:0/3511618823 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678031cb0 con 0x7fb690071260 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 -- 172.21.15.162:0/3511618823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb690071260 msgr2=0x7fb6900716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 --2- 172.21.15.162:0/3511618823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb690071260 0x7fb6900716a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb69006ea80 tx=0x7fb67802b860 comp rx=0 tx=0).stop 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 -- 172.21.15.162:0/3511618823 shutdown_connections 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 --2- 172.21.15.162:0/3511618823 >> v2:172.21.15.179:3300/0 conn(0x7fb69006d7a0 0x7fb69006dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 --2- 172.21.15.162:0/3511618823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb690071260 0x7fb6900716a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 --2- 172.21.15.162:0/3511618823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69015a530 0x7fb6900cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 -- 172.21.15.162:0/3511618823 >> 172.21.15.162:0/3511618823 conn(0x7fb6900b0cd0 msgr2=0x7fb6900b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:06.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 -- 172.21.15.162:0/3511618823 shutdown_connections 2024-01-20T11:08:06.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.567+0000 7fb695e00640 1 -- 172.21.15.162:0/3511618823 wait complete. 2024-01-20T11:08:06.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.569+0000 7fb695e00640 1 Processor -- start 2024-01-20T11:08:06.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.569+0000 7fb695e00640 1 -- start start 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb695e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69006d7a0 0x7fb69009ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb695e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb690071260 0x7fb690151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb695e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69015a530 0x7fb6900b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb695e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69009aa00 con 0x7fb69006d7a0 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb695e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901520a0 con 0x7fb69015a530 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb695e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb690099d80 con 0x7fb690071260 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb68ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69006d7a0 0x7fb69009ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb68ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69006d7a0 0x7fb69009ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:59984/0 (socket says 172.21.15.162:59984) 2024-01-20T11:08:06.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.570+0000 7fb68ea00640 1 -- 172.21.15.162:0/1959025632 learned_addr learned my addr 172.21.15.162:0/1959025632 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:06.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb68f400640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69015a530 0x7fb6900b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb68ea00640 1 -- 172.21.15.162:0/1959025632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb690071260 msgr2=0x7fb690151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb68ea00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb690071260 0x7fb690151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb68ea00640 1 -- 172.21.15.162:0/1959025632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69015a530 msgr2=0x7fb6900b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb68ea00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69015a530 0x7fb6900b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb68ea00640 1 -- 172.21.15.162:0/1959025632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780094d0 con 0x7fb69006d7a0 2024-01-20T11:08:06.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb68ea00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69006d7a0 0x7fb69009ae20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c7f0 tx=0x7fb68000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:06.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb687e00640 1 -- 172.21.15.162:0/1959025632 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680004220 con 0x7fb69006d7a0 2024-01-20T11:08:06.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb687e00640 1 -- 172.21.15.162:0/1959025632 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680004380 con 0x7fb69006d7a0 2024-01-20T11:08:06.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb687e00640 1 -- 172.21.15.162:0/1959025632 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680007840 con 0x7fb69006d7a0 2024-01-20T11:08:06.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69009a060 con 0x7fb69006d7a0 2024-01-20T11:08:06.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.571+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69009a620 con 0x7fb69006d7a0 2024-01-20T11:08:06.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.573+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69004e970 con 0x7fb69006d7a0 2024-01-20T11:08:06.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.573+0000 7fb687e00640 1 -- 172.21.15.162:0/1959025632 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb680007bb0 con 0x7fb69006d7a0 2024-01-20T11:08:06.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.574+0000 7fb687e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb66806aed0 0x7fb66806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:06.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.574+0000 7fb687e00640 1 -- 172.21.15.162:0/1959025632 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb680089560 con 0x7fb69006d7a0 2024-01-20T11:08:06.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.575+0000 7fb685e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb66806aed0 0x7fb66806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:06.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.575+0000 7fb685e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb66806aed0 0x7fb66806d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb678036000 tx=0x7fb678030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:06.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.579+0000 7fb687e00640 1 -- 172.21.15.162:0/1959025632 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb680054430 con 0x7fb69006d7a0 2024-01-20T11:08:06.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.775+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb69015dce0 con 0x7fb69006d7a0 2024-01-20T11:08:06.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.777+0000 7fb687e00640 1 -- 172.21.15.162:0/1959025632 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fb680007e60 con 0x7fb69006d7a0 2024-01-20T11:08:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:06.780 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.780+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb66806aed0 msgr2=0x7fb66806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.780+0000 7fb695e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb66806aed0 0x7fb66806d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb678036000 tx=0x7fb678030000 comp rx=0 tx=0).stop 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.780+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69006d7a0 msgr2=0x7fb69009ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.780+0000 7fb695e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69006d7a0 0x7fb69009ae20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c7f0 tx=0x7fb68000ccb0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 shutdown_connections 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb66806aed0 0x7fb66806d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69015a530 0x7fb6900b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb690071260 0x7fb690151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 --2- 172.21.15.162:0/1959025632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb69006d7a0 0x7fb69009ae20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 >> 172.21.15.162:0/1959025632 conn(0x7fb6900b0cd0 msgr2=0x7fb6900cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 shutdown_connections 2024-01-20T11:08:06.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:06.781+0000 7fb695e00640 1 -- 172.21.15.162:0/1959025632 wait complete. 2024-01-20T11:08:06.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:06.802 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:07.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.007+0000 7f7fc8e00640 1 Processor -- start 2024-01-20T11:08:07.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.007+0000 7f7fc8e00640 1 -- start start 2024-01-20T11:08:07.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc8e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7fc40cdc30 0x7f7fc406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc8e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7fc406cc20 0x7f7fc40717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc8e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40cee70 con 0x7f7fc4141bb0 2024-01-20T11:08:07.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc8e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc406d0d0 con 0x7f7fc40cdc30 2024-01-20T11:08:07.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc8e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc40cd7a0 con 0x7f7fc406cc20 2024-01-20T11:08:07.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc1e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7fc4141bb0 0x7f7fc40ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48222/0 (socket says 172.21.15.162:48222) 2024-01-20T11:08:07.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc1e00640 1 -- 172.21.15.162:0/3945093507 learned_addr learned my addr 172.21.15.162:0/3945093507 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:07.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc1400640 1 --2- 172.21.15.162:0/3945093507 >> v2:172.21.15.162:3300/0 conn(0x7f7fc40cdc30 0x7f7fc406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.009+0000 7f7fc2800640 1 --2- 172.21.15.162:0/3945093507 >> v2:172.21.15.179:3300/0 conn(0x7f7fc406cc20 0x7f7fc40717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.010+0000 7f7fc0a00640 1 -- 172.21.15.162:0/3945093507 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347655065 0 0) 0x7f7fac001110 con 0x7f7fc4141bb0 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.010+0000 7f7fc0a00640 1 -- 172.21.15.162:0/3945093507 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa4003520 con 0x7f7fc4141bb0 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.010+0000 7f7fc1400640 1 -- 172.21.15.162:0/3945093507 >> v2:172.21.15.179:3300/0 conn(0x7f7fc406cc20 msgr2=0x7f7fc40717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.010+0000 7f7fc1400640 1 --2- 172.21.15.162:0/3945093507 >> v2:172.21.15.179:3300/0 conn(0x7f7fc406cc20 0x7f7fc40717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.010+0000 7f7fc1400640 1 -- 172.21.15.162:0/3945093507 >> v1:172.21.15.162:6789/0 conn(0x7f7fc4141bb0 legacy=0x7f7fc40ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.010+0000 7f7fc1400640 1 -- 172.21.15.162:0/3945093507 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40ceb90 con 0x7f7fc40cdc30 2024-01-20T11:08:07.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.010+0000 7f7fc2800640 1 --2- 172.21.15.162:0/3945093507 >> v2:172.21.15.179:3300/0 conn(0x7f7fc406cc20 0x7f7fc40717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:08:07.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.011+0000 7f7fc1400640 1 --2- 172.21.15.162:0/3945093507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40cdc30 0x7f7fc406c6e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4074280 tx=0x7f7fb402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43329503cee12909 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.011+0000 7f7fc0a00640 1 -- 172.21.15.162:0/3945093507 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb402e070 con 0x7f7fc40cdc30 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.011+0000 7f7fc0a00640 1 -- 172.21.15.162:0/3945093507 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb40315a0 con 0x7f7fc40cdc30 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.011+0000 7f7fc0a00640 1 -- 172.21.15.162:0/3945093507 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4031930 con 0x7f7fc40cdc30 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 -- 172.21.15.162:0/3945093507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40cdc30 msgr2=0x7f7fc406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/3945093507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40cdc30 0x7f7fc406c6e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4074280 tx=0x7f7fb402b840 comp rx=0 tx=0).stop 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 -- 172.21.15.162:0/3945093507 shutdown_connections 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/3945093507 >> v2:172.21.15.179:3300/0 conn(0x7f7fc406cc20 0x7f7fc40717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/3945093507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40cdc30 0x7f7fc406c6e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 -- 172.21.15.162:0/3945093507 >> 172.21.15.162:0/3945093507 conn(0x7f7fc406a600 msgr2=0x7f7fc406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 -- 172.21.15.162:0/3945093507 shutdown_connections 2024-01-20T11:08:07.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.012+0000 7f7fc8e00640 1 -- 172.21.15.162:0/3945093507 wait complete. 2024-01-20T11:08:07.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.014+0000 7f7fc8e00640 1 Processor -- start 2024-01-20T11:08:07.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.014+0000 7f7fc8e00640 1 -- start start 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc8e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fc406cc20 0x7f7fc41f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc8e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fc40cdc30 0x7f7fc4143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc4141bb0 0x7f7fc413aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41434f0 con 0x7f7fc4141bb0 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc8e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc413a790 con 0x7f7fc406cc20 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc8e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41f3410 con 0x7f7fc40cdc30 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc4141bb0 0x7f7fc413aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc4141bb0 0x7f7fc413aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:59998/0 (socket says 172.21.15.162:59998) 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc2800640 1 -- 172.21.15.162:0/289072840 learned_addr learned my addr 172.21.15.162:0/289072840 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.015+0000 7f7fc1e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fc406cc20 0x7f7fc41f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc1400640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fc40cdc30 0x7f7fc4143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc2800640 1 -- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fc40cdc30 msgr2=0x7f7fc4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc2800640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fc40cdc30 0x7f7fc4143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc2800640 1 -- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fc406cc20 msgr2=0x7f7fc41f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc2800640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fc406cc20 0x7f7fc41f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc2800640 1 -- 172.21.15.162:0/289072840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009400 con 0x7f7fc4141bb0 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc1400640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fc40cdc30 0x7f7fc4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc2800640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc4141bb0 0x7f7fc413aa00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc007df0 tx=0x7f7fbc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fba000640 1 -- 172.21.15.162:0/289072840 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc003990 con 0x7f7fc4141bb0 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fba000640 1 -- 172.21.15.162:0/289072840 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc00f040 con 0x7f7fc4141bb0 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fba000640 1 -- 172.21.15.162:0/289072840 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc003d30 con 0x7f7fc4141bb0 2024-01-20T11:08:07.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4143e50 con 0x7f7fc4141bb0 2024-01-20T11:08:07.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.016+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4142b50 con 0x7f7fc4141bb0 2024-01-20T11:08:07.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.018+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc4143630 con 0x7f7fc4141bb0 2024-01-20T11:08:07.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.018+0000 7f7fba000640 1 -- 172.21.15.162:0/289072840 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7fbc004030 con 0x7f7fc4141bb0 2024-01-20T11:08:07.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.020+0000 7f7fba000640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f9c06aed0 0x7f7f9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.020+0000 7f7fba000640 1 -- 172.21.15.162:0/289072840 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fbc089890 con 0x7f7fc4141bb0 2024-01-20T11:08:07.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.020+0000 7f7fc1e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f9c06aed0 0x7f7f9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.021+0000 7f7fc1e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f9c06aed0 0x7f7f9c06d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7fac005880 tx=0x7f7fac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.024+0000 7f7fba000640 1 -- 172.21.15.162:0/289072840 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7fc4143630 con 0x7f7fc4141bb0 2024-01-20T11:08:07.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.215+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fc4143630 con 0x7f7fc4141bb0 2024-01-20T11:08:07.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.216+0000 7f7fba000640 1 -- 172.21.15.162:0/289072840 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fc4143630 con 0x7f7fc4141bb0 2024-01-20T11:08:07.217 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:07.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.218+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f9c06aed0 msgr2=0x7f7f9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.218+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f9c06aed0 0x7f7f9c06d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7fac005880 tx=0x7f7fac009040 comp rx=0 tx=0).stop 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc4141bb0 msgr2=0x7f7fc413aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc4141bb0 0x7f7fc413aa00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc007df0 tx=0x7f7fbc00d4a0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 shutdown_connections 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc4141bb0 0x7f7fc413aa00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fc40cdc30 0x7f7fc4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f9c06aed0 0x7f7f9c06d390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 --2- 172.21.15.162:0/289072840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fc406cc20 0x7f7fc41f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 >> 172.21.15.162:0/289072840 conn(0x7f7fc406a600 msgr2=0x7f7fc40ade50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 shutdown_connections 2024-01-20T11:08:07.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.219+0000 7f7fc8e00640 1 -- 172.21.15.162:0/289072840 wait complete. 2024-01-20T11:08:07.238 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:07.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.434+0000 7f3851200640 1 Processor -- start 2024-01-20T11:08:07.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.435+0000 7f3851200640 1 -- start start 2024-01-20T11:08:07.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.436+0000 7f3851200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 0x7f384c0b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.436+0000 7f3851200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c0b6f30 con 0x7f384c0b91e0 2024-01-20T11:08:07.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.436+0000 7f3851200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c0b7210 con 0x7f384c15d750 2024-01-20T11:08:07.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.436+0000 7f3851200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c15db30 con 0x7f384c0b7fd0 2024-01-20T11:08:07.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.436+0000 7f3849400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f384c0b91e0 0x7f384c0d1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48236/0 (socket says 172.21.15.162:48236) 2024-01-20T11:08:07.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.436+0000 7f3849400640 1 -- 172.21.15.162:0/1817070436 learned_addr learned my addr 172.21.15.162:0/1817070436 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:07.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f384a800640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 0x7f384c0b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461820406 0 0) 0x7f384c0b6f30 con 0x7f384c0b91e0 2024-01-20T11:08:07.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f382c003520 con 0x7f384c0b91e0 2024-01-20T11:08:07.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 793639381 0 0) 0x7f382c003520 con 0x7f384c0b91e0 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 msgr2=0x7f384c0b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 0x7f384c0b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 >> v1:172.21.15.179:6789/0 conn(0x7f384c15d750 legacy=0x7f384c0b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0b74f0 con 0x7f384c0b91e0 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f3834001670 con 0x7f384c0b91e0 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 >> v1:172.21.15.162:6789/0 conn(0x7f384c0b91e0 legacy=0x7f384c0d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 0x7f382c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004020 0x7f382c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382c004d00 0x7f382c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c15db30 con 0x7f382c004d00 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c00bc50 con 0x7f382c004020 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.437+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c00be10 con 0x7f384c0b7fd0 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f384a800640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382c004d00 0x7f382c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f3849e00640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 0x7f382c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f3849400640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004020 0x7f382c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f384a800640 1 -- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 msgr2=0x7f382c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:07.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f384a800640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0b7fd0 0x7f382c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f384a800640 1 -- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004020 msgr2=0x7f382c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:07.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f384a800640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004020 0x7f382c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f384a800640 1 -- 172.21.15.162:0/1817070436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c003520 con 0x7f382c004d00 2024-01-20T11:08:07.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.438+0000 7f3849400640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004020 0x7f382c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:07.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.439+0000 7f384a800640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382c004d00 0x7f382c005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f384400ba30 tx=0x7f382c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fd71ea16917b20 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.439+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844032640 con 0x7f382c004d00 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.439+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38440327a0 con 0x7f382c004d00 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.439+0000 7f3848a00640 1 -- 172.21.15.162:0/1817070436 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844032b30 con 0x7f382c004d00 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.440+0000 7f3851200640 1 -- 172.21.15.162:0/1817070436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382c004d00 msgr2=0x7f382c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.440+0000 7f3851200640 1 --2- 172.21.15.162:0/1817070436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382c004d00 0x7f382c005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f384400ba30 tx=0x7f382c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.440+0000 7f384a800640 1 -- 172.21.15.162:0/1817070436 reap_dead start 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.440+0000 7f3851200640 1 -- 172.21.15.162:0/1817070436 shutdown_connections 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.440+0000 7f3851200640 1 -- 172.21.15.162:0/1817070436 >> 172.21.15.162:0/1817070436 conn(0x7f384c066760 msgr2=0x7f384c066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.440+0000 7f3851200640 1 -- 172.21.15.162:0/1817070436 shutdown_connections 2024-01-20T11:08:07.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.440+0000 7f3851200640 1 -- 172.21.15.162:0/1817070436 wait complete. 2024-01-20T11:08:07.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.442+0000 7f3851200640 1 Processor -- start 2024-01-20T11:08:07.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.442+0000 7f3851200640 1 -- start start 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3851200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004d00 0x7f384c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3851200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f384c0d1e70 0x7f384c0d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3851200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0cc8f0 0x7f384c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3851200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c15ec70 con 0x7f384c0d1e70 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3851200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0cb100 con 0x7f382c004d00 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3851200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0d29e0 con 0x7f384c0cc8f0 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3849400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f384c0d1e70 0x7f384c0d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3849400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f384c0d1e70 0x7f384c0d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60014/0 (socket says 172.21.15.162:60014) 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.443+0000 7f3849400640 1 -- 172.21.15.162:0/4199645337 learned_addr learned my addr 172.21.15.162:0/4199645337 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3849e00640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004d00 0x7f384c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f384a800640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0cc8f0 0x7f384c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3849400640 1 -- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0cc8f0 msgr2=0x7f384c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3849400640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0cc8f0 0x7f384c0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3849400640 1 -- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004d00 msgr2=0x7f384c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3849400640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004d00 0x7f384c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3849400640 1 -- 172.21.15.162:0/4199645337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0d2cc0 con 0x7f384c0d1e70 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3849400640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f384c0d1e70 0x7f384c0d22f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f383400d8b0 tx=0x7f383400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3842000640 1 -- 172.21.15.162:0/4199645337 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340074e0 con 0x7f384c0d1e70 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3842000640 1 -- 172.21.15.162:0/4199645337 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834007640 con 0x7f384c0d1e70 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3842000640 1 -- 172.21.15.162:0/4199645337 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340049e0 con 0x7f384c0d1e70 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.444+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c15e620 con 0x7f384c0d1e70 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.445+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c0cd2b0 con 0x7f384c0d1e70 2024-01-20T11:08:07.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.446+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c04e970 con 0x7f384c0d1e70 2024-01-20T11:08:07.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.447+0000 7f3842000640 1 -- 172.21.15.162:0/4199645337 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3834004b40 con 0x7f384c0d1e70 2024-01-20T11:08:07.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.447+0000 7f3842000640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f382406aed0 0x7f382406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.448+0000 7f3842000640 1 -- 172.21.15.162:0/4199645337 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3834089490 con 0x7f384c0d1e70 2024-01-20T11:08:07.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.448+0000 7f3849e00640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f382406aed0 0x7f382406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.448+0000 7f3849e00640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f382406aed0 0x7f382406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f383c007fd0 tx=0x7f383c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.452+0000 7f3842000640 1 -- 172.21.15.162:0/4199645337 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3834054350 con 0x7f384c0d1e70 2024-01-20T11:08:07.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.643+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f384c15edb0 con 0x7f384c0d1e70 2024-01-20T11:08:07.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.644+0000 7f3842000640 1 -- 172.21.15.162:0/4199645337 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3834057970 con 0x7f384c0d1e70 2024-01-20T11:08:07.646 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f382406aed0 msgr2=0x7f382406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f382406aed0 0x7f382406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f383c007fd0 tx=0x7f383c009040 comp rx=0 tx=0).stop 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f384c0d1e70 msgr2=0x7f384c0d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f384c0d1e70 0x7f384c0d22f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f383400d8b0 tx=0x7f383400dd70 comp rx=0 tx=0).stop 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 shutdown_connections 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f384c0cc8f0 0x7f384c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f384c0d1e70 0x7f384c0d22f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f382406aed0 0x7f382406d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.647+0000 7f3851200640 1 --2- 172.21.15.162:0/4199645337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f382c004d00 0x7f384c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.648+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 >> 172.21.15.162:0/4199645337 conn(0x7f384c066760 msgr2=0x7f384c0c7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.648+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 shutdown_connections 2024-01-20T11:08:07.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.648+0000 7f3851200640 1 -- 172.21.15.162:0/4199645337 wait complete. 2024-01-20T11:08:07.667 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:07.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.877+0000 7f9eb8a00640 1 Processor -- start 2024-01-20T11:08:07.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.877+0000 7f9eb8a00640 1 -- start start 2024-01-20T11:08:07.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb8a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb015dda0 0x7f9eb0070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb8a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb015e520 con 0x7f9eb00706c0 2024-01-20T11:08:07.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb8a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb015e800 con 0x7f9eb01618c0 2024-01-20T11:08:07.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb8a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb015edc0 con 0x7f9eb015dda0 2024-01-20T11:08:07.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb6a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9eb00706c0 0x7f9eb006f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48250/0 (socket says 172.21.15.162:48250) 2024-01-20T11:08:07.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb6a00640 1 -- 172.21.15.162:0/294794405 learned_addr learned my addr 172.21.15.162:0/294794405 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb5600640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb015dda0 0x7f9eb0070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898622889 0 0) 0x7f9eb015e520 con 0x7f9eb00706c0 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e90003520 con 0x7f9eb00706c0 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1895506532 0 0) 0x7f9e90003520 con 0x7f9eb00706c0 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb015dda0 msgr2=0x7f9eb0070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb015dda0 0x7f9eb0070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 >> v1:172.21.15.179:6789/0 conn(0x7f9eb01618c0 legacy=0x7f9eb0161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb015eae0 con 0x7f9eb00706c0 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f9ea80019f0 con 0x7f9eb00706c0 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 >> v1:172.21.15.162:6789/0 conn(0x7f9eb00706c0 legacy=0x7f9eb006f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900039a0 0x7f9e90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e900047c0 0x7f9e90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb015dda0 0x7f9e90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb015edc0 con 0x7f9e900047c0 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9000ba90 con 0x7f9e900039a0 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9000bc50 con 0x7f9eb015dda0 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.880+0000 7f9eb5600640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e900047c0 0x7f9e90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.881+0000 7f9eb6000640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900039a0 0x7f9e90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.881+0000 7f9eb5600640 1 -- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb015dda0 msgr2=0x7f9e90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.881+0000 7f9eb5600640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb015dda0 0x7f9e90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.881+0000 7f9eb5600640 1 -- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900039a0 msgr2=0x7f9e90003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.881+0000 7f9eb5600640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900039a0 0x7f9e90003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.881+0000 7f9eb5600640 1 -- 172.21.15.162:0/294794405 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90003520 con 0x7f9e900047c0 2024-01-20T11:08:07.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.882+0000 7f9eb5600640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e900047c0 0x7f9e90004c40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009a90 tx=0x7f9e900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95a7eb6e3031137 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.882+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9802c6b0 con 0x7f9e900047c0 2024-01-20T11:08:07.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.882+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9802c810 con 0x7f9e900047c0 2024-01-20T11:08:07.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.882+0000 7f9eb4c00640 1 -- 172.21.15.162:0/294794405 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9802cba0 con 0x7f9e900047c0 2024-01-20T11:08:07.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.883+0000 7f9eb8a00640 1 -- 172.21.15.162:0/294794405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e900047c0 msgr2=0x7f9e90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.883+0000 7f9eb8a00640 1 --2- 172.21.15.162:0/294794405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e900047c0 0x7f9e90004c40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009a90 tx=0x7f9e900057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.883+0000 7f9eb6a00640 1 -- 172.21.15.162:0/294794405 reap_dead start 2024-01-20T11:08:07.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.883+0000 7f9eb8a00640 1 -- 172.21.15.162:0/294794405 shutdown_connections 2024-01-20T11:08:07.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.883+0000 7f9eb8a00640 1 -- 172.21.15.162:0/294794405 >> 172.21.15.162:0/294794405 conn(0x7f9eb00d1230 msgr2=0x7f9eb00d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:07.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.883+0000 7f9eb8a00640 1 -- 172.21.15.162:0/294794405 shutdown_connections 2024-01-20T11:08:07.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.883+0000 7f9eb8a00640 1 -- 172.21.15.162:0/294794405 wait complete. 2024-01-20T11:08:07.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.885+0000 7f9eb8a00640 1 Processor -- start 2024-01-20T11:08:07.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.885+0000 7f9eb8a00640 1 -- start start 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb8a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900047c0 0x7f9eb00aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb8a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00af150 0x7f9eb00c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015b200 0x7f9eb00c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00af5f0 con 0x7f9eb015b200 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb8a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00af8d0 con 0x7f9e900047c0 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb8a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00afbb0 con 0x7f9eb00af150 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015b200 0x7f9eb00c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015b200 0x7f9eb00c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60024/0 (socket says 172.21.15.162:60024) 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb6a00640 1 -- 172.21.15.162:0/1750768027 learned_addr learned my addr 172.21.15.162:0/1750768027 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:07.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb6000640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900047c0 0x7f9eb00aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.886+0000 7f9eb6a00640 1 -- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00af150 msgr2=0x7f9eb00c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb6a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00af150 0x7f9eb00c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb6a00640 1 -- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900047c0 msgr2=0x7f9eb00aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb6a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900047c0 0x7f9eb00aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb6a00640 1 -- 172.21.15.162:0/1750768027 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00afe90 con 0x7f9eb015b200 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb6000640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900047c0 0x7f9eb00aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb6a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015b200 0x7f9eb00c7090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00743b0 tx=0x7f9ea800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eae000640 1 -- 172.21.15.162:0/1750768027 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800a610 con 0x7f9eb015b200 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eae000640 1 -- 172.21.15.162:0/1750768027 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea800a7b0 con 0x7f9eb015b200 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eae000640 1 -- 172.21.15.162:0/1750768027 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800ab60 con 0x7f9eb015b200 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb00b0170 con 0x7f9eb015b200 2024-01-20T11:08:07.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.887+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb00ae6b0 con 0x7f9eb015b200 2024-01-20T11:08:07.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.888+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb0067b70 con 0x7f9eb015b200 2024-01-20T11:08:07.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.889+0000 7f9eae000640 1 -- 172.21.15.162:0/1750768027 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9ea800acc0 con 0x7f9eb015b200 2024-01-20T11:08:07.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.890+0000 7f9eae000640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9e8806af00 0x7f9e8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:07.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.890+0000 7f9eae000640 1 -- 172.21.15.162:0/1750768027 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ea8088bf0 con 0x7f9eb015b200 2024-01-20T11:08:07.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.890+0000 7f9eb6000640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9e8806af00 0x7f9e8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:07.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.891+0000 7f9eb6000640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9e8806af00 0x7f9e8806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00016b0 tx=0x7f9ea0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:07.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:07.895+0000 7f9eae000640 1 -- 172.21.15.162:0/1750768027 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9ea8053a20 con 0x7f9eb015b200 2024-01-20T11:08:08.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.087+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9eb00b0360 con 0x7f9eb015b200 2024-01-20T11:08:08.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.088+0000 7f9eae000640 1 -- 172.21.15.162:0/1750768027 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ea8057040 con 0x7f9eb015b200 2024-01-20T11:08:08.090 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:08.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9e8806af00 msgr2=0x7f9e8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9e8806af00 0x7f9e8806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00016b0 tx=0x7f9ea0009040 comp rx=0 tx=0).stop 2024-01-20T11:08:08.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015b200 msgr2=0x7f9eb00c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015b200 0x7f9eb00c7090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00743b0 tx=0x7f9ea800ccd0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 shutdown_connections 2024-01-20T11:08:08.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eb015b200 0x7f9eb00c7090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00af150 0x7f9eb00c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9e8806af00 0x7f9e8806d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 --2- 172.21.15.162:0/1750768027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e900047c0 0x7f9eb00aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.091+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 >> 172.21.15.162:0/1750768027 conn(0x7f9eb00d1230 msgr2=0x7f9eb00c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:08.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.092+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 shutdown_connections 2024-01-20T11:08:08.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.092+0000 7f9eb8a00640 1 -- 172.21.15.162:0/1750768027 wait complete. 2024-01-20T11:08:08.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:08.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.308+0000 7fe2f8200640 1 Processor -- start 2024-01-20T11:08:08.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.308+0000 7fe2f8200640 1 -- start start 2024-01-20T11:08:08.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f8200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 0x7fe2f015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f8200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f006cfe0 con 0x7fe2f006cb80 2024-01-20T11:08:08.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f8200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f00b51a0 con 0x7fe2f0147000 2024-01-20T11:08:08.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f8200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f006bae0 con 0x7fe2f00b3940 2024-01-20T11:08:08.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f4e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe2f006cb80 0x7fe2f00b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48254/0 (socket says 172.21.15.162:48254) 2024-01-20T11:08:08.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f4e00640 1 -- 172.21.15.162:0/1301461665 learned_addr learned my addr 172.21.15.162:0/1301461665 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:08.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863892109 0 0) 0x7fe2f006cfe0 con 0x7fe2f006cb80 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f6200640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 0x7fe2f015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d0003520 con 0x7fe2f006cb80 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2996794474 0 0) 0x7fe2d0003520 con 0x7fe2f006cb80 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 msgr2=0x7fe2f015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 0x7fe2f015ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 >> v1:172.21.15.179:6789/0 conn(0x7fe2f0147000 legacy=0x7fe2f00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f006bdc0 con 0x7fe2f006cb80 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fe2d8001670 con 0x7fe2f006cb80 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 >> v1:172.21.15.162:6789/0 conn(0x7fe2f006cb80 legacy=0x7fe2f00b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 0x7fe2d00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d0004020 0x7fe2d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2d0004d00 0x7fe2d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f006bae0 con 0x7fe2d0004d00 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d000bbc0 con 0x7fe2d0004020 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d000bd80 con 0x7fe2f00b3940 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.310+0000 7fe2f6200640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2d0004d00 0x7fe2d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.311+0000 7fe2f4e00640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d0004020 0x7fe2d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.311+0000 7fe2f5800640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 0x7fe2d00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.311+0000 7fe2f6200640 1 -- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 msgr2=0x7fe2d00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.311+0000 7fe2f6200640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f00b3940 0x7fe2d00039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.311+0000 7fe2f6200640 1 -- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d0004020 msgr2=0x7fe2d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.311+0000 7fe2f6200640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d0004020 0x7fe2d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.311+0000 7fe2f6200640 1 -- 172.21.15.162:0/1301461665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0003520 con 0x7fe2d0004d00 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.312+0000 7fe2f6200640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2d0004d00 0x7fe2d0005180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8007330 tx=0x7fe2d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7041a5d00b10565 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.312+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e802cca0 con 0x7fe2d0004d00 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.312+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e802ce00 con 0x7fe2d0004d00 2024-01-20T11:08:08.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.312+0000 7fe2efe00640 1 -- 172.21.15.162:0/1301461665 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8034660 con 0x7fe2d0004d00 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.313+0000 7fe2f8200640 1 -- 172.21.15.162:0/1301461665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2d0004d00 msgr2=0x7fe2d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.313+0000 7fe2f8200640 1 --2- 172.21.15.162:0/1301461665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2d0004d00 0x7fe2d0005180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8007330 tx=0x7fe2d00057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.313+0000 7fe2f6200640 1 -- 172.21.15.162:0/1301461665 reap_dead start 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.313+0000 7fe2f8200640 1 -- 172.21.15.162:0/1301461665 shutdown_connections 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.313+0000 7fe2f8200640 1 -- 172.21.15.162:0/1301461665 >> 172.21.15.162:0/1301461665 conn(0x7fe2f0066550 msgr2=0x7fe2f0066960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.313+0000 7fe2f8200640 1 -- 172.21.15.162:0/1301461665 shutdown_connections 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.313+0000 7fe2f8200640 1 -- 172.21.15.162:0/1301461665 wait complete. 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.315+0000 7fe2f8200640 1 Processor -- start 2024-01-20T11:08:08.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.315+0000 7fe2f8200640 1 -- start start 2024-01-20T11:08:08.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f8200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2f013dc70 0x7fe2f013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f8200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f013e050 0x7fe2f013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f8200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2f0141570 0x7fe2f0141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f8200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00cd310 con 0x7fe2f0141570 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f8200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00cd5f0 con 0x7fe2f013dc70 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f8200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00cd8d0 con 0x7fe2f013e050 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2f0141570 0x7fe2f0141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2f0141570 0x7fe2f0141a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60048/0 (socket says 172.21.15.162:60048) 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 -- 172.21.15.162:0/323746426 learned_addr learned my addr 172.21.15.162:0/323746426 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f5800640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2f013dc70 0x7fe2f013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 -- 172.21.15.162:0/323746426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f013e050 msgr2=0x7fe2f013f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f013e050 0x7fe2f013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 -- 172.21.15.162:0/323746426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2f013dc70 msgr2=0x7fe2f013f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2f013dc70 0x7fe2f013f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.316+0000 7fe2f6200640 1 -- 172.21.15.162:0/323746426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00cdbb0 con 0x7fe2f0141570 2024-01-20T11:08:08.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.317+0000 7fe2f6200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2f0141570 0x7fe2f0141a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8037040 tx=0x7fe2e8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:08.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.317+0000 7fe2ed600640 1 -- 172.21.15.162:0/323746426 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e803e600 con 0x7fe2f0141570 2024-01-20T11:08:08.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.317+0000 7fe2ed600640 1 -- 172.21.15.162:0/323746426 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e803e780 con 0x7fe2f0141570 2024-01-20T11:08:08.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.317+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f00cde90 con 0x7fe2f0141570 2024-01-20T11:08:08.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.317+0000 7fe2ed600640 1 -- 172.21.15.162:0/323746426 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e803eb30 con 0x7fe2f0141570 2024-01-20T11:08:08.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.317+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f00cf850 con 0x7fe2f0141570 2024-01-20T11:08:08.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.318+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f004e970 con 0x7fe2f0141570 2024-01-20T11:08:08.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.319+0000 7fe2ed600640 1 -- 172.21.15.162:0/323746426 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe2e803ec90 con 0x7fe2f0141570 2024-01-20T11:08:08.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.320+0000 7fe2ed600640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe2c806af00 0x7fe2c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.320+0000 7fe2ed600640 1 -- 172.21.15.162:0/323746426 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2e80ab7d0 con 0x7fe2f0141570 2024-01-20T11:08:08.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.320+0000 7fe2f5800640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe2c806af00 0x7fe2c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.321+0000 7fe2f5800640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe2c806af00 0x7fe2c806d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00b2d20 tx=0x7fe2e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:08.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.325+0000 7fe2ed600640 1 -- 172.21.15.162:0/323746426 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe2e8076690 con 0x7fe2f0141570 2024-01-20T11:08:08.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.518+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2f00b2790 con 0x7fe2f0141570 2024-01-20T11:08:08.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.520+0000 7fe2ed600640 1 -- 172.21.15.162:0/323746426 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fe2e8039090 con 0x7fe2f0141570 2024-01-20T11:08:08.522 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:08.522 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:08.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.522+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe2c806af00 msgr2=0x7fe2c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.522+0000 7fe2f8200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe2c806af00 0x7fe2c806d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00b2d20 tx=0x7fe2e0009040 comp rx=0 tx=0).stop 2024-01-20T11:08:08.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.522+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2f0141570 msgr2=0x7fe2f0141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.522+0000 7fe2f8200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2f0141570 0x7fe2f0141a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8037040 tx=0x7fe2e8004ab0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.522+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 shutdown_connections 2024-01-20T11:08:08.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.523+0000 7fe2f8200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2f0141570 0x7fe2f0141a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.523+0000 7fe2f8200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2f013e050 0x7fe2f013f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.523+0000 7fe2f8200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe2c806af00 0x7fe2c806d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.523+0000 7fe2f8200640 1 --2- 172.21.15.162:0/323746426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2f013dc70 0x7fe2f013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.523+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 >> 172.21.15.162:0/323746426 conn(0x7fe2f0066550 msgr2=0x7fe2f00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:08.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.523+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 shutdown_connections 2024-01-20T11:08:08.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.523+0000 7fe2f8200640 1 -- 172.21.15.162:0/323746426 wait complete. 2024-01-20T11:08:08.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:08.543 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.746+0000 7f8102a00640 1 Processor -- start 2024-01-20T11:08:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.746+0000 7f8102a00640 1 -- start start 2024-01-20T11:08:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f8102a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f80fc160d10 0x7f80fc0b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f8102a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80fc0b4f80 0x7f80fc0b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f8102a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80fc0d16e0 con 0x7f80fc0ca110 2024-01-20T11:08:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f8102a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc0b5950 con 0x7f80fc160d10 2024-01-20T11:08:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f8102a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc0d19c0 con 0x7f80fc0b4f80 2024-01-20T11:08:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f80fbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f80fc160d10 0x7f80fc0b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f80f3e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f80fc0ca110 0x7f80fc06b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48256/0 (socket says 172.21.15.162:48256) 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.748+0000 7f80f3e00640 1 -- 172.21.15.162:0/1393292407 learned_addr learned my addr 172.21.15.162:0/1393292407 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.749+0000 7f8100a00640 1 --2- 172.21.15.162:0/1393292407 >> v2:172.21.15.179:3300/0 conn(0x7f80fc0b4f80 0x7f80fc0b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.749+0000 7f80fbe00640 1 -- 172.21.15.162:0/1393292407 >> v2:172.21.15.179:3300/0 conn(0x7f80fc0b4f80 msgr2=0x7f80fc0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.749+0000 7f80fbe00640 1 --2- 172.21.15.162:0/1393292407 >> v2:172.21.15.179:3300/0 conn(0x7f80fc0b4f80 0x7f80fc0b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.749+0000 7f80fbe00640 1 -- 172.21.15.162:0/1393292407 >> v1:172.21.15.162:6789/0 conn(0x7f80fc0ca110 legacy=0x7f80fc06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.749+0000 7f80fbe00640 1 -- 172.21.15.162:0/1393292407 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0d1ca0 con 0x7f80fc160d10 2024-01-20T11:08:08.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.749+0000 7f80fb400640 1 -- 172.21.15.162:0/1393292407 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927535681 0 0) 0x7f80fc0d16e0 con 0x7f80fc0ca110 2024-01-20T11:08:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.750+0000 7f80fbe00640 1 --2- 172.21.15.162:0/1393292407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc160d10 0x7f80fc0b29d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0d42c0 tx=0x7f80ec02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124e65b368b6a21 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.750+0000 7f80fb400640 1 -- 172.21.15.162:0/1393292407 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec030610 con 0x7f80fc160d10 2024-01-20T11:08:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.750+0000 7f80fb400640 1 -- 172.21.15.162:0/1393292407 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec030770 con 0x7f80fc160d10 2024-01-20T11:08:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.750+0000 7f80fb400640 1 -- 172.21.15.162:0/1393292407 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec030b00 con 0x7f80fc160d10 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 -- 172.21.15.162:0/1393292407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc160d10 msgr2=0x7f80fc0b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 --2- 172.21.15.162:0/1393292407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc160d10 0x7f80fc0b29d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0d42c0 tx=0x7f80ec02b960 comp rx=0 tx=0).stop 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 -- 172.21.15.162:0/1393292407 shutdown_connections 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 --2- 172.21.15.162:0/1393292407 >> v2:172.21.15.179:3300/0 conn(0x7f80fc0b4f80 0x7f80fc0b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 --2- 172.21.15.162:0/1393292407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc160d10 0x7f80fc0b29d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 -- 172.21.15.162:0/1393292407 >> 172.21.15.162:0/1393292407 conn(0x7f80fc09c7b0 msgr2=0x7f80fc0d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 -- 172.21.15.162:0/1393292407 shutdown_connections 2024-01-20T11:08:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.751+0000 7f8102a00640 1 -- 172.21.15.162:0/1393292407 wait complete. 2024-01-20T11:08:08.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.753+0000 7f8102a00640 1 Processor -- start 2024-01-20T11:08:08.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.753+0000 7f8102a00640 1 -- start start 2024-01-20T11:08:08.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f8102a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80fc0b4f80 0x7f80fc1f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f8102a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0ca110 0x7f80fc15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f8102a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80fc160d10 0x7f80fc15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f8102a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1f3440 con 0x7f80fc0ca110 2024-01-20T11:08:08.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f8102a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1f3720 con 0x7f80fc160d10 2024-01-20T11:08:08.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f8102a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1f3a00 con 0x7f80fc0b4f80 2024-01-20T11:08:08.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0ca110 0x7f80fc15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0ca110 0x7f80fc15eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60068/0 (socket says 172.21.15.162:60068) 2024-01-20T11:08:08.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 -- 172.21.15.162:0/2418067410 learned_addr learned my addr 172.21.15.162:0/2418067410 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80fbe00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80fc0b4f80 0x7f80fc1f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 -- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80fc0b4f80 msgr2=0x7f80fc1f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f8100a00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80fc160d10 0x7f80fc15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80fc0b4f80 0x7f80fc1f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 -- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80fc160d10 msgr2=0x7f80fc15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80fc160d10 0x7f80fc15f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.755+0000 7f80f3e00640 1 -- 172.21.15.162:0/2418067410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec009400 con 0x7f80fc0ca110 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.756+0000 7f80f3e00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0ca110 0x7f80fc15eaf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f80e400c4d0 tx=0x7f80e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.756+0000 7f80f8c00640 1 -- 172.21.15.162:0/2418067410 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e40074e0 con 0x7f80fc0ca110 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.756+0000 7f80f8c00640 1 -- 172.21.15.162:0/2418067410 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e4007660 con 0x7f80fc0ca110 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.756+0000 7f80f8c00640 1 -- 172.21.15.162:0/2418067410 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4004a20 con 0x7f80fc0ca110 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.756+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc1f3ce0 con 0x7f80fc0ca110 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.756+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc1f44b0 con 0x7f80fc0ca110 2024-01-20T11:08:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.757+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc1f4200 con 0x7f80fc0ca110 2024-01-20T11:08:08.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.758+0000 7f80f8c00640 1 -- 172.21.15.162:0/2418067410 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f80e4004b80 con 0x7f80fc0ca110 2024-01-20T11:08:08.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.759+0000 7f80f8c00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f80d406aed0 0x7f80d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:08.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.759+0000 7f80f8c00640 1 -- 172.21.15.162:0/2418067410 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80e4088820 con 0x7f80fc0ca110 2024-01-20T11:08:08.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.760+0000 7f80fbe00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f80d406aed0 0x7f80d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:08.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.760+0000 7f80fbe00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f80d406aed0 0x7f80d406d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f80ec036000 tx=0x7f80ec03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:08.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.764+0000 7f80f8c00640 1 -- 172.21.15.162:0/2418067410 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f80e40536f0 con 0x7f80fc0ca110 2024-01-20T11:08:08.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.958+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80fc1f3e70 con 0x7f80fc0ca110 2024-01-20T11:08:08.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.959+0000 7f80f8c00640 1 -- 172.21.15.162:0/2418067410 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80e4018020 con 0x7f80fc0ca110 2024-01-20T11:08:08.959 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f80d406aed0 msgr2=0x7f80d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f80d406aed0 0x7f80d406d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f80ec036000 tx=0x7f80ec03b040 comp rx=0 tx=0).stop 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0ca110 msgr2=0x7f80fc15eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0ca110 0x7f80fc15eaf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f80e400c4d0 tx=0x7f80e400c990 comp rx=0 tx=0).stop 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 shutdown_connections 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f80d406aed0 0x7f80d406d390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80fc160d10 0x7f80fc15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80fc0ca110 0x7f80fc15eaf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 --2- 172.21.15.162:0/2418067410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80fc0b4f80 0x7f80fc1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:08.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 >> 172.21.15.162:0/2418067410 conn(0x7f80fc09c7b0 msgr2=0x7f80fc15fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:08.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 shutdown_connections 2024-01-20T11:08:08.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:08.962+0000 7f8102a00640 1 -- 172.21.15.162:0/2418067410 wait complete. 2024-01-20T11:08:08.979 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:09.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.184+0000 7fcaaf000640 1 Processor -- start 2024-01-20T11:08:09.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.184+0000 7fcaaf000640 1 -- start start 2024-01-20T11:08:09.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaaf000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcaa815a320 0x7fcaa815b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaaf000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa80b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaaf000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa8071260 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaaf000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa80b4420 con 0x7fcaa815a320 2024-01-20T11:08:09.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaaf000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80709f0 con 0x7fcaa815e930 2024-01-20T11:08:09.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaa7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcaa815a320 0x7fcaa815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:09.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaad000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcaa80b3fb0 0x7fcaa80cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48258/0 (socket says 172.21.15.162:48258) 2024-01-20T11:08:09.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaad000640 1 -- 172.21.15.162:0/712869969 learned_addr learned my addr 172.21.15.162:0/712869969 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:09.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fca9f200640 1 --2- 172.21.15.162:0/712869969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa80b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:09.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaa7e00640 1 -- 172.21.15.162:0/712869969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 msgr2=0x7fcaa80b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:09.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaa7e00640 1 --2- 172.21.15.162:0/712869969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa80b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaa7e00640 1 -- 172.21.15.162:0/712869969 >> v1:172.21.15.162:6789/0 conn(0x7fcaa80b3fb0 legacy=0x7fcaa80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.186+0000 7fcaa7e00640 1 -- 172.21.15.162:0/712869969 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8070cd0 con 0x7fcaa815a320 2024-01-20T11:08:09.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.187+0000 7fca9f200640 1 --2- 172.21.15.162:0/712869969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa80b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:09.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.188+0000 7fcaa7e00640 1 --2- 172.21.15.162:0/712869969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa815a320 0x7fcaa815b520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca980097a0 tx=0x7fca9802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92566aed85b4d2cd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.188+0000 7fcaa7400640 1 -- 172.21.15.162:0/712869969 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9802d040 con 0x7fcaa815a320 2024-01-20T11:08:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.188+0000 7fcaa7400640 1 -- 172.21.15.162:0/712869969 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98031810 con 0x7fcaa815a320 2024-01-20T11:08:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.188+0000 7fcaa7400640 1 -- 172.21.15.162:0/712869969 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98031ba0 con 0x7fcaa815a320 2024-01-20T11:08:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.188+0000 7fcaaf000640 1 -- 172.21.15.162:0/712869969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa815a320 msgr2=0x7fcaa815b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.188+0000 7fcaaf000640 1 --2- 172.21.15.162:0/712869969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa815a320 0x7fcaa815b520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca980097a0 tx=0x7fca9802b8b0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.189+0000 7fcaaf000640 1 -- 172.21.15.162:0/712869969 shutdown_connections 2024-01-20T11:08:09.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.189+0000 7fcaaf000640 1 --2- 172.21.15.162:0/712869969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa80b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.189+0000 7fcaaf000640 1 --2- 172.21.15.162:0/712869969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa815a320 0x7fcaa815b520 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.189+0000 7fcaaf000640 1 -- 172.21.15.162:0/712869969 >> 172.21.15.162:0/712869969 conn(0x7fcaa806a600 msgr2=0x7fcaa806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:09.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.189+0000 7fcaaf000640 1 -- 172.21.15.162:0/712869969 shutdown_connections 2024-01-20T11:08:09.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.189+0000 7fcaaf000640 1 -- 172.21.15.162:0/712869969 wait complete. 2024-01-20T11:08:09.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.191+0000 7fcaaf000640 1 Processor -- start 2024-01-20T11:08:09.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.191+0000 7fcaaf000640 1 -- start start 2024-01-20T11:08:09.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.192+0000 7fcaaf000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa80b3fb0 0x7fcaa8143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.192+0000 7fcaaf000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815a320 0x7fcaa81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.192+0000 7fcaaf000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa8158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.192+0000 7fcaaf000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8152540 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.192+0000 7fcaaf000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8143f90 con 0x7fcaa815a320 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.192+0000 7fcaaf000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8151ca0 con 0x7fcaa815e930 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.192+0000 7fcaa7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa80b3fb0 0x7fcaa8143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa80b3fb0 0x7fcaa8143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60086/0 (socket says 172.21.15.162:60086) 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 -- 172.21.15.162:0/1689079994 learned_addr learned my addr 172.21.15.162:0/1689079994 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 -- 172.21.15.162:0/1689079994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 msgr2=0x7fcaa8158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa8158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 -- 172.21.15.162:0/1689079994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815a320 msgr2=0x7fcaa81513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815a320 0x7fcaa81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 -- 172.21.15.162:0/1689079994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98009400 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa7e00640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa80b3fb0 0x7fcaa8143a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca980098c0 tx=0x7fca980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:09.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa4c00640 1 -- 172.21.15.162:0/1689079994 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9803ad60 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa4c00640 1 -- 172.21.15.162:0/1689079994 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98044400 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.193+0000 7fcaa4c00640 1 -- 172.21.15.162:0/1689079994 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980447b0 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.194+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa8151f80 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.194+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa8156170 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.195+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa8155fd0 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.196+0000 7fcaa4c00640 1 -- 172.21.15.162:0/1689079994 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fca9804d440 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.196+0000 7fcaa4c00640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fca8006aed0 0x7fca8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.196+0000 7fcaa4c00640 1 -- 172.21.15.162:0/1689079994 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca980abb60 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.197+0000 7fca9f200640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fca8006aed0 0x7fca8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:09.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.197+0000 7fca9f200640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fca8006aed0 0x7fca8006d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:09.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.201+0000 7fcaa4c00640 1 -- 172.21.15.162:0/1689079994 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcaa8155fd0 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.394+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcaa8155fd0 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.395+0000 7fcaa4c00640 1 -- 172.21.15.162:0/1689079994 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcaa8155fd0 con 0x7fcaa80b3fb0 2024-01-20T11:08:09.396 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fca8006aed0 msgr2=0x7fca8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fca8006aed0 0x7fca8006d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90008040 comp rx=0 tx=0).stop 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa80b3fb0 msgr2=0x7fcaa8143a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa80b3fb0 0x7fcaa8143a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca980098c0 tx=0x7fca980046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 shutdown_connections 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa815e930 0x7fcaa8158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fca8006aed0 0x7fca8006d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815a320 0x7fcaa81513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 --2- 172.21.15.162:0/1689079994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaa80b3fb0 0x7fcaa8143a50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 >> 172.21.15.162:0/1689079994 conn(0x7fcaa806a600 msgr2=0x7fcaa8073670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 shutdown_connections 2024-01-20T11:08:09.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.398+0000 7fcaaf000640 1 -- 172.21.15.162:0/1689079994 wait complete. 2024-01-20T11:08:09.417 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:09.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.624+0000 7f36aee00640 1 Processor -- start 2024-01-20T11:08:09.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.624+0000 7f36aee00640 1 -- start start 2024-01-20T11:08:09.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.625+0000 7f36aee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36a8141bb0 0x7f36a80ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.625+0000 7f36aee00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f36a80ce6a0 0x7f36a806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.625+0000 7f36aee00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a80cdc30 0x7f36a806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.625+0000 7f36aee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80cee70 con 0x7f36a8141bb0 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.625+0000 7f36aee00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80cd7a0 con 0x7f36a80ce6a0 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.625+0000 7f36aee00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80ceb90 con 0x7f36a80cdc30 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36a8141bb0 0x7f36a80ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36a8141bb0 0x7f36a80ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60092/0 (socket says 172.21.15.162:60092) 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 -- 172.21.15.162:0/2855736148 learned_addr learned my addr 172.21.15.162:0/2855736148 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 -- 172.21.15.162:0/2855736148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a80cdc30 msgr2=0x7f36a806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 --2- 172.21.15.162:0/2855736148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a80cdc30 0x7f36a806cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 -- 172.21.15.162:0/2855736148 >> v2:172.21.15.179:3300/0 conn(0x7f36a80ce6a0 msgr2=0x7f36a806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 --2- 172.21.15.162:0/2855736148 >> v2:172.21.15.179:3300/0 conn(0x7f36a80ce6a0 0x7f36a806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.626+0000 7f36a7e00640 1 -- 172.21.15.162:0/2855736148 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80cd150 con 0x7f36a8141bb0 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.627+0000 7f36a7e00640 1 --2- 172.21.15.162:0/2855736148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a8141bb0 0x7f36a80ce160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f36a806e8c0 tx=0x7f369802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f483d486273fc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.627+0000 7f36a6a00640 1 -- 172.21.15.162:0/2855736148 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980317e0 con 0x7f36a8141bb0 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.627+0000 7f36a6a00640 1 -- 172.21.15.162:0/2855736148 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3698031940 con 0x7f36a8141bb0 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.627+0000 7f36a6a00640 1 -- 172.21.15.162:0/2855736148 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698031cd0 con 0x7f36a8141bb0 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 -- 172.21.15.162:0/2855736148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a8141bb0 msgr2=0x7f36a80ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 --2- 172.21.15.162:0/2855736148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a8141bb0 0x7f36a80ce160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f36a806e8c0 tx=0x7f369802b880 comp rx=0 tx=0).stop 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 -- 172.21.15.162:0/2855736148 shutdown_connections 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 --2- 172.21.15.162:0/2855736148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a80cdc30 0x7f36a806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 --2- 172.21.15.162:0/2855736148 >> v2:172.21.15.179:3300/0 conn(0x7f36a80ce6a0 0x7f36a806c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 --2- 172.21.15.162:0/2855736148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a8141bb0 0x7f36a80ce160 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 -- 172.21.15.162:0/2855736148 >> 172.21.15.162:0/2855736148 conn(0x7f36a806a600 msgr2=0x7f36a806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:09.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 -- 172.21.15.162:0/2855736148 shutdown_connections 2024-01-20T11:08:09.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.628+0000 7f36aee00640 1 -- 172.21.15.162:0/2855736148 wait complete. 2024-01-20T11:08:09.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.630+0000 7f36aee00640 1 Processor -- start 2024-01-20T11:08:09.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.630+0000 7f36aee00640 1 -- start start 2024-01-20T11:08:09.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36aee00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a80cdc30 0x7f36a81355e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36aee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a80ce6a0 0x7f36a81332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36aee00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a8141bb0 0x7f36a815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36aee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8133da0 con 0x7f36a80ce6a0 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36aee00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8134080 con 0x7f36a80cdc30 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36aee00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8134360 con 0x7f36a8141bb0 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a80ce6a0 0x7f36a81332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a80ce6a0 0x7f36a81332e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60106/0 (socket says 172.21.15.162:60106) 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 -- 172.21.15.162:0/4180564679 learned_addr learned my addr 172.21.15.162:0/4180564679 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 -- 172.21.15.162:0/4180564679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a8141bb0 msgr2=0x7f36a815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a8141bb0 0x7f36a815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 -- 172.21.15.162:0/4180564679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a80cdc30 msgr2=0x7f36a81355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a80cdc30 0x7f36a81355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.631+0000 7f36a7400640 1 -- 172.21.15.162:0/4180564679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36980094d0 con 0x7f36a80ce6a0 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.632+0000 7f36a7400640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a80ce6a0 0x7f36a81332e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f369000b410 tx=0x7f369000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.632+0000 7f369fe00640 1 -- 172.21.15.162:0/4180564679 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690011830 con 0x7f36a80ce6a0 2024-01-20T11:08:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.632+0000 7f369fe00640 1 -- 172.21.15.162:0/4180564679 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36900119b0 con 0x7f36a80ce6a0 2024-01-20T11:08:09.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.632+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a8134640 con 0x7f36a80ce6a0 2024-01-20T11:08:09.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.632+0000 7f369fe00640 1 -- 172.21.15.162:0/4180564679 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690011d60 con 0x7f36a80ce6a0 2024-01-20T11:08:09.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.632+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a8140aa0 con 0x7f36a80ce6a0 2024-01-20T11:08:09.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.633+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8134b60 con 0x7f36a80ce6a0 2024-01-20T11:08:09.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.634+0000 7f369fe00640 1 -- 172.21.15.162:0/4180564679 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f369001a400 con 0x7f36a80ce6a0 2024-01-20T11:08:09.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.635+0000 7f369fe00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f368006af00 0x7f368006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:09.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.635+0000 7f369fe00640 1 -- 172.21.15.162:0/4180564679 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3690089820 con 0x7f36a80ce6a0 2024-01-20T11:08:09.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.635+0000 7f36a7e00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f368006af00 0x7f368006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:09.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.636+0000 7f36a7e00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f368006af00 0x7f368006d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3698036000 tx=0x7f3698030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:09.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.639+0000 7f369fe00640 1 -- 172.21.15.162:0/4180564679 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f36a8134b60 con 0x7f36a80ce6a0 2024-01-20T11:08:09.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.830+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36a8134b60 con 0x7f36a80ce6a0 2024-01-20T11:08:09.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.831+0000 7f369fe00640 1 -- 172.21.15.162:0/4180564679 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36a8134b60 con 0x7f36a80ce6a0 2024-01-20T11:08:09.831 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f368006af00 msgr2=0x7f368006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f368006af00 0x7f368006d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3698036000 tx=0x7f3698030000 comp rx=0 tx=0).stop 2024-01-20T11:08:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a80ce6a0 msgr2=0x7f36a81332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a80ce6a0 0x7f36a81332e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f369000b410 tx=0x7f369000b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 shutdown_connections 2024-01-20T11:08:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a8141bb0 0x7f36a815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a80ce6a0 0x7f36a81332e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f368006af00 0x7f368006d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 --2- 172.21.15.162:0/4180564679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a80cdc30 0x7f36a81355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:09.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 >> 172.21.15.162:0/4180564679 conn(0x7f36a806a600 msgr2=0x7f36a80b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:09.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.833+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 shutdown_connections 2024-01-20T11:08:09.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:09.834+0000 7f36aee00640 1 -- 172.21.15.162:0/4180564679 wait complete. 2024-01-20T11:08:09.890 INFO:tasks.cephfs_test_runner:Starting test: test_dir_deletion (tasks.cephfs.test_strays.TestStrays) That when deleting a bunch of dentries and the containing 2024-01-20T11:08:09.890 INFO:tasks.cephfs_test_runner:test_dir_deletion (tasks.cephfs.test_strays.TestStrays) 2024-01-20T11:08:09.890 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:10.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.100+0000 7fb9ce200640 1 Processor -- start 2024-01-20T11:08:10.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.100+0000 7fb9ce200640 1 -- start start 2024-01-20T11:08:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9ce200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb9c8070630 0x7fb9c80adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c815c6e0 0x7fb9c80ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9ce200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c8070b60 con 0x7fb9c8155a30 2024-01-20T11:08:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9ce200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c815ba10 con 0x7fb9c8070630 2024-01-20T11:08:10.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9ce200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c815bc00 con 0x7fb9c815c6e0 2024-01-20T11:08:10.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c7400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb9c8155a30 0x7fb9c80ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48266/0 (socket says 172.21.15.162:48266) 2024-01-20T11:08:10.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c7400640 1 -- 172.21.15.162:0/2969529434 learned_addr learned my addr 172.21.15.162:0/2969529434 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:10.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c6a00640 1 --2- 172.21.15.162:0/2969529434 >> v2:172.21.15.162:3300/0 conn(0x7fb9c8070630 0x7fb9c80adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c6000640 1 -- 172.21.15.162:0/2969529434 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465951420 0 0) 0x7fb9c8070b60 con 0x7fb9c8155a30 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c6000640 1 -- 172.21.15.162:0/2969529434 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a8003520 con 0x7fb9c8155a30 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c7e00640 1 --2- 172.21.15.162:0/2969529434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c815c6e0 0x7fb9c80ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c6a00640 1 -- 172.21.15.162:0/2969529434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c815c6e0 msgr2=0x7fb9c80ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c6a00640 1 --2- 172.21.15.162:0/2969529434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c815c6e0 0x7fb9c80ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c6a00640 1 -- 172.21.15.162:0/2969529434 >> v1:172.21.15.162:6789/0 conn(0x7fb9c8155a30 legacy=0x7fb9c80ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c6a00640 1 -- 172.21.15.162:0/2969529434 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c815bee0 con 0x7fb9c8070630 2024-01-20T11:08:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.102+0000 7fb9c7e00640 1 --2- 172.21.15.162:0/2969529434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c815c6e0 0x7fb9c80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9c6a00640 1 --2- 172.21.15.162:0/2969529434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c8070630 0x7fb9c80adfa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00097a0 tx=0x7fb9b002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed60fc7b3f6b8c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9c6000640 1 -- 172.21.15.162:0/2969529434 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b002d040 con 0x7fb9c8070630 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9c6000640 1 -- 172.21.15.162:0/2969529434 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0031810 con 0x7fb9c8070630 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9c6000640 1 -- 172.21.15.162:0/2969529434 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0031b80 con 0x7fb9c8070630 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9ce200640 1 -- 172.21.15.162:0/2969529434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c8070630 msgr2=0x7fb9c80adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9ce200640 1 --2- 172.21.15.162:0/2969529434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c8070630 0x7fb9c80adfa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00097a0 tx=0x7fb9b002b8b0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9ce200640 1 -- 172.21.15.162:0/2969529434 shutdown_connections 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9ce200640 1 --2- 172.21.15.162:0/2969529434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c815c6e0 0x7fb9c80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9ce200640 1 --2- 172.21.15.162:0/2969529434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c8070630 0x7fb9c80adfa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.104+0000 7fb9ce200640 1 -- 172.21.15.162:0/2969529434 >> 172.21.15.162:0/2969529434 conn(0x7fb9c80b0cd0 msgr2=0x7fb9c80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.105+0000 7fb9ce200640 1 -- 172.21.15.162:0/2969529434 shutdown_connections 2024-01-20T11:08:10.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.105+0000 7fb9ce200640 1 -- 172.21.15.162:0/2969529434 wait complete. 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.106+0000 7fb9ce200640 1 Processor -- start 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.106+0000 7fb9ce200640 1 -- start start 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.107+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c8070630 0x7fb9c80cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.107+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c8155a30 0x7fb9c80b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.107+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c815c6e0 0x7fb9c80b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.107+0000 7fb9ce200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80cb160 con 0x7fb9c815c6e0 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.107+0000 7fb9ce200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80c9b80 con 0x7fb9c8155a30 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.107+0000 7fb9ce200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80c9e60 con 0x7fb9c8070630 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.107+0000 7fb9c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c815c6e0 0x7fb9c80b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c815c6e0 0x7fb9c80b27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60124/0 (socket says 172.21.15.162:60124) 2024-01-20T11:08:10.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 -- 172.21.15.162:0/358050272 learned_addr learned my addr 172.21.15.162:0/358050272 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 -- 172.21.15.162:0/358050272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c8070630 msgr2=0x7fb9c80cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c8070630 0x7fb9c80cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 -- 172.21.15.162:0/358050272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c8155a30 msgr2=0x7fb9c80b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c8155a30 0x7fb9c80b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 -- 172.21.15.162:0/358050272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b0009400 con 0x7fb9c815c6e0 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9c7e00640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c815c6e0 0x7fb9c80b27b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000cd50 tx=0x7fb9c000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9bf400640 1 -- 172.21.15.162:0/358050272 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000f680 con 0x7fb9c815c6e0 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9bf400640 1 -- 172.21.15.162:0/358050272 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c000f800 con 0x7fb9c815c6e0 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9bf400640 1 -- 172.21.15.162:0/358050272 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000fbb0 con 0x7fb9c815c6e0 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.108+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c8155f90 con 0x7fb9c815c6e0 2024-01-20T11:08:10.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.109+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c80ca420 con 0x7fb9c815c6e0 2024-01-20T11:08:10.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.110+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c804e970 con 0x7fb9c815c6e0 2024-01-20T11:08:10.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.111+0000 7fb9bf400640 1 -- 172.21.15.162:0/358050272 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb9c000b040 con 0x7fb9c815c6e0 2024-01-20T11:08:10.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.111+0000 7fb9bf400640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb9a006aed0 0x7fb9a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.112+0000 7fb9bf400640 1 -- 172.21.15.162:0/358050272 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9c0089fe0 con 0x7fb9c815c6e0 2024-01-20T11:08:10.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.112+0000 7fb9c7400640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb9a006aed0 0x7fb9a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.113+0000 7fb9c7400640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb9a006aed0 0x7fb9a006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8000f60 tx=0x7fb9b80078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.117+0000 7fb9bf400640 1 -- 172.21.15.162:0/358050272 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb9c0054eb0 con 0x7fb9c815c6e0 2024-01-20T11:08:10.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.295+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9c806db40 con 0x7fb9c815c6e0 2024-01-20T11:08:10.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.298+0000 7fb9bf400640 1 -- 172.21.15.162:0/358050272 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fb9c001d090 con 0x7fb9c815c6e0 2024-01-20T11:08:10.298 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:10.299 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb9a006aed0 msgr2=0x7fb9a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb9a006aed0 0x7fb9a006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8000f60 tx=0x7fb9b80078f0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c815c6e0 msgr2=0x7fb9c80b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c815c6e0 0x7fb9c80b27b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000cd50 tx=0x7fb9c000a650 comp rx=0 tx=0).stop 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 shutdown_connections 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c815c6e0 0x7fb9c80b27b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb9a006aed0 0x7fb9a006d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c8155a30 0x7fb9c80b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 --2- 172.21.15.162:0/358050272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c8070630 0x7fb9c80cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 >> 172.21.15.162:0/358050272 conn(0x7fb9c80b0cd0 msgr2=0x7fb9c806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 shutdown_connections 2024-01-20T11:08:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.300+0000 7fb9ce200640 1 -- 172.21.15.162:0/358050272 wait complete. 2024-01-20T11:08:10.319 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:10.319 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:10.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.518+0000 7f054fa00640 1 Processor -- start 2024-01-20T11:08:10.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.518+0000 7f054fa00640 1 -- start start 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.519+0000 7f054fa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0548141bb0 0x7f05480ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.519+0000 7f054fa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480ce6a0 0x7f054806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.519+0000 7f054fa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f05480cdc30 0x7f054806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.519+0000 7f054fa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480cee70 con 0x7f05480cdc30 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.519+0000 7f054fa00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480cd7a0 con 0x7f0548141bb0 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.519+0000 7f054fa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05480ceb90 con 0x7f05480ce6a0 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f05480cdc30 0x7f054806cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f05480cdc30 0x7f054806cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60136/0 (socket says 172.21.15.162:60136) 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 -- 172.21.15.162:0/671693550 learned_addr learned my addr 172.21.15.162:0/671693550 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054d000640 1 --2- 172.21.15.162:0/671693550 >> v2:172.21.15.179:3300/0 conn(0x7f0548141bb0 0x7f05480ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 -- 172.21.15.162:0/671693550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480ce6a0 msgr2=0x7f054806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:10.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 --2- 172.21.15.162:0/671693550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480ce6a0 0x7f054806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 -- 172.21.15.162:0/671693550 >> v2:172.21.15.179:3300/0 conn(0x7f0548141bb0 msgr2=0x7f05480ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:10.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 --2- 172.21.15.162:0/671693550 >> v2:172.21.15.179:3300/0 conn(0x7f0548141bb0 0x7f05480ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.520+0000 7f054da00640 1 -- 172.21.15.162:0/671693550 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05480cd150 con 0x7f05480cdc30 2024-01-20T11:08:10.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.522+0000 7f054da00640 1 --2- 172.21.15.162:0/671693550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480cdc30 0x7f054806cc20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f05480ccea0 tx=0x7f054002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8418610aab6f3d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.522+0000 7f0547e00640 1 -- 172.21.15.162:0/671693550 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054002c9e0 con 0x7f05480cdc30 2024-01-20T11:08:10.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.522+0000 7f0547e00640 1 -- 172.21.15.162:0/671693550 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054002cb40 con 0x7f05480cdc30 2024-01-20T11:08:10.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.522+0000 7f0547e00640 1 -- 172.21.15.162:0/671693550 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400343f0 con 0x7f05480cdc30 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.522+0000 7f054fa00640 1 -- 172.21.15.162:0/671693550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480cdc30 msgr2=0x7f054806cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.522+0000 7f054fa00640 1 --2- 172.21.15.162:0/671693550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480cdc30 0x7f054806cc20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f05480ccea0 tx=0x7f054002be40 comp rx=0 tx=0).stop 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.523+0000 7f054fa00640 1 -- 172.21.15.162:0/671693550 shutdown_connections 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.523+0000 7f054fa00640 1 --2- 172.21.15.162:0/671693550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480cdc30 0x7f054806cc20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.523+0000 7f054fa00640 1 --2- 172.21.15.162:0/671693550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480ce6a0 0x7f054806c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.523+0000 7f054fa00640 1 --2- 172.21.15.162:0/671693550 >> v2:172.21.15.179:3300/0 conn(0x7f0548141bb0 0x7f05480ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.523+0000 7f054fa00640 1 -- 172.21.15.162:0/671693550 >> 172.21.15.162:0/671693550 conn(0x7f054806a600 msgr2=0x7f054806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.523+0000 7f054fa00640 1 -- 172.21.15.162:0/671693550 shutdown_connections 2024-01-20T11:08:10.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.523+0000 7f054fa00640 1 -- 172.21.15.162:0/671693550 wait complete. 2024-01-20T11:08:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.524+0000 7f054fa00640 1 Processor -- start 2024-01-20T11:08:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.525+0000 7f054fa00640 1 -- start start 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.525+0000 7f054fa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480cdc30 0x7f05480b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480ce6a0 0x7f05481e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054fa00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0548141bb0 0x7f054815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05481e4dd0 con 0x7f05480ce6a0 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054fa00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05481e50b0 con 0x7f0548141bb0 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054fa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05481e5390 con 0x7f05480cdc30 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480ce6a0 0x7f05481e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480ce6a0 0x7f05481e4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60140/0 (socket says 172.21.15.162:60140) 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 -- 172.21.15.162:0/1616765314 learned_addr learned my addr 172.21.15.162:0/1616765314 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054d000640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480cdc30 0x7f05480b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054da00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0548141bb0 0x7f054815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 -- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480cdc30 msgr2=0x7f05480b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480cdc30 0x7f05480b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 -- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0548141bb0 msgr2=0x7f054815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0548141bb0 0x7f054815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f053fc00640 1 -- 172.21.15.162:0/1616765314 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540009b30 con 0x7f05480ce6a0 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.526+0000 7f054da00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0548141bb0 0x7f054815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.527+0000 7f053fc00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480ce6a0 0x7f05481e4580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f053000b410 tx=0x7f053000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.527+0000 7f0545600640 1 -- 172.21.15.162:0/1616765314 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530011830 con 0x7f05480ce6a0 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.527+0000 7f0545600640 1 -- 172.21.15.162:0/1616765314 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05300119b0 con 0x7f05480ce6a0 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.527+0000 7f0545600640 1 -- 172.21.15.162:0/1616765314 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530011d60 con 0x7f05480ce6a0 2024-01-20T11:08:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.527+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05481e5670 con 0x7f05480ce6a0 2024-01-20T11:08:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.527+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05481e4ac0 con 0x7f05480ce6a0 2024-01-20T11:08:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.528+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05481e5b90 con 0x7f05480ce6a0 2024-01-20T11:08:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.529+0000 7f0545600640 1 -- 172.21.15.162:0/1616765314 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f053001a400 con 0x7f05480ce6a0 2024-01-20T11:08:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.530+0000 7f0545600640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f052006af00 0x7f052006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.530+0000 7f0545600640 1 -- 172.21.15.162:0/1616765314 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05300897d0 con 0x7f05480ce6a0 2024-01-20T11:08:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.530+0000 7f054d000640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f052006af00 0x7f052006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.531+0000 7f054d000640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f052006af00 0x7f052006d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0538006fd0 tx=0x7f0538008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.535+0000 7f0545600640 1 -- 172.21.15.162:0/1616765314 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f05481e5b90 con 0x7f05480ce6a0 2024-01-20T11:08:10.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.730+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05481e5b90 con 0x7f05480ce6a0 2024-01-20T11:08:10.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.730+0000 7f0545600640 1 -- 172.21.15.162:0/1616765314 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05481e5b90 con 0x7f05480ce6a0 2024-01-20T11:08:10.731 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f052006af00 msgr2=0x7f052006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f052006af00 0x7f052006d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0538006fd0 tx=0x7f0538008040 comp rx=0 tx=0).stop 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480ce6a0 msgr2=0x7f05481e4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480ce6a0 0x7f05481e4580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f053000b410 tx=0x7f053000b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 shutdown_connections 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f052006af00 0x7f052006d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0548141bb0 0x7f054815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05480ce6a0 0x7f05481e4580 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 --2- 172.21.15.162:0/1616765314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05480cdc30 0x7f05480b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 >> 172.21.15.162:0/1616765314 conn(0x7f054806a600 msgr2=0x7f0548071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 shutdown_connections 2024-01-20T11:08:10.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.733+0000 7f054fa00640 1 -- 172.21.15.162:0/1616765314 wait complete. 2024-01-20T11:08:10.752 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:10.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.953+0000 7f8bf0000640 1 Processor -- start 2024-01-20T11:08:10.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.954+0000 7f8bf0000640 1 -- start start 2024-01-20T11:08:10.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.955+0000 7f8bf0000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8be815a320 0x7f8be815b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.955+0000 7f8bf0000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815e930 0x7f8be80b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.955+0000 7f8bf0000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be8071260 con 0x7f8be80b3fb0 2024-01-20T11:08:10.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.955+0000 7f8bf0000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80b4420 con 0x7f8be815a320 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.955+0000 7f8bf0000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80709f0 con 0x7f8be815e930 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.955+0000 7f8bed600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8be815a320 0x7f8be815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8bed600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8be815a320 0x7f8be815b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60146/0 (socket says 172.21.15.162:60146) 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8bed600640 1 -- 172.21.15.162:0/401962580 learned_addr learned my addr 172.21.15.162:0/401962580 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8becc00640 1 --2- 172.21.15.162:0/401962580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815e930 0x7f8be80b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8bed600640 1 -- 172.21.15.162:0/401962580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815e930 msgr2=0x7f8be80b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8bed600640 1 --2- 172.21.15.162:0/401962580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815e930 0x7f8be80b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8bed600640 1 -- 172.21.15.162:0/401962580 >> v1:172.21.15.179:6789/0 conn(0x7f8be80b3fb0 legacy=0x7f8be80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8bed600640 1 -- 172.21.15.162:0/401962580 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8070cd0 con 0x7f8be815a320 2024-01-20T11:08:10.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.956+0000 7f8becc00640 1 --2- 172.21.15.162:0/401962580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815e930 0x7f8be80b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:10.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.957+0000 7f8bed600640 1 --2- 172.21.15.162:0/401962580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815a320 0x7f8be815b520 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009870 tx=0x7f8bd802db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238a580e110d45cd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.957+0000 7f8be7e00640 1 -- 172.21.15.162:0/401962580 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd802f8c0 con 0x7f8be815a320 2024-01-20T11:08:10.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8be7e00640 1 -- 172.21.15.162:0/401962580 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd802fa20 con 0x7f8be815a320 2024-01-20T11:08:10.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8be7e00640 1 -- 172.21.15.162:0/401962580 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd802fdb0 con 0x7f8be815a320 2024-01-20T11:08:10.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8bf0000640 1 -- 172.21.15.162:0/401962580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815a320 msgr2=0x7f8be815b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8bf0000640 1 --2- 172.21.15.162:0/401962580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815a320 0x7f8be815b520 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009870 tx=0x7f8bd802db00 comp rx=0 tx=0).stop 2024-01-20T11:08:10.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8bf0000640 1 -- 172.21.15.162:0/401962580 shutdown_connections 2024-01-20T11:08:10.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8bf0000640 1 --2- 172.21.15.162:0/401962580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815e930 0x7f8be80b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8bf0000640 1 --2- 172.21.15.162:0/401962580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815a320 0x7f8be815b520 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.958+0000 7f8bf0000640 1 -- 172.21.15.162:0/401962580 >> 172.21.15.162:0/401962580 conn(0x7f8be806a600 msgr2=0x7f8be806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:10.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.959+0000 7f8bf0000640 1 -- 172.21.15.162:0/401962580 shutdown_connections 2024-01-20T11:08:10.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.959+0000 7f8bf0000640 1 -- 172.21.15.162:0/401962580 wait complete. 2024-01-20T11:08:10.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.960+0000 7f8bf0000640 1 Processor -- start 2024-01-20T11:08:10.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.961+0000 7f8bf0000640 1 -- start start 2024-01-20T11:08:10.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bf0000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b3fb0 0x7f8be81468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bf0000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815a320 0x7f8be815ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bf0000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815e930 0x7f8be815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bf0000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8154ab0 con 0x7f8be815e930 2024-01-20T11:08:10.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bf0000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8154180 con 0x7f8be80b3fb0 2024-01-20T11:08:10.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bf0000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8154460 con 0x7f8be815a320 2024-01-20T11:08:10.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815e930 0x7f8be815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815e930 0x7f8be815cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60160/0 (socket says 172.21.15.162:60160) 2024-01-20T11:08:10.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 -- 172.21.15.162:0/2065870017 learned_addr learned my addr 172.21.15.162:0/2065870017 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8becc00640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815a320 0x7f8be815ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bed600640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b3fb0 0x7f8be81468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 -- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815a320 msgr2=0x7f8be815ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815a320 0x7f8be815ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 -- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b3fb0 msgr2=0x7f8be81468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b3fb0 0x7f8be81468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.962+0000 7f8bee000640 1 -- 172.21.15.162:0/2065870017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80094d0 con 0x7f8be815e930 2024-01-20T11:08:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.963+0000 7f8bed600640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b3fb0 0x7f8be81468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.963+0000 7f8bee000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815e930 0x7f8be815cf50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c410 tx=0x7f8be000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.963+0000 7f8be5600640 1 -- 172.21.15.162:0/2065870017 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0011790 con 0x7f8be815e930 2024-01-20T11:08:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.963+0000 7f8be5600640 1 -- 172.21.15.162:0/2065870017 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be00118f0 con 0x7f8be815e930 2024-01-20T11:08:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.963+0000 7f8be5600640 1 -- 172.21.15.162:0/2065870017 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0011ce0 con 0x7f8be815e930 2024-01-20T11:08:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.963+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be8154740 con 0x7f8be815e930 2024-01-20T11:08:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.963+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8146e00 con 0x7f8be815e930 2024-01-20T11:08:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.964+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be814e420 con 0x7f8be815e930 2024-01-20T11:08:10.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.965+0000 7f8be5600640 1 -- 172.21.15.162:0/2065870017 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8be001c460 con 0x7f8be815e930 2024-01-20T11:08:10.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.967+0000 7f8be5600640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8bc006aed0 0x7f8bc006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:10.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.967+0000 7f8be5600640 1 -- 172.21.15.162:0/2065870017 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8be00893b0 con 0x7f8be815e930 2024-01-20T11:08:10.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.967+0000 7f8bed600640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8bc006aed0 0x7f8bc006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:10.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.968+0000 7f8bed600640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8bc006aed0 0x7f8bc006d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8038000 tx=0x7f8bd8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:10.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:10.971+0000 7f8be5600640 1 -- 172.21.15.162:0/2065870017 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8be00541e0 con 0x7f8be815e930 2024-01-20T11:08:11.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.162+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8be80680e0 con 0x7f8be815e930 2024-01-20T11:08:11.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.163+0000 7f8be5600640 1 -- 172.21.15.162:0/2065870017 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8be0057800 con 0x7f8be815e930 2024-01-20T11:08:11.163 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8bc006aed0 msgr2=0x7f8bc006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8bc006aed0 0x7f8bc006d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8038000 tx=0x7f8bd8008030 comp rx=0 tx=0).stop 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815e930 msgr2=0x7f8be815cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815e930 0x7f8be815cf50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c410 tx=0x7f8be000c8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 shutdown_connections 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be815e930 0x7f8be815cf50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815a320 0x7f8be815ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8bc006aed0 0x7f8bc006d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 --2- 172.21.15.162:0/2065870017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b3fb0 0x7f8be81468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.165+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 >> 172.21.15.162:0/2065870017 conn(0x7f8be806a600 msgr2=0x7f8be80cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:11.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.166+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 shutdown_connections 2024-01-20T11:08:11.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.166+0000 7f8bf0000640 1 -- 172.21.15.162:0/2065870017 wait complete. 2024-01-20T11:08:11.183 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:11.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.399+0000 7f5bbb000640 1 Processor -- start 2024-01-20T11:08:11.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.399+0000 7f5bbb000640 1 -- start start 2024-01-20T11:08:11.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bbb000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5bb40cdf90 0x7f5bb40ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bbb000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb4071830 con 0x7f5bb4144a10 2024-01-20T11:08:11.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bbb000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb4070c20 con 0x7f5bb4071cc0 2024-01-20T11:08:11.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bbb000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb4070f00 con 0x7f5bb40cdf90 2024-01-20T11:08:11.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bb9c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5bb4144a10 0x7f5bb40703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48276/0 (socket says 172.21.15.162:48276) 2024-01-20T11:08:11.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bb9c00640 1 -- 172.21.15.162:0/3265797427 learned_addr learned my addr 172.21.15.162:0/3265797427 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:11.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bba600640 1 --2- 172.21.15.162:0/3265797427 >> v2:172.21.15.179:3300/0 conn(0x7f5bb40cdf90 0x7f5bb40ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.401+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968873241 0 0) 0x7f5bb4071830 con 0x7f5bb4144a10 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b94003520 con 0x7f5bb4144a10 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699549289 0 0) 0x7f5b94003520 con 0x7f5bb4144a10 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 >> v2:172.21.15.179:3300/0 conn(0x7f5bb40cdf90 msgr2=0x7f5bb40ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 --2- 172.21.15.162:0/3265797427 >> v2:172.21.15.179:3300/0 conn(0x7f5bb40cdf90 0x7f5bb40ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 >> v1:172.21.15.179:6789/0 conn(0x7f5bb4071cc0 legacy=0x7f5bb40cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb40711e0 con 0x7f5bb4144a10 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f5ba4001670 con 0x7f5bb4144a10 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 >> v1:172.21.15.162:6789/0 conn(0x7f5bb4144a10 legacy=0x7f5bb40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94003970 0x7f5b94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b940047c0 0x7f5b94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b94005180 0x7f5b9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb4070f00 con 0x7f5b94005180 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9400c020 con 0x7f5b94003970 2024-01-20T11:08:11.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9400c1e0 con 0x7f5b940047c0 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.402+0000 7f5bba600640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b94005180 0x7f5b9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bb9c00640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94003970 0x7f5b94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bb9200640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b940047c0 0x7f5b94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bba600640 1 -- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b940047c0 msgr2=0x7f5b94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bba600640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b940047c0 0x7f5b94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bba600640 1 -- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94003970 msgr2=0x7f5b94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bba600640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94003970 0x7f5b94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bba600640 1 -- 172.21.15.162:0/3265797427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94003520 con 0x7f5b94005180 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.403+0000 7f5bb9200640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b940047c0 0x7f5b94004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.404+0000 7f5bba600640 1 -- 172.21.15.162:0/3265797427 reap_dead start 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.404+0000 7f5bba600640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b94005180 0x7f5b9400b980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009fc0 tx=0x7f5b940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d050fc73289b3869 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.404+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac02cc60 con 0x7f5b94005180 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.404+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac00f040 con 0x7f5b94005180 2024-01-20T11:08:11.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.404+0000 7f5bb3e00640 1 -- 172.21.15.162:0/3265797427 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac003990 con 0x7f5b94005180 2024-01-20T11:08:11.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.405+0000 7f5bbb000640 1 -- 172.21.15.162:0/3265797427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b94005180 msgr2=0x7f5b9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.405+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b94005180 0x7f5b9400b980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009fc0 tx=0x7f5b940057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.405+0000 7f5bbb000640 1 -- 172.21.15.162:0/3265797427 shutdown_connections 2024-01-20T11:08:11.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.405+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3265797427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b94005180 0x7f5b9400b980 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.405+0000 7f5bbb000640 1 -- 172.21.15.162:0/3265797427 >> 172.21.15.162:0/3265797427 conn(0x7f5bb40b0c40 msgr2=0x7f5bb40b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:11.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.405+0000 7f5bbb000640 1 -- 172.21.15.162:0/3265797427 shutdown_connections 2024-01-20T11:08:11.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.405+0000 7f5bbb000640 1 -- 172.21.15.162:0/3265797427 wait complete. 2024-01-20T11:08:11.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.407+0000 7f5bbb000640 1 Processor -- start 2024-01-20T11:08:11.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.407+0000 7f5bbb000640 1 -- start start 2024-01-20T11:08:11.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bbb000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94005180 0x7f5bb4138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bbb000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb413e2e0 0x7f5bb4150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bbb000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb4139970 0x7f5bb4139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bbb000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb413b120 con 0x7f5bb413e2e0 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bbb000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb413e760 con 0x7f5b94005180 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bbb000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb413a7f0 con 0x7f5bb4139970 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bb9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb413e2e0 0x7f5bb4150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bb9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb413e2e0 0x7f5bb4150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60176/0 (socket says 172.21.15.162:60176) 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.408+0000 7f5bb9200640 1 -- 172.21.15.162:0/3164469630 learned_addr learned my addr 172.21.15.162:0/3164469630 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb9c00640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94005180 0x7f5bb4138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bba600640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb4139970 0x7f5bb4139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb9200640 1 -- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb4139970 msgr2=0x7f5bb4139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb9200640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb4139970 0x7f5bb4139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb9200640 1 -- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94005180 msgr2=0x7f5bb4138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb9200640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94005180 0x7f5bb4138010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb9200640 1 -- 172.21.15.162:0/3164469630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb413aad0 con 0x7f5bb413e2e0 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bba600640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb4139970 0x7f5bb4139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb9200640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb413e2e0 0x7f5bb4150770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c000f60 tx=0x7f5b9c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:11.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb1600640 1 -- 172.21.15.162:0/3164469630 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c005480 con 0x7f5bb413e2e0 2024-01-20T11:08:11.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb1600640 1 -- 172.21.15.162:0/3164469630 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c003610 con 0x7f5bb413e2e0 2024-01-20T11:08:11.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb413adb0 con 0x7f5bb413e2e0 2024-01-20T11:08:11.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bb1600640 1 -- 172.21.15.162:0/3164469630 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0039c0 con 0x7f5bb413e2e0 2024-01-20T11:08:11.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.409+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb413a330 con 0x7f5bb413e2e0 2024-01-20T11:08:11.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.410+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb4074a30 con 0x7f5bb413e2e0 2024-01-20T11:08:11.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.411+0000 7f5bb1600640 1 -- 172.21.15.162:0/3164469630 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5b9c003b20 con 0x7f5bb413e2e0 2024-01-20T11:08:11.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.412+0000 7f5bb1600640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b8c06aed0 0x7f5b8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.412+0000 7f5bb1600640 1 -- 172.21.15.162:0/3164469630 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b9c089530 con 0x7f5bb413e2e0 2024-01-20T11:08:11.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.413+0000 7f5bb9c00640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b8c06aed0 0x7f5b8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.413+0000 7f5bb9c00640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b8c06aed0 0x7f5b8c06d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4001050 tx=0x7f5ba4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:11.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.417+0000 7f5bb1600640 1 -- 172.21.15.162:0/3164469630 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5b9c0544a0 con 0x7f5bb413e2e0 2024-01-20T11:08:11.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.610+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bb413b260 con 0x7f5bb413e2e0 2024-01-20T11:08:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.611+0000 7f5bb1600640 1 -- 172.21.15.162:0/3164469630 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b9c001230 con 0x7f5bb413e2e0 2024-01-20T11:08:11.611 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b8c06aed0 msgr2=0x7f5b8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b8c06aed0 0x7f5b8c06d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4001050 tx=0x7f5ba4009040 comp rx=0 tx=0).stop 2024-01-20T11:08:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb413e2e0 msgr2=0x7f5bb4150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb413e2e0 0x7f5bb4150770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c000f60 tx=0x7f5b9c00d9f0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 shutdown_connections 2024-01-20T11:08:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb4139970 0x7f5bb4139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb413e2e0 0x7f5bb4150770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b8c06aed0 0x7f5b8c06d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 --2- 172.21.15.162:0/3164469630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b94005180 0x7f5bb4138010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.613+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 >> 172.21.15.162:0/3164469630 conn(0x7f5bb40b0c40 msgr2=0x7f5bb415aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:11.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.614+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 shutdown_connections 2024-01-20T11:08:11.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.614+0000 7f5bbb000640 1 -- 172.21.15.162:0/3164469630 wait complete. 2024-01-20T11:08:11.631 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2024-01-20T11:08:11.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.837+0000 7f5db0800640 1 Processor -- start 2024-01-20T11:08:11.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.837+0000 7f5db0800640 1 -- start start 2024-01-20T11:08:11.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5db0800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5da8155a30 0x7f5da80ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5db0800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8070630 0x7f5da80adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5db0800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5da815c6e0 0x7f5da80ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5db0800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da815ba10 con 0x7f5da8155a30 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5db0800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da8070b60 con 0x7f5da815c6e0 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5db0800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da815bc00 con 0x7f5da8070630 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5dade00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5da8155a30 0x7f5da80ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5dade00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5da8155a30 0x7f5da80ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60188/0 (socket says 172.21.15.162:60188) 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.839+0000 7f5dade00640 1 -- 172.21.15.162:0/1120461750 learned_addr learned my addr 172.21.15.162:0/1120461750 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.840+0000 7f5dade00640 1 -- 172.21.15.162:0/1120461750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8070630 msgr2=0x7f5da80adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.840+0000 7f5dade00640 1 --2- 172.21.15.162:0/1120461750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8070630 0x7f5da80adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.840+0000 7f5dade00640 1 -- 172.21.15.162:0/1120461750 >> v2:172.21.15.179:3300/0 conn(0x7f5da815c6e0 msgr2=0x7f5da80ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.840+0000 7f5dade00640 1 --2- 172.21.15.162:0/1120461750 >> v2:172.21.15.179:3300/0 conn(0x7f5da815c6e0 0x7f5da80ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.840+0000 7f5dade00640 1 -- 172.21.15.162:0/1120461750 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da815bee0 con 0x7f5da8155a30 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.841+0000 7f5dade00640 1 --2- 172.21.15.162:0/1120461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8155a30 0x7f5da80ce800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5da806d840 tx=0x7f5d9802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bd3a9ec9b61b1d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.841+0000 7f5daca00640 1 -- 172.21.15.162:0/1120461750 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9802c9f0 con 0x7f5da8155a30 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.841+0000 7f5daca00640 1 -- 172.21.15.162:0/1120461750 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9802cb50 con 0x7f5da8155a30 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.841+0000 7f5daca00640 1 -- 172.21.15.162:0/1120461750 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980343f0 con 0x7f5da8155a30 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 -- 172.21.15.162:0/1120461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8155a30 msgr2=0x7f5da80ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 --2- 172.21.15.162:0/1120461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8155a30 0x7f5da80ce800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5da806d840 tx=0x7f5d9802be50 comp rx=0 tx=0).stop 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 -- 172.21.15.162:0/1120461750 shutdown_connections 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 --2- 172.21.15.162:0/1120461750 >> v2:172.21.15.179:3300/0 conn(0x7f5da815c6e0 0x7f5da80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 --2- 172.21.15.162:0/1120461750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8070630 0x7f5da80adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 --2- 172.21.15.162:0/1120461750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8155a30 0x7f5da80ce800 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 -- 172.21.15.162:0/1120461750 >> 172.21.15.162:0/1120461750 conn(0x7f5da80b0cd0 msgr2=0x7f5da80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:11.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 -- 172.21.15.162:0/1120461750 shutdown_connections 2024-01-20T11:08:11.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.842+0000 7f5db0800640 1 -- 172.21.15.162:0/1120461750 wait complete. 2024-01-20T11:08:11.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.844+0000 7f5db0800640 1 Processor -- start 2024-01-20T11:08:11.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.844+0000 7f5db0800640 1 -- start start 2024-01-20T11:08:11.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.845+0000 7f5db0800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8070630 0x7f5da81477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.845+0000 7f5db0800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8155a30 0x7f5da80b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.845+0000 7f5db0800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da815c6e0 0x7f5da80b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.845+0000 7f5db0800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da809a830 con 0x7f5da8070630 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.845+0000 7f5db0800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da809ab10 con 0x7f5da815c6e0 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.845+0000 7f5db0800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da809adf0 con 0x7f5da8155a30 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.845+0000 7f5dade00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8070630 0x7f5da81477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8070630 0x7f5da81477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60192/0 (socket says 172.21.15.162:60192) 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 -- 172.21.15.162:0/3995082907 learned_addr learned my addr 172.21.15.162:0/3995082907 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dad400640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8155a30 0x7f5da80b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 -- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8155a30 msgr2=0x7f5da80b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dae800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da815c6e0 0x7f5da80b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8155a30 0x7f5da80b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 -- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da815c6e0 msgr2=0x7f5da80b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da815c6e0 0x7f5da80b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:11.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 -- 172.21.15.162:0/3995082907 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98009b30 con 0x7f5da8070630 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dad400640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8155a30 0x7f5da80b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dae800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da815c6e0 0x7f5da80b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.846+0000 7f5dade00640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8070630 0x7f5da81477e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d980093e0 tx=0x7f5d98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.847+0000 7f5da6000640 1 -- 172.21.15.162:0/3995082907 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9803e450 con 0x7f5da8070630 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.847+0000 7f5da6000640 1 -- 172.21.15.162:0/3995082907 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9803e5b0 con 0x7f5da8070630 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.847+0000 7f5da6000640 1 -- 172.21.15.162:0/3995082907 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9803e960 con 0x7f5da8070630 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.847+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da809b0d0 con 0x7f5da8070630 2024-01-20T11:08:11.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.847+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da8147d20 con 0x7f5da8070630 2024-01-20T11:08:11.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.848+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da809b590 con 0x7f5da8070630 2024-01-20T11:08:11.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.849+0000 7f5da6000640 1 -- 172.21.15.162:0/3995082907 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5d9803eac0 con 0x7f5da8070630 2024-01-20T11:08:11.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.850+0000 7f5da6000640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5d8006aed0 0x7f5d8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:11.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.850+0000 7f5da6000640 1 -- 172.21.15.162:0/3995082907 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d980ac5d0 con 0x7f5da8070630 2024-01-20T11:08:11.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.850+0000 7f5dad400640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5d8006aed0 0x7f5d8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:11.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.850+0000 7f5dad400640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5d8006aed0 0x7f5d8006d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d90006fd0 tx=0x7f5d90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:11.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:11.854+0000 7f5da6000640 1 -- 172.21.15.162:0/3995082907 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5d980775c0 con 0x7f5da8070630 2024-01-20T11:08:12.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.115+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) v1 -- 0x7f5da80ced10 con 0x7f5da8070630 2024-01-20T11:08:12.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.766+0000 7f5da6000640 1 -- 172.21.15.162:0/3995082907 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v53) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5d9807abe0 con 0x7f5da8070630 2024-01-20T11:08:12.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5d8006aed0 msgr2=0x7f5d8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:12.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5d8006aed0 0x7f5d8006d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d90006fd0 tx=0x7f5d90008040 comp rx=0 tx=0).stop 2024-01-20T11:08:12.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8070630 msgr2=0x7f5da81477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:12.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8070630 0x7f5da81477e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d980093e0 tx=0x7f5d98004a40 comp rx=0 tx=0).stop 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 shutdown_connections 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5d8006aed0 0x7f5d8006d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da815c6e0 0x7f5da80b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.770+0000 7f5db0800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da8155a30 0x7f5da80b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.771+0000 7f5db0800640 1 --2- 172.21.15.162:0/3995082907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da8070630 0x7f5da81477e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.771+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 >> 172.21.15.162:0/3995082907 conn(0x7f5da80b0cd0 msgr2=0x7f5da80ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.771+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 shutdown_connections 2024-01-20T11:08:12.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:12.771+0000 7f5db0800640 1 -- 172.21.15.162:0/3995082907 wait complete. 2024-01-20T11:08:12.791 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-20T11:08:13.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.001+0000 7fdba4800640 1 Processor -- start 2024-01-20T11:08:13.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.001+0000 7fdba4800640 1 -- start start 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba4800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba4800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdb9c06cc20 0x7fdb9c0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba4800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0cee70 con 0x7fdb9c141bb0 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba4800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c06d0b0 con 0x7fdb9c06cc20 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba4800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0cd7a0 con 0x7fdb9c0cdc30 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba1e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fdb9c141bb0 0x7fdb9c0ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48280/0 (socket says 172.21.15.162:48280) 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba1e00640 1 -- 172.21.15.162:0/1751720396 learned_addr learned my addr 172.21.15.162:0/1751720396 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:13.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.003+0000 7fdba2800640 1 --2- 172.21.15.162:0/1751720396 >> v2:172.21.15.162:3300/0 conn(0x7fdb9c06cc20 0x7fdb9c0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.004+0000 7fdba1400640 1 --2- 172.21.15.162:0/1751720396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.004+0000 7fdba0a00640 1 -- 172.21.15.162:0/1751720396 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538850947 0 0) 0x7fdb8c001110 con 0x7fdb9c141bb0 2024-01-20T11:08:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.004+0000 7fdba0a00640 1 -- 172.21.15.162:0/1751720396 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb7c003520 con 0x7fdb9c141bb0 2024-01-20T11:08:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.004+0000 7fdba2800640 1 -- 172.21.15.162:0/1751720396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 msgr2=0x7fdb9c06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.004+0000 7fdba2800640 1 --2- 172.21.15.162:0/1751720396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c06c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.004+0000 7fdba2800640 1 -- 172.21.15.162:0/1751720396 >> v1:172.21.15.162:6789/0 conn(0x7fdb9c141bb0 legacy=0x7fdb9c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.004+0000 7fdba2800640 1 -- 172.21.15.162:0/1751720396 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0ceb90 con 0x7fdb9c06cc20 2024-01-20T11:08:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.005+0000 7fdba2800640 1 --2- 172.21.15.162:0/1751720396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0717b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009d90 tx=0x7fdb9402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9c10298b64a7c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.005+0000 7fdba0a00640 1 -- 172.21.15.162:0/1751720396 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9402cbc0 con 0x7fdb9c06cc20 2024-01-20T11:08:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba0a00640 1 -- 172.21.15.162:0/1751720396 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9402cd20 con 0x7fdb9c06cc20 2024-01-20T11:08:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba0a00640 1 -- 172.21.15.162:0/1751720396 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94034640 con 0x7fdb9c06cc20 2024-01-20T11:08:13.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 -- 172.21.15.162:0/1751720396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 msgr2=0x7fdb9c0717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 --2- 172.21.15.162:0/1751720396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0717b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009d90 tx=0x7fdb9402be10 comp rx=0 tx=0).stop 2024-01-20T11:08:13.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 -- 172.21.15.162:0/1751720396 shutdown_connections 2024-01-20T11:08:13.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 --2- 172.21.15.162:0/1751720396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c06c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 --2- 172.21.15.162:0/1751720396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0717b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 -- 172.21.15.162:0/1751720396 >> 172.21.15.162:0/1751720396 conn(0x7fdb9c06a600 msgr2=0x7fdb9c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 -- 172.21.15.162:0/1751720396 shutdown_connections 2024-01-20T11:08:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.006+0000 7fdba4800640 1 -- 172.21.15.162:0/1751720396 wait complete. 2024-01-20T11:08:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.008+0000 7fdba4800640 1 Processor -- start 2024-01-20T11:08:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.008+0000 7fdba4800640 1 -- start start 2024-01-20T11:08:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.009+0000 7fdba4800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.009+0000 7fdba4800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c1e4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.009+0000 7fdba4800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c141bb0 0x7fdb9c1e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.009+0000 7fdba4800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1e5170 con 0x7fdb9c06cc20 2024-01-20T11:08:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.009+0000 7fdba4800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1e5380 con 0x7fdb9c141bb0 2024-01-20T11:08:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.009+0000 7fdba4800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1e5660 con 0x7fdb9c0cdc30 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60212/0 (socket says 172.21.15.162:60212) 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 -- 172.21.15.162:0/1415488023 learned_addr learned my addr 172.21.15.162:0/1415488023 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1400640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c1e4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 -- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 msgr2=0x7fdb9c1e4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c1e4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba2800640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c141bb0 0x7fdb9c1e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 -- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c141bb0 msgr2=0x7fdb9c1e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c141bb0 0x7fdb9c1e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 -- 172.21.15.162:0/1415488023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94009a70 con 0x7fdb9c06cc20 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.010+0000 7fdba1e00640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0b1330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00c700 tx=0x7fdb8c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.011+0000 7fdb9a000640 1 -- 172.21.15.162:0/1415488023 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c005ab0 con 0x7fdb9c06cc20 2024-01-20T11:08:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.011+0000 7fdb9a000640 1 -- 172.21.15.162:0/1415488023 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c005c10 con 0x7fdb9c06cc20 2024-01-20T11:08:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.011+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c1e5940 con 0x7fdb9c06cc20 2024-01-20T11:08:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.011+0000 7fdb9a000640 1 -- 172.21.15.162:0/1415488023 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c001d50 con 0x7fdb9c06cc20 2024-01-20T11:08:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.011+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c1e5f00 con 0x7fdb9c06cc20 2024-01-20T11:08:13.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.012+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c1e6120 con 0x7fdb9c06cc20 2024-01-20T11:08:13.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.013+0000 7fdb9a000640 1 -- 172.21.15.162:0/1415488023 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdb8c007070 con 0x7fdb9c06cc20 2024-01-20T11:08:13.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.014+0000 7fdb9a000640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdb7406af00 0x7fdb7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.014+0000 7fdb9a000640 1 -- 172.21.15.162:0/1415488023 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb8c088a90 con 0x7fdb9c06cc20 2024-01-20T11:08:13.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.014+0000 7fdba1400640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdb7406af00 0x7fdb7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.015+0000 7fdba1400640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdb7406af00 0x7fdb7406d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c143810 tx=0x7fdb84008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:13.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.019+0000 7fdb9a000640 1 -- 172.21.15.162:0/1415488023 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdb8c0538c0 con 0x7fdb9c06cc20 2024-01-20T11:08:13.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.211+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdb9c0cee70 con 0x7fdb9c06cc20 2024-01-20T11:08:13.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.217+0000 7fdb9a000640 1 -- 172.21.15.162:0/1415488023 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb9c0cee70 con 0x7fdb9c06cc20 2024-01-20T11:08:13.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.219+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdb7406af00 msgr2=0x7fdb7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.219+0000 7fdba4800640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdb7406af00 0x7fdb7406d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c143810 tx=0x7fdb84008040 comp rx=0 tx=0).stop 2024-01-20T11:08:13.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.219+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 msgr2=0x7fdb9c0b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.219+0000 7fdba4800640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0b1330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00c700 tx=0x7fdb8c00cbc0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 shutdown_connections 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdb7406af00 0x7fdb7406d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c141bb0 0x7fdb9c1e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0cdc30 0x7fdb9c1e4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 --2- 172.21.15.162:0/1415488023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb9c06cc20 0x7fdb9c0b1330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 >> 172.21.15.162:0/1415488023 conn(0x7fdb9c06a600 msgr2=0x7fdb9c142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 shutdown_connections 2024-01-20T11:08:13.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.220+0000 7fdba4800640 1 -- 172.21.15.162:0/1415488023 wait complete. 2024-01-20T11:08:13.239 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T11:08:13.240 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:08:13.355 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:08:13.478 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T11:08:13.478 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:08:13.479 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:13.534 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:08:13.534 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:13.585 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:08:13.585 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:13.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:13.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.845+0000 7f58bea00640 1 Processor -- start 2024-01-20T11:08:13.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.845+0000 7f58bea00640 1 -- start start 2024-01-20T11:08:13.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58bea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f58b8155a30 0x7f58b80ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58bea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8070630 0x7f58b80adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58bea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b8070b60 con 0x7f58b815c6e0 2024-01-20T11:08:13.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58bea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b815ba10 con 0x7f58b8155a30 2024-01-20T11:08:13.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58bea00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b815bc00 con 0x7f58b8070630 2024-01-20T11:08:13.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58bca00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f58b815c6e0 0x7f58b806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48284/0 (socket says 172.21.15.162:48284) 2024-01-20T11:08:13.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58bca00640 1 -- 172.21.15.162:0/2678127172 learned_addr learned my addr 172.21.15.162:0/2678127172 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:13.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.847+0000 7f58b7e00640 1 --2- 172.21.15.162:0/2678127172 >> v2:172.21.15.162:3300/0 conn(0x7f58b8155a30 0x7f58b80ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.848+0000 7f58b7400640 1 --2- 172.21.15.162:0/2678127172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8070630 0x7f58b80adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.848+0000 7f58b6a00640 1 -- 172.21.15.162:0/2678127172 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561360849 0 0) 0x7f58b8070b60 con 0x7f58b815c6e0 2024-01-20T11:08:13.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.848+0000 7f58b6a00640 1 -- 172.21.15.162:0/2678127172 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5898003520 con 0x7f58b815c6e0 2024-01-20T11:08:13.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.848+0000 7f58b7e00640 1 -- 172.21.15.162:0/2678127172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8070630 msgr2=0x7f58b80adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:13.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.848+0000 7f58b7e00640 1 --2- 172.21.15.162:0/2678127172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8070630 0x7f58b80adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.848+0000 7f58b7e00640 1 -- 172.21.15.162:0/2678127172 >> v1:172.21.15.162:6789/0 conn(0x7f58b815c6e0 legacy=0x7f58b806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.848+0000 7f58b7e00640 1 -- 172.21.15.162:0/2678127172 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b815bee0 con 0x7f58b8155a30 2024-01-20T11:08:13.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.849+0000 7f58b7e00640 1 --2- 172.21.15.162:0/2678127172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8155a30 0x7f58b80ce800 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58a80097a0 tx=0x7f58a802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed363f05542cc8b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.849+0000 7f58b6a00640 1 -- 172.21.15.162:0/2678127172 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8031780 con 0x7f58b8155a30 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.849+0000 7f58b6a00640 1 -- 172.21.15.162:0/2678127172 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a80318e0 con 0x7f58b8155a30 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.849+0000 7f58b6a00640 1 -- 172.21.15.162:0/2678127172 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8031c50 con 0x7f58b8155a30 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 -- 172.21.15.162:0/2678127172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8155a30 msgr2=0x7f58b80ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 --2- 172.21.15.162:0/2678127172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8155a30 0x7f58b80ce800 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58a80097a0 tx=0x7f58a802b820 comp rx=0 tx=0).stop 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 -- 172.21.15.162:0/2678127172 shutdown_connections 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 --2- 172.21.15.162:0/2678127172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8070630 0x7f58b80adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 --2- 172.21.15.162:0/2678127172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8155a30 0x7f58b80ce800 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 -- 172.21.15.162:0/2678127172 >> 172.21.15.162:0/2678127172 conn(0x7f58b80b0cd0 msgr2=0x7f58b80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 -- 172.21.15.162:0/2678127172 shutdown_connections 2024-01-20T11:08:13.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.850+0000 7f58bea00640 1 -- 172.21.15.162:0/2678127172 wait complete. 2024-01-20T11:08:13.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.852+0000 7f58bea00640 1 Processor -- start 2024-01-20T11:08:13.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.852+0000 7f58bea00640 1 -- start start 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58bea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8070630 0x7f58b81f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58bea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8155a30 0x7f58b80af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58bea00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b815c6e0 0x7f58b8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58bea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80af7f0 con 0x7f58b8070630 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58bea00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80aeed0 con 0x7f58b815c6e0 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58bea00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8154210 con 0x7f58b8155a30 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58b7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8070630 0x7f58b81f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58b7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8070630 0x7f58b81f2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60218/0 (socket says 172.21.15.162:60218) 2024-01-20T11:08:13.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.853+0000 7f58b7e00640 1 -- 172.21.15.162:0/1435167472 learned_addr learned my addr 172.21.15.162:0/1435167472 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:13.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58b7400640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8155a30 0x7f58b80af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58bca00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b815c6e0 0x7f58b8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58b7e00640 1 -- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8155a30 msgr2=0x7f58b80af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58b7e00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8155a30 0x7f58b80af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58b7e00640 1 -- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b815c6e0 msgr2=0x7f58b8153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58b7e00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b815c6e0 0x7f58b8153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58b7e00640 1 -- 172.21.15.162:0/1435167472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a8009400 con 0x7f58b8070630 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58b7e00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8070630 0x7f58b81f2ed0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58a8034040 tx=0x7f58a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58afe00640 1 -- 172.21.15.162:0/1435167472 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8032820 con 0x7f58b8070630 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58afe00640 1 -- 172.21.15.162:0/1435167472 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a80329a0 con 0x7f58b8070630 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58afe00640 1 -- 172.21.15.162:0/1435167472 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8032d50 con 0x7f58b8070630 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.854+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b80ad180 con 0x7f58b8070630 2024-01-20T11:08:13.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.855+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b81f3800 con 0x7f58b8070630 2024-01-20T11:08:13.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.856+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b80ad310 con 0x7f58b8070630 2024-01-20T11:08:13.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.857+0000 7f58afe00640 1 -- 172.21.15.162:0/1435167472 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f58a804d3f0 con 0x7f58b8070630 2024-01-20T11:08:13.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.858+0000 7f58afe00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f589006aed0 0x7f589006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:13.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.858+0000 7f58afe00640 1 -- 172.21.15.162:0/1435167472 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58a80ab2c0 con 0x7f58b8070630 2024-01-20T11:08:13.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.858+0000 7f58b7400640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f589006aed0 0x7f589006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:13.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.859+0000 7f58b7400640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f589006aed0 0x7f589006d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58b80b2ee0 tx=0x7f58a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:13.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:13.862+0000 7f58afe00640 1 -- 172.21.15.162:0/1435167472 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f58a80760f0 con 0x7f58b8070630 2024-01-20T11:08:14.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.059+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58b804e970 con 0x7f58b8070630 2024-01-20T11:08:14.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.060+0000 7f58afe00640 1 -- 172.21.15.162:0/1435167472 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f58a8079710 con 0x7f58b8070630 2024-01-20T11:08:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:14.061 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f589006aed0 msgr2=0x7f589006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f589006aed0 0x7f589006d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58b80b2ee0 tx=0x7f58a0008040 comp rx=0 tx=0).stop 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8070630 msgr2=0x7f58b81f2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8070630 0x7f58b81f2ed0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58a8034040 tx=0x7f58a80046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 shutdown_connections 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f589006aed0 0x7f589006d390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b815c6e0 0x7f58b8153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58b8155a30 0x7f58b80af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 --2- 172.21.15.162:0/1435167472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58b8070630 0x7f58b81f2ed0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 >> 172.21.15.162:0/1435167472 conn(0x7f58b80b0cd0 msgr2=0x7f58b815a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:14.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 shutdown_connections 2024-01-20T11:08:14.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.063+0000 7f58bea00640 1 -- 172.21.15.162:0/1435167472 wait complete. 2024-01-20T11:08:14.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:14.082 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:14.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.294+0000 7f8091e00640 1 Processor -- start 2024-01-20T11:08:14.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.294+0000 7f8091e00640 1 -- start start 2024-01-20T11:08:14.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.296+0000 7f8091e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f808c071cc0 0x7f808c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.296+0000 7f8091e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c071830 con 0x7f808c0cd880 2024-01-20T11:08:14.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.296+0000 7f8091e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c070c20 con 0x7f808c144a10 2024-01-20T11:08:14.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.296+0000 7f8091e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c070f00 con 0x7f808c071cc0 2024-01-20T11:08:14.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.296+0000 7f8091400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f808c0cd880 0x7f808c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48300/0 (socket says 172.21.15.162:48300) 2024-01-20T11:08:14.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.296+0000 7f8091400640 1 -- 172.21.15.162:0/2226313446 learned_addr learned my addr 172.21.15.162:0/2226313446 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:14.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.296+0000 7f808be00640 1 --2- 172.21.15.162:0/2226313446 >> v2:172.21.15.179:3300/0 conn(0x7f808c071cc0 0x7f808c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747031740 0 0) 0x7f808c071830 con 0x7f808c0cd880 2024-01-20T11:08:14.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f806c003520 con 0x7f808c0cd880 2024-01-20T11:08:14.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638591967 0 0) 0x7f806c003520 con 0x7f808c0cd880 2024-01-20T11:08:14.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 >> v2:172.21.15.179:3300/0 conn(0x7f808c071cc0 msgr2=0x7f808c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:14.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 --2- 172.21.15.162:0/2226313446 >> v2:172.21.15.179:3300/0 conn(0x7f808c071cc0 0x7f808c0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 >> v1:172.21.15.179:6789/0 conn(0x7f808c144a10 legacy=0x7f808c0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0711e0 con 0x7f808c0cd880 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f80840019f0 con 0x7f808c0cd880 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 >> v1:172.21.15.162:6789/0 conn(0x7f808c0cd880 legacy=0x7f808c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f806c003970 0x7f806c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c0047c0 0x7f806c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c005180 0x7f806c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c070f00 con 0x7f806c005180 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c00c020 con 0x7f806c003970 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.297+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c00c1e0 con 0x7f806c0047c0 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8091400640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c005180 0x7f806c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8090a00640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f806c003970 0x7f806c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8091400640 1 -- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c0047c0 msgr2=0x7f806c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f808be00640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c0047c0 0x7f806c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8091400640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c0047c0 0x7f806c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8091400640 1 -- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f806c003970 msgr2=0x7f806c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8091400640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f806c003970 0x7f806c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8091400640 1 -- 172.21.15.162:0/2226313446 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c003520 con 0x7f806c005180 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f808be00640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c0047c0 0x7f806c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.298+0000 7f8090a00640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f806c003970 0x7f806c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.299+0000 7f8091400640 1 -- 172.21.15.162:0/2226313446 reap_dead start 2024-01-20T11:08:14.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.299+0000 7f8091400640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c005180 0x7f806c00b980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f808400a830 tx=0x7f806c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4f568adc3885ec server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:14.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.299+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840072d0 con 0x7f806c005180 2024-01-20T11:08:14.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.299+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808402f070 con 0x7f806c005180 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.299+0000 7f808b400640 1 -- 172.21.15.162:0/2226313446 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840076b0 con 0x7f806c005180 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.300+0000 7f8091e00640 1 -- 172.21.15.162:0/2226313446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c005180 msgr2=0x7f806c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.300+0000 7f8091e00640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c005180 0x7f806c00b980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f808400a830 tx=0x7f806c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.300+0000 7f8091e00640 1 -- 172.21.15.162:0/2226313446 shutdown_connections 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.300+0000 7f8091e00640 1 --2- 172.21.15.162:0/2226313446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c005180 0x7f806c00b980 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.300+0000 7f8091e00640 1 -- 172.21.15.162:0/2226313446 >> 172.21.15.162:0/2226313446 conn(0x7f808c0b0c40 msgr2=0x7f808c0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.300+0000 7f8091e00640 1 -- 172.21.15.162:0/2226313446 shutdown_connections 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.300+0000 7f8091e00640 1 -- 172.21.15.162:0/2226313446 wait complete. 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.302+0000 7f8091e00640 1 Processor -- start 2024-01-20T11:08:14.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.302+0000 7f8091e00640 1 -- start start 2024-01-20T11:08:14.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f8091e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c005180 0x7f808c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f8091e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f808c13c1f0 0x7f808c14b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f8091e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f808c14be90 0x7f808c14c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f8091e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c15acf0 con 0x7f808c13c1f0 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f8091e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c15e5e0 con 0x7f808c14be90 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f8091e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0b2920 con 0x7f806c005180 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f808be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f808c13c1f0 0x7f808c14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f808be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f808c13c1f0 0x7f808c14b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60246/0 (socket says 172.21.15.162:60246) 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.303+0000 7f808be00640 1 -- 172.21.15.162:0/3017533951 learned_addr learned my addr 172.21.15.162:0/3017533951 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f8090a00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c005180 0x7f808c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f8091400640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f808c14be90 0x7f808c14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f808be00640 1 -- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c005180 msgr2=0x7f808c15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f808be00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c005180 0x7f808c15df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f808be00640 1 -- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f808c14be90 msgr2=0x7f808c14c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f808be00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f808c14be90 0x7f808c14c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f808be00640 1 -- 172.21.15.162:0/3017533951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0b2c00 con 0x7f808c13c1f0 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f808be00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f808c13c1f0 0x7f808c14b950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f80740108b0 tx=0x7f8074010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:14.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f8088c00640 1 -- 172.21.15.162:0/3017533951 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400eb60 con 0x7f808c13c1f0 2024-01-20T11:08:14.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f8088c00640 1 -- 172.21.15.162:0/3017533951 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400ecc0 con 0x7f808c13c1f0 2024-01-20T11:08:14.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.304+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c0b2ee0 con 0x7f808c13c1f0 2024-01-20T11:08:14.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.305+0000 7f8088c00640 1 -- 172.21.15.162:0/3017533951 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807401c400 con 0x7f808c13c1f0 2024-01-20T11:08:14.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.305+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c0b3400 con 0x7f808c13c1f0 2024-01-20T11:08:14.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.306+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c067b70 con 0x7f808c13c1f0 2024-01-20T11:08:14.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.307+0000 7f8088c00640 1 -- 172.21.15.162:0/3017533951 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f807401c560 con 0x7f808c13c1f0 2024-01-20T11:08:14.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.307+0000 7f8088c00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f806406af00 0x7f806406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.308+0000 7f8088c00640 1 -- 172.21.15.162:0/3017533951 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8074089c80 con 0x7f808c13c1f0 2024-01-20T11:08:14.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.308+0000 7f8090a00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f806406af00 0x7f806406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.308+0000 7f8090a00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f806406af00 0x7f806406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f807c000f60 tx=0x7f807c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:14.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.312+0000 7f8088c00640 1 -- 172.21.15.162:0/3017533951 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8074054bf0 con 0x7f808c13c1f0 2024-01-20T11:08:14.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.503+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f808c0b3070 con 0x7f808c13c1f0 2024-01-20T11:08:14.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.504+0000 7f8088c00640 1 -- 172.21.15.162:0/3017533951 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8074058210 con 0x7f808c13c1f0 2024-01-20T11:08:14.504 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:14.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f806406af00 msgr2=0x7f806406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f806406af00 0x7f806406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f807c000f60 tx=0x7f807c009040 comp rx=0 tx=0).stop 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f808c13c1f0 msgr2=0x7f808c14b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f808c13c1f0 0x7f808c14b950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f80740108b0 tx=0x7f8074010d70 comp rx=0 tx=0).stop 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 shutdown_connections 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f806406af00 0x7f806406d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f808c14be90 0x7f808c14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f808c13c1f0 0x7f808c14b950 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 --2- 172.21.15.162:0/3017533951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f806c005180 0x7f808c15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 >> 172.21.15.162:0/3017533951 conn(0x7f808c0b0c40 msgr2=0x7f808c06cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 shutdown_connections 2024-01-20T11:08:14.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.507+0000 7f8091e00640 1 -- 172.21.15.162:0/3017533951 wait complete. 2024-01-20T11:08:14.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:14.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.734+0000 7f8516000640 1 Processor -- start 2024-01-20T11:08:14.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.734+0000 7f8516000640 1 -- start start 2024-01-20T11:08:14.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.736+0000 7f8516000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f851015da10 0x7f85101683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.736+0000 7f8516000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100ce230 con 0x7f85100d16d0 2024-01-20T11:08:14.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.736+0000 7f8516000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100ce500 con 0x7f851015d630 2024-01-20T11:08:14.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.736+0000 7f8516000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85100ce7e0 con 0x7f851015da10 2024-01-20T11:08:14.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.736+0000 7f850ea00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f85100d16d0 0x7f85100cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48302/0 (socket says 172.21.15.162:48302) 2024-01-20T11:08:14.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.736+0000 7f850ea00640 1 -- 172.21.15.162:0/4018125601 learned_addr learned my addr 172.21.15.162:0/4018125601 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:14.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.736+0000 7f850fe00640 1 --2- 172.21.15.162:0/4018125601 >> v2:172.21.15.179:3300/0 conn(0x7f851015da10 0x7f85101683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926469246 0 0) 0x7f85100ce230 con 0x7f85100d16d0 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f0003520 con 0x7f85100d16d0 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 527725749 0 0) 0x7f84f0003520 con 0x7f85100d16d0 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 >> v2:172.21.15.179:3300/0 conn(0x7f851015da10 msgr2=0x7f85101683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 --2- 172.21.15.162:0/4018125601 >> v2:172.21.15.179:3300/0 conn(0x7f851015da10 0x7f85101683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 >> v1:172.21.15.179:6789/0 conn(0x7f851015d630 legacy=0x7f85100cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100ceac0 con 0x7f85100d16d0 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f8500001670 con 0x7f85100d16d0 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 >> v1:172.21.15.162:6789/0 conn(0x7f85100d16d0 legacy=0x7f85100cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84f0003970 0x7f84f0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84f00047c0 0x7f84f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f84f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85100ce7e0 con 0x7f84f0005180 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f000c0b0 con 0x7f84f0003970 2024-01-20T11:08:14.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f000c270 con 0x7f84f00047c0 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.737+0000 7f850fe00640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f84f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850f400640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84f0003970 0x7f84f0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850ea00640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84f00047c0 0x7f84f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850fe00640 1 -- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84f00047c0 msgr2=0x7f84f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850fe00640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84f00047c0 0x7f84f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850fe00640 1 -- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84f0003970 msgr2=0x7f84f0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850fe00640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84f0003970 0x7f84f0003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850fe00640 1 -- 172.21.15.162:0/4018125601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0003520 con 0x7f84f0005180 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.738+0000 7f850ea00640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84f00047c0 0x7f84f0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.739+0000 7f850fe00640 1 -- 172.21.15.162:0/4018125601 reap_dead start 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.739+0000 7f850fe00640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f84f000b980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f851015de80 tx=0x7f84f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305e821f57e87085 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.739+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850802cca0 con 0x7f84f0005180 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.739+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850802ce00 con 0x7f84f0005180 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.739+0000 7f850e000640 1 -- 172.21.15.162:0/4018125601 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508034660 con 0x7f84f0005180 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.740+0000 7f8516000640 1 -- 172.21.15.162:0/4018125601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 msgr2=0x7f84f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.740+0000 7f8516000640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f84f000b980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f851015de80 tx=0x7f84f00057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.740+0000 7f8516000640 1 -- 172.21.15.162:0/4018125601 shutdown_connections 2024-01-20T11:08:14.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.740+0000 7f8516000640 1 --2- 172.21.15.162:0/4018125601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f84f000b980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.740+0000 7f8516000640 1 -- 172.21.15.162:0/4018125601 >> 172.21.15.162:0/4018125601 conn(0x7f851008afe0 msgr2=0x7f851009c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:14.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.740+0000 7f8516000640 1 -- 172.21.15.162:0/4018125601 shutdown_connections 2024-01-20T11:08:14.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.740+0000 7f8516000640 1 -- 172.21.15.162:0/4018125601 wait complete. 2024-01-20T11:08:14.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.742+0000 7f8516000640 1 Processor -- start 2024-01-20T11:08:14.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.742+0000 7f8516000640 1 -- start start 2024-01-20T11:08:14.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f8516000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f8510152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f8516000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85101f7510 0x7f851015fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f8516000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85101600a0 0x7f85101f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f8516000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85100c7000 con 0x7f84f0005180 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f8516000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8510160570 con 0x7f85101600a0 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f8516000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8510160850 con 0x7f85101f7510 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f8510152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f8510152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60272/0 (socket says 172.21.15.162:60272) 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 -- 172.21.15.162:0/208092378 learned_addr learned my addr 172.21.15.162:0/208092378 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 -- 172.21.15.162:0/208092378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85101f7510 msgr2=0x7f851015fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85101f7510 0x7f851015fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 -- 172.21.15.162:0/208092378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85101600a0 msgr2=0x7f85101f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85101600a0 0x7f85101f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.743+0000 7f850f400640 1 -- 172.21.15.162:0/208092378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100c72a0 con 0x7f84f0005180 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.744+0000 7f850f400640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f8510152b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84f800e460 tx=0x7f84f800e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.744+0000 7f8507400640 1 -- 172.21.15.162:0/208092378 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80135f0 con 0x7f84f0005180 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.744+0000 7f8507400640 1 -- 172.21.15.162:0/208092378 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8013750 con 0x7f84f0005180 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.744+0000 7f8507400640 1 -- 172.21.15.162:0/208092378 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8013b00 con 0x7f84f0005180 2024-01-20T11:08:14.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.744+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85100c7580 con 0x7f84f0005180 2024-01-20T11:08:14.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.744+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85101f4400 con 0x7f84f0005180 2024-01-20T11:08:14.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.745+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85100cf790 con 0x7f84f0005180 2024-01-20T11:08:14.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.746+0000 7f8507400640 1 -- 172.21.15.162:0/208092378 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f84f8013c60 con 0x7f84f0005180 2024-01-20T11:08:14.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.747+0000 7f8507400640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f84e806aed0 0x7f84e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:14.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.747+0000 7f8507400640 1 -- 172.21.15.162:0/208092378 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84f8089430 con 0x7f84f0005180 2024-01-20T11:08:14.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.747+0000 7f850ea00640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f84e806aed0 0x7f84e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:14.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.748+0000 7f850ea00640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f84e806aed0 0x7f84e806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85000018e0 tx=0x7f8500009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:14.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.751+0000 7f8507400640 1 -- 172.21.15.162:0/208092378 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f84f8054260 con 0x7f84f0005180 2024-01-20T11:08:14.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.944+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f851006d3e0 con 0x7f84f0005180 2024-01-20T11:08:14.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.945+0000 7f8507400640 1 -- 172.21.15.162:0/208092378 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84f8057880 con 0x7f84f0005180 2024-01-20T11:08:14.946 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:14.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f84e806aed0 msgr2=0x7f84e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f84e806aed0 0x7f84e806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85000018e0 tx=0x7f8500009040 comp rx=0 tx=0).stop 2024-01-20T11:08:14.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 msgr2=0x7f8510152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:14.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f8510152b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84f800e460 tx=0x7f84f800e920 comp rx=0 tx=0).stop 2024-01-20T11:08:14.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 shutdown_connections 2024-01-20T11:08:14.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f84e806aed0 0x7f84e806d390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85101600a0 0x7f85101f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85101f7510 0x7f851015fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 --2- 172.21.15.162:0/208092378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0005180 0x7f8510152b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:14.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 >> 172.21.15.162:0/208092378 conn(0x7f851008afe0 msgr2=0x7f85100b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:14.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.948+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 shutdown_connections 2024-01-20T11:08:14.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:14.949+0000 7f8516000640 1 -- 172.21.15.162:0/208092378 wait complete. 2024-01-20T11:08:14.968 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.183+0000 7f318ba00640 1 Processor -- start 2024-01-20T11:08:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.183+0000 7f318ba00640 1 -- start start 2024-01-20T11:08:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f318ba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f31840b2040 0x7f318415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f318ba00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31840cf060 0x7f31840cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f318ba00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31840b2ec0 con 0x7f318415a380 2024-01-20T11:08:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f318ba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3184070eb0 con 0x7f31840b2040 2024-01-20T11:08:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f318ba00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318415ee30 con 0x7f31840cf060 2024-01-20T11:08:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f3189000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f318415a380 0x7f31840707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48308/0 (socket says 172.21.15.162:48308) 2024-01-20T11:08:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f3189000640 1 -- 172.21.15.162:0/2558091865 learned_addr learned my addr 172.21.15.162:0/2558091865 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.185+0000 7f317bc00640 1 --2- 172.21.15.162:0/2558091865 >> v2:172.21.15.162:3300/0 conn(0x7f31840b2040 0x7f318415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.186+0000 7f3189a00640 1 --2- 172.21.15.162:0/2558091865 >> v2:172.21.15.179:3300/0 conn(0x7f31840cf060 0x7f31840cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.186+0000 7f3183e00640 1 -- 172.21.15.162:0/2558091865 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934651287 0 0) 0x7f3174001110 con 0x7f318415a380 2024-01-20T11:08:15.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.186+0000 7f3183e00640 1 -- 172.21.15.162:0/2558091865 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3164003520 con 0x7f318415a380 2024-01-20T11:08:15.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.186+0000 7f317bc00640 1 -- 172.21.15.162:0/2558091865 >> v2:172.21.15.179:3300/0 conn(0x7f31840cf060 msgr2=0x7f31840cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:15.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.186+0000 7f317bc00640 1 --2- 172.21.15.162:0/2558091865 >> v2:172.21.15.179:3300/0 conn(0x7f31840cf060 0x7f31840cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.186+0000 7f317bc00640 1 -- 172.21.15.162:0/2558091865 >> v1:172.21.15.162:6789/0 conn(0x7f318415a380 legacy=0x7f31840707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.186+0000 7f317bc00640 1 -- 172.21.15.162:0/2558091865 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840cf9f0 con 0x7f31840b2040 2024-01-20T11:08:15.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.187+0000 7f317bc00640 1 --2- 172.21.15.162:0/2558091865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31840b2040 0x7f318415e8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f318406e8d0 tx=0x7f316c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fa31aad5bff866 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:15.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.187+0000 7f3183e00640 1 -- 172.21.15.162:0/2558091865 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c02e070 con 0x7f31840b2040 2024-01-20T11:08:15.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.187+0000 7f3183e00640 1 -- 172.21.15.162:0/2558091865 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c0315a0 con 0x7f31840b2040 2024-01-20T11:08:15.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.187+0000 7f3183e00640 1 -- 172.21.15.162:0/2558091865 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c031930 con 0x7f31840b2040 2024-01-20T11:08:15.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 -- 172.21.15.162:0/2558091865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31840b2040 msgr2=0x7f318415e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 --2- 172.21.15.162:0/2558091865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31840b2040 0x7f318415e8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f318406e8d0 tx=0x7f316c02b840 comp rx=0 tx=0).stop 2024-01-20T11:08:15.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 -- 172.21.15.162:0/2558091865 shutdown_connections 2024-01-20T11:08:15.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 --2- 172.21.15.162:0/2558091865 >> v2:172.21.15.179:3300/0 conn(0x7f31840cf060 0x7f31840cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 --2- 172.21.15.162:0/2558091865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31840b2040 0x7f318415e8f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 -- 172.21.15.162:0/2558091865 >> 172.21.15.162:0/2558091865 conn(0x7f318406a600 msgr2=0x7f318406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:15.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 -- 172.21.15.162:0/2558091865 shutdown_connections 2024-01-20T11:08:15.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.188+0000 7f318ba00640 1 -- 172.21.15.162:0/2558091865 wait complete. 2024-01-20T11:08:15.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.190+0000 7f318ba00640 1 Processor -- start 2024-01-20T11:08:15.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.190+0000 7f318ba00640 1 -- start start 2024-01-20T11:08:15.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f318ba00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840b2040 0x7f3184167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f318ba00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31840cf060 0x7f3184166280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f318ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f318415a380 0x7f318415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f318ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318414cf30 con 0x7f318415a380 2024-01-20T11:08:15.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f318ba00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841667c0 con 0x7f31840b2040 2024-01-20T11:08:15.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f318ba00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3184167570 con 0x7f31840cf060 2024-01-20T11:08:15.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f3189a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f318415a380 0x7f318415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f3189a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f318415a380 0x7f318415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60296/0 (socket says 172.21.15.162:60296) 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f3189a00640 1 -- 172.21.15.162:0/2844674559 learned_addr learned my addr 172.21.15.162:0/2844674559 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.191+0000 7f3189000640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840b2040 0x7f3184167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f317bc00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31840cf060 0x7f3184166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3189a00640 1 -- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31840cf060 msgr2=0x7f3184166280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3189a00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31840cf060 0x7f3184166280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3189a00640 1 -- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840b2040 msgr2=0x7f3184167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3189a00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840b2040 0x7f3184167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3189a00640 1 -- 172.21.15.162:0/2844674559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c009400 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3189000640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840b2040 0x7f3184167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f317bc00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31840cf060 0x7f3184166280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3189a00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f318415a380 0x7f318415cba0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f317c007e40 tx=0x7f317c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3181600640 1 -- 172.21.15.162:0/2844674559 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c014620 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3181600640 1 -- 172.21.15.162:0/2844674559 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c00ee90 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f3181600640 1 -- 172.21.15.162:0/2844674559 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0149e0 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31841669f0 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.192+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3184166fb0 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.193+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318414d0a0 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.194+0000 7f3181600640 1 -- 172.21.15.162:0/2844674559 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f317c014b40 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.195+0000 7f3181600640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f315c06aed0 0x7f315c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.195+0000 7f3181600640 1 -- 172.21.15.162:0/2844674559 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f317c08a050 con 0x7f318415a380 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.195+0000 7f3189000640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f315c06aed0 0x7f315c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.196+0000 7f3189000640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f315c06aed0 0x7f315c06d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3174001270 tx=0x7f3174009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:15.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.199+0000 7f3181600640 1 -- 172.21.15.162:0/2844674559 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f317c054f20 con 0x7f318415a380 2024-01-20T11:08:15.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.389+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f318404e970 con 0x7f318415a380 2024-01-20T11:08:15.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.390+0000 7f3181600640 1 -- 172.21.15.162:0/2844674559 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f317c058540 con 0x7f318415a380 2024-01-20T11:08:15.391 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:15.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f315c06aed0 msgr2=0x7f315c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f315c06aed0 0x7f315c06d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3174001270 tx=0x7f3174009040 comp rx=0 tx=0).stop 2024-01-20T11:08:15.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f318415a380 msgr2=0x7f318415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f318415a380 0x7f318415cba0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f317c007e40 tx=0x7f317c00e4b0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 shutdown_connections 2024-01-20T11:08:15.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f318415a380 0x7f318415cba0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31840cf060 0x7f3184166280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.393+0000 7f318ba00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f315c06aed0 0x7f315c06d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.394+0000 7f318ba00640 1 --2- 172.21.15.162:0/2844674559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840b2040 0x7f3184167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.394+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 >> 172.21.15.162:0/2844674559 conn(0x7f318406a600 msgr2=0x7f3184157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:15.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.394+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 shutdown_connections 2024-01-20T11:08:15.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.394+0000 7f318ba00640 1 -- 172.21.15.162:0/2844674559 wait complete. 2024-01-20T11:08:15.413 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T11:08:15.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.620+0000 7f2e72e00640 1 Processor -- start 2024-01-20T11:08:15.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.620+0000 7f2e72e00640 1 -- start start 2024-01-20T11:08:15.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.621+0000 7f2e72e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e6c0d16d0 0x7f2e6c0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.621+0000 7f2e72e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c0ce230 con 0x7f2e6c15da10 2024-01-20T11:08:15.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.621+0000 7f2e72e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c0ce500 con 0x7f2e6c15d630 2024-01-20T11:08:15.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.621+0000 7f2e72e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c0ce7e0 con 0x7f2e6c0d16d0 2024-01-20T11:08:15.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.622+0000 7f2e6b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e6c0d16d0 0x7f2e6c0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.622+0000 7f2e70e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2e6c15da10 0x7f2e6c06bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48320/0 (socket says 172.21.15.162:48320) 2024-01-20T11:08:15.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.622+0000 7f2e70e00640 1 -- 172.21.15.162:0/680860174 learned_addr learned my addr 172.21.15.162:0/680860174 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:15.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.622+0000 7f2e6b400640 1 -- 172.21.15.162:0/680860174 >> v1:172.21.15.179:6789/0 conn(0x7f2e6c15d630 legacy=0x7f2e6c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:15.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.622+0000 7f2e6b400640 1 -- 172.21.15.162:0/680860174 >> v1:172.21.15.162:6789/0 conn(0x7f2e6c15da10 legacy=0x7f2e6c06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.622+0000 7f2e6b400640 1 -- 172.21.15.162:0/680860174 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0ceac0 con 0x7f2e6c0d16d0 2024-01-20T11:08:15.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.623+0000 7f2e6b400640 1 --2- 172.21.15.162:0/680860174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c0cfc00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009dc0 tx=0x7f2e5c02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ef5c8ad18d536a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:15.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.623+0000 7f2e6aa00640 1 -- 172.21.15.162:0/680860174 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c02cc40 con 0x7f2e6c0d16d0 2024-01-20T11:08:15.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.623+0000 7f2e6aa00640 1 -- 172.21.15.162:0/680860174 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c02cda0 con 0x7f2e6c0d16d0 2024-01-20T11:08:15.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.623+0000 7f2e6aa00640 1 -- 172.21.15.162:0/680860174 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c034660 con 0x7f2e6c0d16d0 2024-01-20T11:08:15.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.624+0000 7f2e72e00640 1 -- 172.21.15.162:0/680860174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c0d16d0 msgr2=0x7f2e6c0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.624+0000 7f2e72e00640 1 --2- 172.21.15.162:0/680860174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c0cfc00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009dc0 tx=0x7f2e5c02be90 comp rx=0 tx=0).stop 2024-01-20T11:08:15.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.624+0000 7f2e72e00640 1 -- 172.21.15.162:0/680860174 shutdown_connections 2024-01-20T11:08:15.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.624+0000 7f2e72e00640 1 --2- 172.21.15.162:0/680860174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c0cfc00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.624+0000 7f2e72e00640 1 -- 172.21.15.162:0/680860174 >> 172.21.15.162:0/680860174 conn(0x7f2e6c08afe0 msgr2=0x7f2e6c09c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:15.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.624+0000 7f2e72e00640 1 -- 172.21.15.162:0/680860174 shutdown_connections 2024-01-20T11:08:15.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.624+0000 7f2e72e00640 1 -- 172.21.15.162:0/680860174 wait complete. 2024-01-20T11:08:15.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.626+0000 7f2e72e00640 1 Processor -- start 2024-01-20T11:08:15.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.627+0000 7f2e72e00640 1 -- start start 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e72e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c1f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e72e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c15d630 0x7f2e6c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e72e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6c15da10 0x7f2e6c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e72e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0c7000 con 0x7f2e6c15d630 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e72e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1f38d0 con 0x7f2e6c0d16d0 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e72e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0c7250 con 0x7f2e6c15da10 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e6b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c15d630 0x7f2e6c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e6b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c15d630 0x7f2e6c0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60314/0 (socket says 172.21.15.162:60314) 2024-01-20T11:08:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.628+0000 7f2e6b400640 1 -- 172.21.15.162:0/3460464713 learned_addr learned my addr 172.21.15.162:0/3460464713 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e70e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6c15da10 0x7f2e6c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6be00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c1f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6b400640 1 -- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6c15da10 msgr2=0x7f2e6c157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6b400640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6c15da10 0x7f2e6c157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6b400640 1 -- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e6c0d16d0 msgr2=0x7f2e6c1f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6b400640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c1f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6b400640 1 -- 172.21.15.162:0/3460464713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009a70 con 0x7f2e6c15d630 2024-01-20T11:08:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6be00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c1f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e6b400640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c15d630 0x7f2e6c0b60f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c000f80 tx=0x7f2e5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e63e00640 1 -- 172.21.15.162:0/3460464713 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c03e610 con 0x7f2e6c15d630 2024-01-20T11:08:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e63e00640 1 -- 172.21.15.162:0/3460464713 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c03e770 con 0x7f2e6c15d630 2024-01-20T11:08:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e63e00640 1 -- 172.21.15.162:0/3460464713 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c03eb20 con 0x7f2e6c15d630 2024-01-20T11:08:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.629+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c0c7530 con 0x7f2e6c15d630 2024-01-20T11:08:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.630+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c0c7af0 con 0x7f2e6c15d630 2024-01-20T11:08:15.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.631+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c0cf790 con 0x7f2e6c15d630 2024-01-20T11:08:15.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.632+0000 7f2e63e00640 1 -- 172.21.15.162:0/3460464713 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2e5c03b050 con 0x7f2e6c15d630 2024-01-20T11:08:15.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.632+0000 7f2e63e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4406aed0 0x7f2e4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:15.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.632+0000 7f2e63e00640 1 -- 172.21.15.162:0/3460464713 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e5c0ac270 con 0x7f2e6c15d630 2024-01-20T11:08:15.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.633+0000 7f2e6be00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4406aed0 0x7f2e4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:15.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.633+0000 7f2e6be00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4406aed0 0x7f2e4406d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003eb0 tx=0x7f2e54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:15.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.637+0000 7f2e63e00640 1 -- 172.21.15.162:0/3460464713 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2e5c0771c0 con 0x7f2e6c15d630 2024-01-20T11:08:15.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.845+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e6c067b70 con 0x7f2e6c15d630 2024-01-20T11:08:15.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.846+0000 7f2e63e00640 1 -- 172.21.15.162:0/3460464713 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e5c07a7e0 con 0x7f2e6c15d630 2024-01-20T11:08:15.846 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4406aed0 msgr2=0x7f2e4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4406aed0 0x7f2e4406d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003eb0 tx=0x7f2e54009040 comp rx=0 tx=0).stop 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c15d630 msgr2=0x7f2e6c0b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c15d630 0x7f2e6c0b60f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c000f80 tx=0x7f2e5c004a40 comp rx=0 tx=0).stop 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 shutdown_connections 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6c15da10 0x7f2e6c157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e6c15d630 0x7f2e6c0b60f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4406aed0 0x7f2e4406d390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 --2- 172.21.15.162:0/3460464713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e6c0d16d0 0x7f2e6c1f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 >> 172.21.15.162:0/3460464713 conn(0x7f2e6c08afe0 msgr2=0x7f2e6c0d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 shutdown_connections 2024-01-20T11:08:15.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:15.849+0000 7f2e72e00640 1 -- 172.21.15.162:0/3460464713 wait complete. 2024-01-20T11:08:15.869 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-20T11:08:15.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:15.869 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-20T11:08:15.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:08:15.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:15.969 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T11:08:16.022 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:08:16.022 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:16.081 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:08:16.082 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:16.137 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:08:16.137 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:16.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:16.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.405+0000 7fbad3e00640 1 Processor -- start 2024-01-20T11:08:16.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.406+0000 7fbad3e00640 1 -- start start 2024-01-20T11:08:16.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.407+0000 7fbad3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbad40cba40 0x7fbad40c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.407+0000 7fbad3e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad40666d0 0x7fbad406e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.407+0000 7fbad3e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40cda30 con 0x7fbad415dc70 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.407+0000 7fbad3e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad406f3b0 con 0x7fbad40cba40 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.407+0000 7fbad3e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad406f0d0 con 0x7fbad40666d0 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbad40cba40 0x7fbad40c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad3400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbad415dc70 0x7fbad40cdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:48332/0 (socket says 172.21.15.162:48332) 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad3400640 1 -- 172.21.15.162:0/736496079 learned_addr learned my addr 172.21.15.162:0/736496079 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbac9e00640 1 --2- 172.21.15.162:0/736496079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad40666d0 0x7fbad406e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad2a00640 1 -- 172.21.15.162:0/736496079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad40666d0 msgr2=0x7fbad406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad2a00640 1 --2- 172.21.15.162:0/736496079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad40666d0 0x7fbad406e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad2a00640 1 -- 172.21.15.162:0/736496079 >> v1:172.21.15.162:6789/0 conn(0x7fbad415dc70 legacy=0x7fbad40cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad2a00640 1 -- 172.21.15.162:0/736496079 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40cd3e0 con 0x7fbad40cba40 2024-01-20T11:08:16.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.408+0000 7fbad2000640 1 -- 172.21.15.162:0/736496079 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823718191 0 0) 0x7fbad40cda30 con 0x7fbad415dc70 2024-01-20T11:08:16.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.409+0000 7fbad2a00640 1 --2- 172.21.15.162:0/736496079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40cba40 0x7fbad40c9cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009d90 tx=0x7fbac402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71acc8a846cb822 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:16.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad2000640 1 -- 172.21.15.162:0/736496079 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac402cb30 con 0x7fbad40cba40 2024-01-20T11:08:16.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad2000640 1 -- 172.21.15.162:0/736496079 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac402cc90 con 0x7fbad40cba40 2024-01-20T11:08:16.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad2000640 1 -- 172.21.15.162:0/736496079 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4034440 con 0x7fbad40cba40 2024-01-20T11:08:16.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 -- 172.21.15.162:0/736496079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40cba40 msgr2=0x7fbad40c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 --2- 172.21.15.162:0/736496079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40cba40 0x7fbad40c9cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009d90 tx=0x7fbac402bd80 comp rx=0 tx=0).stop 2024-01-20T11:08:16.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 -- 172.21.15.162:0/736496079 shutdown_connections 2024-01-20T11:08:16.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 --2- 172.21.15.162:0/736496079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad40666d0 0x7fbad406e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 --2- 172.21.15.162:0/736496079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40cba40 0x7fbad40c9cc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 -- 172.21.15.162:0/736496079 >> 172.21.15.162:0/736496079 conn(0x7fbad40cc0f0 msgr2=0x7fbad40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:16.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 -- 172.21.15.162:0/736496079 shutdown_connections 2024-01-20T11:08:16.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.410+0000 7fbad3e00640 1 -- 172.21.15.162:0/736496079 wait complete. 2024-01-20T11:08:16.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.412+0000 7fbad3e00640 1 Processor -- start 2024-01-20T11:08:16.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.412+0000 7fbad3e00640 1 -- start start 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40666d0 0x7fbad40b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad3e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad40cba40 0x7fbad40c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad3e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad415dc70 0x7fbad414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40b49e0 con 0x7fbad40666d0 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad3e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad414f3b0 con 0x7fbad40cba40 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad3e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad414e7e0 con 0x7fbad415dc70 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40666d0 0x7fbad40b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40666d0 0x7fbad40b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60342/0 (socket says 172.21.15.162:60342) 2024-01-20T11:08:16.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.413+0000 7fbad2a00640 1 -- 172.21.15.162:0/3868386164 learned_addr learned my addr 172.21.15.162:0/3868386164 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:16.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbad2a00640 1 -- 172.21.15.162:0/3868386164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad415dc70 msgr2=0x7fbad414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbad2a00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad415dc70 0x7fbad414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbad2a00640 1 -- 172.21.15.162:0/3868386164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad40cba40 msgr2=0x7fbad40c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbad2a00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad40cba40 0x7fbad40c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbad2a00640 1 -- 172.21.15.162:0/3868386164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4009a70 con 0x7fbad40666d0 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbad2a00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40666d0 0x7fbad40b44a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009d90 tx=0x7fbac4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbacb400640 1 -- 172.21.15.162:0/3868386164 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4034440 con 0x7fbad40666d0 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbacb400640 1 -- 172.21.15.162:0/3868386164 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4040660 con 0x7fbad40666d0 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad414ea80 con 0x7fbad40666d0 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.414+0000 7fbacb400640 1 -- 172.21.15.162:0/3868386164 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4040a10 con 0x7fbad40666d0 2024-01-20T11:08:16.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.415+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad414f040 con 0x7fbad40666d0 2024-01-20T11:08:16.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.416+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad4074a30 con 0x7fbad40666d0 2024-01-20T11:08:16.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.417+0000 7fbacb400640 1 -- 172.21.15.162:0/3868386164 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbac4040b70 con 0x7fbad40666d0 2024-01-20T11:08:16.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.418+0000 7fbacb400640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbaac06af00 0x7fbaac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.418+0000 7fbacb400640 1 -- 172.21.15.162:0/3868386164 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbac40ac440 con 0x7fbad40666d0 2024-01-20T11:08:16.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.418+0000 7fbac9e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbaac06af00 0x7fbaac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.419+0000 7fbac9e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbaac06af00 0x7fbaac06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006fd0 tx=0x7fbabc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:16.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.422+0000 7fbacb400640 1 -- 172.21.15.162:0/3868386164 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbac40774c0 con 0x7fbad40666d0 2024-01-20T11:08:16.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.615+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbad4066360 con 0x7fbad40666d0 2024-01-20T11:08:16.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.618+0000 7fbacb400640 1 -- 172.21.15.162:0/3868386164 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fbac407aae0 con 0x7fbad40666d0 2024-01-20T11:08:16.619 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:16.619 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":22,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:07:33.479574+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:16.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.620+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbaac06af00 msgr2=0x7fbaac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.620+0000 7fbad3e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbaac06af00 0x7fbaac06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006fd0 tx=0x7fbabc008040 comp rx=0 tx=0).stop 2024-01-20T11:08:16.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.620+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40666d0 msgr2=0x7fbad40b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.620+0000 7fbad3e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40666d0 0x7fbad40b44a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009d90 tx=0x7fbac4004a40 comp rx=0 tx=0).stop 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 shutdown_connections 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad415dc70 0x7fbad414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbaac06af00 0x7fbaac06d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad40cba40 0x7fbad40c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 --2- 172.21.15.162:0/3868386164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbad40666d0 0x7fbad40b44a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 >> 172.21.15.162:0/3868386164 conn(0x7fbad40cc0f0 msgr2=0x7fbad40b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 shutdown_connections 2024-01-20T11:08:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.621+0000 7fbad3e00640 1 -- 172.21.15.162:0/3868386164 wait complete. 2024-01-20T11:08:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:16.642 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:16.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.855+0000 7f4244000640 1 Processor -- start 2024-01-20T11:08:16.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.855+0000 7f4244000640 1 -- start start 2024-01-20T11:08:16.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4244000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c15d630 0x7f423c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4244000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f423c0ce060 0x7f423c06bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4244000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c0ce500 con 0x7f423c0d16d0 2024-01-20T11:08:16.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4244000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c0ce7e0 con 0x7f423c0ce060 2024-01-20T11:08:16.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4244000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0ceac0 con 0x7f423c15d630 2024-01-20T11:08:16.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4240c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f423c0d16d0 0x7f423c0cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44890/0 (socket says 172.21.15.162:44890) 2024-01-20T11:08:16.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4240c00640 1 -- 172.21.15.162:0/240309375 learned_addr learned my addr 172.21.15.162:0/240309375 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:16.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.857+0000 7f4242000640 1 --2- 172.21.15.162:0/240309375 >> v2:172.21.15.162:3300/0 conn(0x7f423c0ce060 0x7f423c06bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.858+0000 7f4241600640 1 --2- 172.21.15.162:0/240309375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c15d630 0x7f423c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.858+0000 7f423be00640 1 -- 172.21.15.162:0/240309375 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583806208 0 0) 0x7f423c0ce500 con 0x7f423c0d16d0 2024-01-20T11:08:16.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.858+0000 7f423be00640 1 -- 172.21.15.162:0/240309375 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f421c003520 con 0x7f423c0d16d0 2024-01-20T11:08:16.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.858+0000 7f4242000640 1 -- 172.21.15.162:0/240309375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c15d630 msgr2=0x7f423c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:16.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.858+0000 7f4242000640 1 --2- 172.21.15.162:0/240309375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c15d630 0x7f423c0cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.858+0000 7f4242000640 1 -- 172.21.15.162:0/240309375 >> v1:172.21.15.162:6789/0 conn(0x7f423c0d16d0 legacy=0x7f423c0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.858+0000 7f4242000640 1 -- 172.21.15.162:0/240309375 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0ceda0 con 0x7f423c0ce060 2024-01-20T11:08:16.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.859+0000 7f4242000640 1 --2- 172.21.15.162:0/240309375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0ce060 0x7f423c06bd00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4234009d90 tx=0x7f423402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1f7008d56bc1a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:16.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.859+0000 7f423be00640 1 -- 172.21.15.162:0/240309375 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423402cc60 con 0x7f423c0ce060 2024-01-20T11:08:16.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f423be00640 1 -- 172.21.15.162:0/240309375 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423402cdc0 con 0x7f423c0ce060 2024-01-20T11:08:16.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f423be00640 1 -- 172.21.15.162:0/240309375 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234034660 con 0x7f423c0ce060 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 -- 172.21.15.162:0/240309375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0ce060 msgr2=0x7f423c06bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 --2- 172.21.15.162:0/240309375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0ce060 0x7f423c06bd00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4234009d90 tx=0x7f423402beb0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 -- 172.21.15.162:0/240309375 shutdown_connections 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 --2- 172.21.15.162:0/240309375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0ce060 0x7f423c06bd00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 --2- 172.21.15.162:0/240309375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c15d630 0x7f423c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 -- 172.21.15.162:0/240309375 >> 172.21.15.162:0/240309375 conn(0x7f423c08afe0 msgr2=0x7f423c09c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 -- 172.21.15.162:0/240309375 shutdown_connections 2024-01-20T11:08:16.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.860+0000 7f4244000640 1 -- 172.21.15.162:0/240309375 wait complete. 2024-01-20T11:08:16.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.862+0000 7f4244000640 1 Processor -- start 2024-01-20T11:08:16.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.862+0000 7f4244000640 1 -- start start 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.863+0000 7f4244000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c0ce060 0x7f423c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.863+0000 7f4244000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0d16d0 0x7f423c0d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.863+0000 7f4244000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f423c15d630 0x7f423c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.863+0000 7f4244000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0d3bd0 con 0x7f423c0d16d0 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.863+0000 7f4244000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0d3330 con 0x7f423c15d630 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.863+0000 7f4244000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0d3610 con 0x7f423c0ce060 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.863+0000 7f4240c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0d16d0 0x7f423c0d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0d16d0 0x7f423c0d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34568/0 (socket says 172.21.15.162:34568) 2024-01-20T11:08:16.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 -- 172.21.15.162:0/2603075357 learned_addr learned my addr 172.21.15.162:0/2603075357 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4241600640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c0ce060 0x7f423c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4242000640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f423c15d630 0x7f423c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 -- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c0ce060 msgr2=0x7f423c153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c0ce060 0x7f423c153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 -- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f423c15d630 msgr2=0x7f423c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f423c15d630 0x7f423c0c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 -- 172.21.15.162:0/2603075357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234009a70 con 0x7f423c0d16d0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4240c00640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0d16d0 0x7f423c0d2b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f422400c430 tx=0x7f422400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.864+0000 7f4239600640 1 -- 172.21.15.162:0/2603075357 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224005ce0 con 0x7f423c0d16d0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.865+0000 7f4239600640 1 -- 172.21.15.162:0/2603075357 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224005e40 con 0x7f423c0d16d0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.865+0000 7f4239600640 1 -- 172.21.15.162:0/2603075357 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240072f0 con 0x7f423c0d16d0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.865+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c0d38f0 con 0x7f423c0d16d0 2024-01-20T11:08:16.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.865+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c0d3040 con 0x7f423c0d16d0 2024-01-20T11:08:16.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.866+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c0cf790 con 0x7f423c0d16d0 2024-01-20T11:08:16.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.867+0000 7f4239600640 1 -- 172.21.15.162:0/2603075357 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4224007450 con 0x7f423c0d16d0 2024-01-20T11:08:16.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.867+0000 7f4239600640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f421406aed0 0x7f421406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:16.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.868+0000 7f4239600640 1 -- 172.21.15.162:0/2603075357 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4224088d80 con 0x7f423c0d16d0 2024-01-20T11:08:16.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.868+0000 7f4241600640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f421406aed0 0x7f421406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:16.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.868+0000 7f4241600640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f421406aed0 0x7f421406d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f422c006fd0 tx=0x7f422c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:16.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:16.872+0000 7f4239600640 1 -- 172.21.15.162:0/2603075357 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4224053bb0 con 0x7f423c0d16d0 2024-01-20T11:08:17.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.063+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f423c0b2f30 con 0x7f423c0d16d0 2024-01-20T11:08:17.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.064+0000 7f4239600640 1 -- 172.21.15.162:0/2603075357 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f423c0b2f30 con 0x7f423c0d16d0 2024-01-20T11:08:17.064 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:17.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f421406aed0 msgr2=0x7f421406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f421406aed0 0x7f421406d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f422c006fd0 tx=0x7f422c008040 comp rx=0 tx=0).stop 2024-01-20T11:08:17.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0d16d0 msgr2=0x7f423c0d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0d16d0 0x7f423c0d2b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f422400c430 tx=0x7f422400c8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 shutdown_connections 2024-01-20T11:08:17.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f421406aed0 0x7f421406d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f423c15d630 0x7f423c0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423c0d16d0 0x7f423c0d2b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 --2- 172.21.15.162:0/2603075357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423c0ce060 0x7f423c153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 >> 172.21.15.162:0/2603075357 conn(0x7f423c08afe0 msgr2=0x7f423c0b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:17.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.066+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 shutdown_connections 2024-01-20T11:08:17.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.067+0000 7f4244000640 1 -- 172.21.15.162:0/2603075357 wait complete. 2024-01-20T11:08:17.085 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:17.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.291+0000 7f7966a00640 1 Processor -- start 2024-01-20T11:08:17.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.291+0000 7f7966a00640 1 -- start start 2024-01-20T11:08:17.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.292+0000 7f7966a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 0x7f7960070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.292+0000 7f7966a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79600cd300 con 0x7f79600cfb30 2024-01-20T11:08:17.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.292+0000 7f7966a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79600cc9d0 con 0x7f79600b3ad0 2024-01-20T11:08:17.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.292+0000 7f7966a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600cccb0 con 0x7f7960143c70 2024-01-20T11:08:17.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.293+0000 7f7966000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f79600cfb30 0x7f79600cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44902/0 (socket says 172.21.15.162:44902) 2024-01-20T11:08:17.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.293+0000 7f7966000640 1 -- 172.21.15.162:0/431072041 learned_addr learned my addr 172.21.15.162:0/431072041 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.293+0000 7f7965600640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 0x7f7960070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.293+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932391845 0 0) 0x7f79600cd300 con 0x7f79600cfb30 2024-01-20T11:08:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.293+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7940003520 con 0x7f79600cfb30 2024-01-20T11:08:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 35081873 0 0) 0x7f7940003520 con 0x7f79600cfb30 2024-01-20T11:08:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 msgr2=0x7f7960070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 0x7f7960070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 >> v1:172.21.15.179:6789/0 conn(0x7f79600b3ad0 legacy=0x7f79600cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600ccf90 con 0x7f79600cfb30 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f79580019f0 con 0x7f79600cfb30 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 >> v1:172.21.15.162:6789/0 conn(0x7f79600cfb30 legacy=0x7f79600cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 0x7f79400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940003f20 0x7f79400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940004d00 0x7f7940005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600cccb0 con 0x7f7940004d00 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794000ba60 con 0x7f7940003f20 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794000bc20 con 0x7f7960143c70 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f7966000640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940004d00 0x7f7940005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.294+0000 7f7964c00640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940003f20 0x7f79400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.295+0000 7f7965600640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 0x7f79400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.295+0000 7f7966000640 1 -- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 msgr2=0x7f79400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:17.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.295+0000 7f7966000640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7960143c70 0x7f79400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.295+0000 7f7966000640 1 -- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940003f20 msgr2=0x7f79400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:17.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.295+0000 7f7966000640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940003f20 0x7f79400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.295+0000 7f7966000640 1 -- 172.21.15.162:0/431072041 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940003520 con 0x7f7940004d00 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.296+0000 7f7966000640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940004d00 0x7f7940005180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f795800a800 tx=0x7f79400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f238929477602705 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.296+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580072d0 con 0x7f7940004d00 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.296+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795802f070 con 0x7f7940004d00 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.296+0000 7f795fe00640 1 -- 172.21.15.162:0/431072041 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580076f0 con 0x7f7940004d00 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.296+0000 7f7966a00640 1 -- 172.21.15.162:0/431072041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940004d00 msgr2=0x7f7940005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.296+0000 7f7966a00640 1 --2- 172.21.15.162:0/431072041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940004d00 0x7f7940005180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f795800a800 tx=0x7f79400057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.297+0000 7f7966000640 1 -- 172.21.15.162:0/431072041 reap_dead start 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.297+0000 7f7966a00640 1 -- 172.21.15.162:0/431072041 shutdown_connections 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.297+0000 7f7966a00640 1 -- 172.21.15.162:0/431072041 >> 172.21.15.162:0/431072041 conn(0x7f796006aa20 msgr2=0x7f796006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.297+0000 7f7966a00640 1 -- 172.21.15.162:0/431072041 shutdown_connections 2024-01-20T11:08:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.297+0000 7f7966a00640 1 -- 172.21.15.162:0/431072041 wait complete. 2024-01-20T11:08:17.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.298+0000 7f7966a00640 1 Processor -- start 2024-01-20T11:08:17.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.299+0000 7f7966a00640 1 -- start start 2024-01-20T11:08:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.299+0000 7f7966a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940004d00 0x7f79601400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.299+0000 7f7966a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796012f250 0x7f7960141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.299+0000 7f7966a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796013d190 0x7f796012e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7966a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960142130 con 0x7f796012f250 2024-01-20T11:08:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7966a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796013fc10 con 0x7f7940004d00 2024-01-20T11:08:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7966a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7960156a20 con 0x7f796013d190 2024-01-20T11:08:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796012f250 0x7f7960141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796012f250 0x7f7960141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34590/0 (socket says 172.21.15.162:34590) 2024-01-20T11:08:17.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 -- 172.21.15.162:0/1398117009 learned_addr learned my addr 172.21.15.162:0/1398117009 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 -- 172.21.15.162:0/1398117009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796013d190 msgr2=0x7f796012e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796013d190 0x7f796012e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 -- 172.21.15.162:0/1398117009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940004d00 msgr2=0x7f79601400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940004d00 0x7f79601400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 -- 172.21.15.162:0/1398117009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600b40b0 con 0x7f796012f250 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.300+0000 7f7964c00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796012f250 0x7f7960141bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f794800e580 tx=0x7f794800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.301+0000 7f795d600640 1 -- 172.21.15.162:0/1398117009 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480052e0 con 0x7f796012f250 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.301+0000 7f795d600640 1 -- 172.21.15.162:0/1398117009 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948005440 con 0x7f796012f250 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.301+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7960156d00 con 0x7f796012f250 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.301+0000 7f795d600640 1 -- 172.21.15.162:0/1398117009 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948003810 con 0x7f796012f250 2024-01-20T11:08:17.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.301+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796013f8a0 con 0x7f796012f250 2024-01-20T11:08:17.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.302+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7960074a30 con 0x7f796012f250 2024-01-20T11:08:17.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.303+0000 7f795d600640 1 -- 172.21.15.162:0/1398117009 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7948003970 con 0x7f796012f250 2024-01-20T11:08:17.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.304+0000 7f795d600640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f793806aed0 0x7f793806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.304+0000 7f795d600640 1 -- 172.21.15.162:0/1398117009 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79480892e0 con 0x7f796012f250 2024-01-20T11:08:17.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.304+0000 7f7965600640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f793806aed0 0x7f793806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.305+0000 7f7965600640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f793806aed0 0x7f793806d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7950009910 tx=0x7f7950008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:17.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.308+0000 7f795d600640 1 -- 172.21.15.162:0/1398117009 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f79480541c0 con 0x7f796012f250 2024-01-20T11:08:17.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.501+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f796013fd50 con 0x7f796012f250 2024-01-20T11:08:17.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.502+0000 7f795d600640 1 -- 172.21.15.162:0/1398117009 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f796013fd50 con 0x7f796012f250 2024-01-20T11:08:17.503 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f793806aed0 msgr2=0x7f793806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f793806aed0 0x7f793806d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7950009910 tx=0x7f7950008040 comp rx=0 tx=0).stop 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796012f250 msgr2=0x7f7960141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796012f250 0x7f7960141bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f794800e580 tx=0x7f794800ea40 comp rx=0 tx=0).stop 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 shutdown_connections 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796013d190 0x7f796012e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796012f250 0x7f7960141bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f793806aed0 0x7f793806d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 --2- 172.21.15.162:0/1398117009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7940004d00 0x7f79601400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 >> 172.21.15.162:0/1398117009 conn(0x7f796006aa20 msgr2=0x7f79600aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:17.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 shutdown_connections 2024-01-20T11:08:17.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.505+0000 7f7966a00640 1 -- 172.21.15.162:0/1398117009 wait complete. 2024-01-20T11:08:17.524 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:17.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.736+0000 7f9369800640 1 Processor -- start 2024-01-20T11:08:17.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.736+0000 7f9369800640 1 -- start start 2024-01-20T11:08:17.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9369800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9364141bb0 0x7f93640ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9369800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f93640ce6a0 0x7f936406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9369800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93640cee70 con 0x7f93640cdc30 2024-01-20T11:08:17.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9369800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640cd7a0 con 0x7f93640ce6a0 2024-01-20T11:08:17.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9369800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640ceb90 con 0x7f9364141bb0 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9362000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f93640ce6a0 0x7f936406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9362000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f93640ce6a0 0x7f936406c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34592/0 (socket says 172.21.15.162:34592) 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9362000640 1 -- 172.21.15.162:0/655650169 learned_addr learned my addr 172.21.15.162:0/655650169 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9362a00640 1 --2- 172.21.15.162:0/655650169 >> v2:172.21.15.179:3300/0 conn(0x7f9364141bb0 0x7f93640ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9362000640 1 -- 172.21.15.162:0/655650169 >> v2:172.21.15.179:3300/0 conn(0x7f9364141bb0 msgr2=0x7f93640ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.738+0000 7f9362000640 1 --2- 172.21.15.162:0/655650169 >> v2:172.21.15.179:3300/0 conn(0x7f9364141bb0 0x7f93640ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.739+0000 7f9362000640 1 -- 172.21.15.162:0/655650169 >> v1:172.21.15.179:6789/0 conn(0x7f93640cdc30 legacy=0x7f936415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:17.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.739+0000 7f9362000640 1 -- 172.21.15.162:0/655650169 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640cd150 con 0x7f93640ce6a0 2024-01-20T11:08:17.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.740+0000 7f9362000640 1 --2- 172.21.15.162:0/655650169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f936406c6e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93640ccea0 tx=0x7f934c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecf9fa3c6b5c4b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:17.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.740+0000 7f9361600640 1 -- 172.21.15.162:0/655650169 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0317e0 con 0x7f93640ce6a0 2024-01-20T11:08:17.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.740+0000 7f9361600640 1 -- 172.21.15.162:0/655650169 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c031940 con 0x7f93640ce6a0 2024-01-20T11:08:17.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.740+0000 7f9361600640 1 -- 172.21.15.162:0/655650169 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c031cd0 con 0x7f93640ce6a0 2024-01-20T11:08:17.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 -- 172.21.15.162:0/655650169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 msgr2=0x7f936406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 --2- 172.21.15.162:0/655650169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f936406c6e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93640ccea0 tx=0x7f934c02b880 comp rx=0 tx=0).stop 2024-01-20T11:08:17.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 -- 172.21.15.162:0/655650169 shutdown_connections 2024-01-20T11:08:17.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 --2- 172.21.15.162:0/655650169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f936406c6e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 --2- 172.21.15.162:0/655650169 >> v2:172.21.15.179:3300/0 conn(0x7f9364141bb0 0x7f93640ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 -- 172.21.15.162:0/655650169 >> 172.21.15.162:0/655650169 conn(0x7f936406a600 msgr2=0x7f936406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:17.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 -- 172.21.15.162:0/655650169 shutdown_connections 2024-01-20T11:08:17.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.741+0000 7f9369800640 1 -- 172.21.15.162:0/655650169 wait complete. 2024-01-20T11:08:17.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.743+0000 7f9369800640 1 Processor -- start 2024-01-20T11:08:17.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.743+0000 7f9369800640 1 -- start start 2024-01-20T11:08:17.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9369800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93640cdc30 0x7f9364138f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9369800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f93641397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9369800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9364141bb0 0x7f93641f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9369800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9364139d10 con 0x7f93640ce6a0 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9369800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9364139f00 con 0x7f93640cdc30 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9369800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936413a1e0 con 0x7f9364141bb0 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f93641397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f93641397d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34600/0 (socket says 172.21.15.162:34600) 2024-01-20T11:08:17.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 -- 172.21.15.162:0/1322846655 learned_addr learned my addr 172.21.15.162:0/1322846655 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 -- 172.21.15.162:0/1322846655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9364141bb0 msgr2=0x7f93641f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9364141bb0 0x7f93641f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 -- 172.21.15.162:0/1322846655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93640cdc30 msgr2=0x7f9364138f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93640cdc30 0x7f9364138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.744+0000 7f9362000640 1 -- 172.21.15.162:0/1322846655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0094d0 con 0x7f93640ce6a0 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.745+0000 7f9362000640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f93641397d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f934c02b8c0 tx=0x7f934c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.745+0000 7f935aa00640 1 -- 172.21.15.162:0/1322846655 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0329c0 con 0x7f93640ce6a0 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.745+0000 7f935aa00640 1 -- 172.21.15.162:0/1322846655 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c032b40 con 0x7f93640ce6a0 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.745+0000 7f935aa00640 1 -- 172.21.15.162:0/1322846655 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0453f0 con 0x7f93640ce6a0 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.745+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936413a4c0 con 0x7f93640ce6a0 2024-01-20T11:08:17.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.745+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936413aa80 con 0x7f93640ce6a0 2024-01-20T11:08:17.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.746+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936413ac70 con 0x7f93640ce6a0 2024-01-20T11:08:17.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.747+0000 7f935aa00640 1 -- 172.21.15.162:0/1322846655 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f934c04d3f0 con 0x7f93640ce6a0 2024-01-20T11:08:17.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.748+0000 7f935aa00640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f933c06aed0 0x7f933c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:17.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.748+0000 7f935aa00640 1 -- 172.21.15.162:0/1322846655 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f934c0ab430 con 0x7f93640ce6a0 2024-01-20T11:08:17.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.748+0000 7f9362a00640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f933c06aed0 0x7f933c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:17.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.749+0000 7f9362a00640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f933c06aed0 0x7f933c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9364141210 tx=0x7f9354008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:17.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.753+0000 7f935aa00640 1 -- 172.21.15.162:0/1322846655 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f934c076260 con 0x7f93640ce6a0 2024-01-20T11:08:17.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.952+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93640cee70 con 0x7f93640ce6a0 2024-01-20T11:08:17.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.953+0000 7f935aa00640 1 -- 172.21.15.162:0/1322846655 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93640cee70 con 0x7f93640ce6a0 2024-01-20T11:08:17.953 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f933c06aed0 msgr2=0x7f933c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f933c06aed0 0x7f933c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9364141210 tx=0x7f9354008040 comp rx=0 tx=0).stop 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 msgr2=0x7f93641397d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f93641397d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f934c02b8c0 tx=0x7f934c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 shutdown_connections 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9364141bb0 0x7f93641f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93640ce6a0 0x7f93641397d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f933c06aed0 0x7f933c06d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 --2- 172.21.15.162:0/1322846655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93640cdc30 0x7f9364138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 >> 172.21.15.162:0/1322846655 conn(0x7f936406a600 msgr2=0x7f936415bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 shutdown_connections 2024-01-20T11:08:17.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:17.956+0000 7f9369800640 1 -- 172.21.15.162:0/1322846655 wait complete. 2024-01-20T11:08:17.976 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T11:08:18.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.184+0000 7ff922400640 1 Processor -- start 2024-01-20T11:08:18.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.184+0000 7ff922400640 1 -- start start 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff922400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff91c144a10 0x7ff91c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff922400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff922400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91c071830 con 0x7ff91c0cd880 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff922400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c070c20 con 0x7ff91c144a10 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff922400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c070f00 con 0x7ff91c071cc0 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff921000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff91c144a10 0x7ff91c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff921a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff91c0cd880 0x7ff91c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44910/0 (socket says 172.21.15.162:44910) 2024-01-20T11:08:18.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.186+0000 7ff921a00640 1 -- 172.21.15.162:0/3298760015 learned_addr learned my addr 172.21.15.162:0/3298760015 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:18.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.187+0000 7ff91be00640 1 --2- 172.21.15.162:0/3298760015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.187+0000 7ff921000640 1 -- 172.21.15.162:0/3298760015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 msgr2=0x7ff91c0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:18.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.187+0000 7ff921000640 1 --2- 172.21.15.162:0/3298760015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c0703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.187+0000 7ff921000640 1 -- 172.21.15.162:0/3298760015 >> v1:172.21.15.162:6789/0 conn(0x7ff91c0cd880 legacy=0x7ff91c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.187+0000 7ff921000640 1 -- 172.21.15.162:0/3298760015 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0711e0 con 0x7ff91c144a10 2024-01-20T11:08:18.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.187+0000 7ff91b400640 1 -- 172.21.15.162:0/3298760015 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042098225 0 0) 0x7ff91c071830 con 0x7ff91c0cd880 2024-01-20T11:08:18.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.188+0000 7ff921000640 1 --2- 172.21.15.162:0/3298760015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c144a10 0x7ff91c0ce950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0097a0 tx=0x7ff90c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce87c5aead6ad447 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:18.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.188+0000 7ff91b400640 1 -- 172.21.15.162:0/3298760015 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c02d040 con 0x7ff91c144a10 2024-01-20T11:08:18.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff91b400640 1 -- 172.21.15.162:0/3298760015 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c031810 con 0x7ff91c144a10 2024-01-20T11:08:18.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff91b400640 1 -- 172.21.15.162:0/3298760015 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c031ba0 con 0x7ff91c144a10 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 -- 172.21.15.162:0/3298760015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c144a10 msgr2=0x7ff91c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 --2- 172.21.15.162:0/3298760015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c144a10 0x7ff91c0ce950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0097a0 tx=0x7ff90c02b8b0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 -- 172.21.15.162:0/3298760015 shutdown_connections 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 --2- 172.21.15.162:0/3298760015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c0703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 --2- 172.21.15.162:0/3298760015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c144a10 0x7ff91c0ce950 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 -- 172.21.15.162:0/3298760015 >> 172.21.15.162:0/3298760015 conn(0x7ff91c0b0c40 msgr2=0x7ff91c0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 -- 172.21.15.162:0/3298760015 shutdown_connections 2024-01-20T11:08:18.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.189+0000 7ff922400640 1 -- 172.21.15.162:0/3298760015 wait complete. 2024-01-20T11:08:18.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.191+0000 7ff922400640 1 Processor -- start 2024-01-20T11:08:18.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.191+0000 7ff922400640 1 -- start start 2024-01-20T11:08:18.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.192+0000 7ff922400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c13d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.192+0000 7ff922400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0cd880 0x7ff91c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.192+0000 7ff922400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff91c144a10 0x7ff91c1e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.192+0000 7ff922400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c1e3f40 con 0x7ff91c0cd880 2024-01-20T11:08:18.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.192+0000 7ff922400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c15cfa0 con 0x7ff91c144a10 2024-01-20T11:08:18.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.192+0000 7ff922400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c15d280 con 0x7ff91c071cc0 2024-01-20T11:08:18.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.192+0000 7ff91be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0cd880 0x7ff91c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0cd880 0x7ff91c15c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34628/0 (socket says 172.21.15.162:34628) 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 -- 172.21.15.162:0/3150266173 learned_addr learned my addr 172.21.15.162:0/3150266173 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff921000640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c13d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff921a00640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff91c144a10 0x7ff91c1e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 -- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 msgr2=0x7ff91c13d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c13d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 -- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff91c144a10 msgr2=0x7ff91c1e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff91c144a10 0x7ff91c1e6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 -- 172.21.15.162:0/3150266173 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c009400 con 0x7ff91c0cd880 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff921a00640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff91c144a10 0x7ff91c1e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.193+0000 7ff91be00640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0cd880 0x7ff91c15c670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d800 tx=0x7ff90400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.194+0000 7ff918c00640 1 -- 172.21.15.162:0/3150266173 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90400b6c0 con 0x7ff91c0cd880 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.194+0000 7ff918c00640 1 -- 172.21.15.162:0/3150266173 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90400b820 con 0x7ff91c0cd880 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.194+0000 7ff918c00640 1 -- 172.21.15.162:0/3150266173 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90400bbb0 con 0x7ff91c0cd880 2024-01-20T11:08:18.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.194+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c15d560 con 0x7ff91c0cd880 2024-01-20T11:08:18.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.194+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c13de80 con 0x7ff91c0cd880 2024-01-20T11:08:18.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.195+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c067b70 con 0x7ff91c0cd880 2024-01-20T11:08:18.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.196+0000 7ff918c00640 1 -- 172.21.15.162:0/3150266173 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff90400bd10 con 0x7ff91c0cd880 2024-01-20T11:08:18.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.197+0000 7ff918c00640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff8f406aed0 0x7ff8f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.197+0000 7ff918c00640 1 -- 172.21.15.162:0/3150266173 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff904089c00 con 0x7ff91c0cd880 2024-01-20T11:08:18.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.197+0000 7ff921000640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff8f406aed0 0x7ff8f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.198+0000 7ff921000640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff8f406aed0 0x7ff8f406d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff90c036000 tx=0x7ff90c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:18.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.201+0000 7ff918c00640 1 -- 172.21.15.162:0/3150266173 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff904054a30 con 0x7ff91c0cd880 2024-01-20T11:08:18.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.408+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff91c074a30 con 0x7ff91c0cd880 2024-01-20T11:08:18.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.408+0000 7ff918c00640 1 -- 172.21.15.162:0/3150266173 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff904058050 con 0x7ff91c0cd880 2024-01-20T11:08:18.409 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-01-20T11:08:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff8f406aed0 msgr2=0x7ff8f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff8f406aed0 0x7ff8f406d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff90c036000 tx=0x7ff90c008030 comp rx=0 tx=0).stop 2024-01-20T11:08:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0cd880 msgr2=0x7ff91c15c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0cd880 0x7ff91c15c670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d800 tx=0x7ff90400dcc0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 shutdown_connections 2024-01-20T11:08:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff8f406aed0 0x7ff8f406d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff91c144a10 0x7ff91c1e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0cd880 0x7ff91c15c670 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 --2- 172.21.15.162:0/3150266173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff91c071cc0 0x7ff91c13d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.411+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 >> 172.21.15.162:0/3150266173 conn(0x7ff91c0b0c40 msgr2=0x7ff91c0af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.412+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 shutdown_connections 2024-01-20T11:08:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.412+0000 7ff922400640 1 -- 172.21.15.162:0/3150266173 wait complete. 2024-01-20T11:08:18.431 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T11:08:18.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:18.432 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-20T11:08:18.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:08:18.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:18.537 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T11:08:18.586 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:08:18.586 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:18.639 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:08:18.639 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:18.684 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:08:18.684 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:18.779 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:18.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.983+0000 7fd058e00640 1 Processor -- start 2024-01-20T11:08:18.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.983+0000 7fd058e00640 1 -- start start 2024-01-20T11:08:18.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd058e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd0540cf3f0 0x7fd0540cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd058e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 0x7fd0540b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd058e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540b43c0 con 0x7fd0541579b0 2024-01-20T11:08:18.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd058e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0540cfde0 con 0x7fd0540cf3f0 2024-01-20T11:08:18.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd058e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05406c690 con 0x7fd0540b2220 2024-01-20T11:08:18.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd04be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd0540cf3f0 0x7fd0540cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd04be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd0540cf3f0 0x7fd0540cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34630/0 (socket says 172.21.15.162:34630) 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd04be00640 1 -- 172.21.15.162:0/2962670936 learned_addr learned my addr 172.21.15.162:0/2962670936 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd053400640 1 --1- 172.21.15.162:0/2962670936 >> v1:172.21.15.162:6789/0 conn(0x7fd0541579b0 0x7fd0540b3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44924/0 (socket says 172.21.15.162:44924) 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd053e00640 1 --2- 172.21.15.162:0/2962670936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 0x7fd0540b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd04be00640 1 -- 172.21.15.162:0/2962670936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 msgr2=0x7fd0540b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd04be00640 1 --2- 172.21.15.162:0/2962670936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 0x7fd0540b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd04be00640 1 -- 172.21.15.162:0/2962670936 >> v1:172.21.15.162:6789/0 conn(0x7fd0541579b0 legacy=0x7fd0540b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.985+0000 7fd04be00640 1 -- 172.21.15.162:0/2962670936 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05406c930 con 0x7fd0540cf3f0 2024-01-20T11:08:18.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.987+0000 7fd04be00640 1 --2- 172.21.15.162:0/2962670936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0540cf3f0 0x7fd0540cf8a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009870 tx=0x7fd03c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1e5763a57fee14 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:18.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.987+0000 7fd052a00640 1 -- 172.21.15.162:0/2962670936 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c030840 con 0x7fd0540cf3f0 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.987+0000 7fd052a00640 1 -- 172.21.15.162:0/2962670936 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c0309a0 con 0x7fd0540cf3f0 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.987+0000 7fd052a00640 1 -- 172.21.15.162:0/2962670936 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c030d30 con 0x7fd0540cf3f0 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.987+0000 7fd058e00640 1 -- 172.21.15.162:0/2962670936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0540cf3f0 msgr2=0x7fd0540cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.987+0000 7fd058e00640 1 --2- 172.21.15.162:0/2962670936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0540cf3f0 0x7fd0540cf8a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009870 tx=0x7fd03c02b980 comp rx=0 tx=0).stop 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.988+0000 7fd058e00640 1 -- 172.21.15.162:0/2962670936 shutdown_connections 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.988+0000 7fd058e00640 1 --2- 172.21.15.162:0/2962670936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 0x7fd0540b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.988+0000 7fd058e00640 1 --2- 172.21.15.162:0/2962670936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0540cf3f0 0x7fd0540cf8a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.988+0000 7fd058e00640 1 -- 172.21.15.162:0/2962670936 >> 172.21.15.162:0/2962670936 conn(0x7fd05406a600 msgr2=0x7fd05406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.988+0000 7fd058e00640 1 -- 172.21.15.162:0/2962670936 shutdown_connections 2024-01-20T11:08:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.988+0000 7fd058e00640 1 -- 172.21.15.162:0/2962670936 wait complete. 2024-01-20T11:08:18.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.989+0000 7fd058e00640 1 Processor -- start 2024-01-20T11:08:18.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.990+0000 7fd058e00640 1 -- start start 2024-01-20T11:08:18.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd058e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 0x7fd054151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd058e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0540cf3f0 0x7fd05415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd058e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0541579b0 0x7fd05413c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd058e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05413c1f0 con 0x7fd0541579b0 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd058e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0541558e0 con 0x7fd0540cf3f0 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd058e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd054150fb0 con 0x7fd0540b2220 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0541579b0 0x7fd05413c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0541579b0 0x7fd05413c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34634/0 (socket says 172.21.15.162:34634) 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 -- 172.21.15.162:0/2382199515 learned_addr learned my addr 172.21.15.162:0/2382199515 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 -- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 msgr2=0x7fd054151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 0x7fd054151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 -- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0540cf3f0 msgr2=0x7fd05415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd04be00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0540cf3f0 0x7fd05415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0540cf3f0 0x7fd05415fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd053e00640 1 -- 172.21.15.162:0/2382199515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c0094d0 con 0x7fd0541579b0 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.991+0000 7fd04be00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0540cf3f0 0x7fd05415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.992+0000 7fd053e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0541579b0 0x7fd05413c4b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd04c007e40 tx=0x7fd04c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.992+0000 7fd04b400640 1 -- 172.21.15.162:0/2382199515 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c014620 con 0x7fd0541579b0 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.992+0000 7fd04b400640 1 -- 172.21.15.162:0/2382199515 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c00ee90 con 0x7fd0541579b0 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.992+0000 7fd04b400640 1 -- 172.21.15.162:0/2382199515 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0149e0 con 0x7fd0541579b0 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.992+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd054151290 con 0x7fd0541579b0 2024-01-20T11:08:18.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.992+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd054155bc0 con 0x7fd0541579b0 2024-01-20T11:08:18.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.993+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd054074a30 con 0x7fd0541579b0 2024-01-20T11:08:18.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.994+0000 7fd04b400640 1 -- 172.21.15.162:0/2382199515 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd04c014b40 con 0x7fd0541579b0 2024-01-20T11:08:18.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.995+0000 7fd04b400640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd02c06aed0 0x7fd02c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:18.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.995+0000 7fd04b400640 1 -- 172.21.15.162:0/2382199515 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd04c08a170 con 0x7fd0541579b0 2024-01-20T11:08:18.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.995+0000 7fd053400640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd02c06aed0 0x7fd02c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:18.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:18.996+0000 7fd053400640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd02c06aed0 0x7fd02c06d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f60 tx=0x7fd044007a00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:19.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.000+0000 7fd04b400640 1 -- 172.21.15.162:0/2382199515 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd04c054f20 con 0x7fd0541579b0 2024-01-20T11:08:19.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.196+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0541517b0 con 0x7fd0541579b0 2024-01-20T11:08:19.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.198+0000 7fd04b400640 1 -- 172.21.15.162:0/2382199515 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16779 (secure 0 0 0) 0x7fd0541517b0 con 0x7fd0541579b0 2024-01-20T11:08:19.199 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:19.199 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":23,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:18.547710+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:19.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd02c06aed0 msgr2=0x7fd02c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd02c06aed0 0x7fd02c06d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f60 tx=0x7fd044007a00 comp rx=0 tx=0).stop 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0541579b0 msgr2=0x7fd05413c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0541579b0 0x7fd05413c4b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd04c007e40 tx=0x7fd04c00e4b0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 shutdown_connections 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0541579b0 0x7fd05413c4b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd02c06aed0 0x7fd02c06d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0540cf3f0 0x7fd05415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 --2- 172.21.15.162:0/2382199515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0540b2220 0x7fd054151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 >> 172.21.15.162:0/2382199515 conn(0x7fd05406a600 msgr2=0x7fd0540b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 shutdown_connections 2024-01-20T11:08:19.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.201+0000 7fd058e00640 1 -- 172.21.15.162:0/2382199515 wait complete. 2024-01-20T11:08:19.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:19.222 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:19.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.428+0000 7f1329c00640 1 Processor -- start 2024-01-20T11:08:19.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.428+0000 7f1329c00640 1 -- start start 2024-01-20T11:08:19.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f1329c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 0x7f13240ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f1329c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13240ce6a0 0x7f132406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f1329c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240cee70 con 0x7f13240cdc30 2024-01-20T11:08:19.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f1329c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240cd7a0 con 0x7f13240ce6a0 2024-01-20T11:08:19.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f1329c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240ceb90 con 0x7f1324141bb0 2024-01-20T11:08:19.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f1323400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f13240cdc30 0x7f132415f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44938/0 (socket says 172.21.15.162:44938) 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f1323400640 1 -- 172.21.15.162:0/2115959146 learned_addr learned my addr 172.21.15.162:0/2115959146 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.430+0000 7f131be00640 1 --2- 172.21.15.162:0/2115959146 >> v2:172.21.15.179:3300/0 conn(0x7f13240ce6a0 0x7f132406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f1322a00640 1 --2- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 0x7f13240ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f1322000640 1 -- 172.21.15.162:0/2115959146 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377492739 0 0) 0x7f131c001490 con 0x7f13240cdc30 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f1322000640 1 -- 172.21.15.162:0/2115959146 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1304003520 con 0x7f13240cdc30 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f131be00640 1 -- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 msgr2=0x7f13240ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f131be00640 1 --2- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 0x7f13240ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f1322000640 1 -- 172.21.15.162:0/2115959146 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811455846 0 0) 0x7f1304003520 con 0x7f13240cdc30 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f131be00640 1 -- 172.21.15.162:0/2115959146 >> v1:172.21.15.162:6789/0 conn(0x7f13240cdc30 legacy=0x7f132415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.431+0000 7f131be00640 1 -- 172.21.15.162:0/2115959146 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240cd150 con 0x7f13240ce6a0 2024-01-20T11:08:19.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.432+0000 7f131be00640 1 --2- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 0x7f132406c6e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097a0 tx=0x7f130c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fff646a7035bfb9c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:19.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.433+0000 7f1322000640 1 -- 172.21.15.162:0/2115959146 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c001b80 con 0x7f13240ce6a0 2024-01-20T11:08:19.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.433+0000 7f1322000640 1 -- 172.21.15.162:0/2115959146 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c02e050 con 0x7f13240ce6a0 2024-01-20T11:08:19.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.433+0000 7f1322000640 1 -- 172.21.15.162:0/2115959146 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c030710 con 0x7f13240ce6a0 2024-01-20T11:08:19.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.433+0000 7f1329c00640 1 -- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 msgr2=0x7f132406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.433+0000 7f1329c00640 1 --2- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 0x7f132406c6e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097a0 tx=0x7f130c02b710 comp rx=0 tx=0).stop 2024-01-20T11:08:19.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.434+0000 7f1329c00640 1 -- 172.21.15.162:0/2115959146 shutdown_connections 2024-01-20T11:08:19.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.434+0000 7f1329c00640 1 --2- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 0x7f132406c6e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.434+0000 7f1329c00640 1 --2- 172.21.15.162:0/2115959146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 0x7f13240ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.434+0000 7f1329c00640 1 -- 172.21.15.162:0/2115959146 >> 172.21.15.162:0/2115959146 conn(0x7f132406a600 msgr2=0x7f132406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:19.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.434+0000 7f1329c00640 1 -- 172.21.15.162:0/2115959146 shutdown_connections 2024-01-20T11:08:19.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.434+0000 7f1329c00640 1 -- 172.21.15.162:0/2115959146 wait complete. 2024-01-20T11:08:19.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.435+0000 7f1329c00640 1 Processor -- start 2024-01-20T11:08:19.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.436+0000 7f1329c00640 1 -- start start 2024-01-20T11:08:19.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.436+0000 7f1329c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13240cdc30 0x7f13241f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.436+0000 7f1329c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 0x7f13241f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.436+0000 7f1329c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 0x7f13240af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.436+0000 7f1329c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13241f4590 con 0x7f13240cdc30 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.436+0000 7f1329c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324159340 con 0x7f13240ce6a0 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.436+0000 7f1329c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1324159620 con 0x7f1324141bb0 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13240cdc30 0x7f13241f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13240cdc30 0x7f13241f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34642/0 (socket says 172.21.15.162:34642) 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 -- 172.21.15.162:0/2066012797 learned_addr learned my addr 172.21.15.162:0/2066012797 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 -- 172.21.15.162:0/2066012797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 msgr2=0x7f13240af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 0x7f13240af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f131be00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 0x7f13241f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 -- 172.21.15.162:0/2066012797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 msgr2=0x7f13241f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 0x7f13241f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.437+0000 7f1322a00640 1 -- 172.21.15.162:0/2066012797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009400 con 0x7f13240cdc30 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.438+0000 7f1322a00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13240cdc30 0x7f13241f11e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f131400e870 tx=0x7f131400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:19.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.438+0000 7f131aa00640 1 -- 172.21.15.162:0/2066012797 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140094f0 con 0x7f13240cdc30 2024-01-20T11:08:19.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.438+0000 7f131aa00640 1 -- 172.21.15.162:0/2066012797 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131400c940 con 0x7f13240cdc30 2024-01-20T11:08:19.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.438+0000 7f131aa00640 1 -- 172.21.15.162:0/2066012797 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131400ccf0 con 0x7f13240cdc30 2024-01-20T11:08:19.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.438+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1324159900 con 0x7f13240cdc30 2024-01-20T11:08:19.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.438+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1324159ec0 con 0x7f13240cdc30 2024-01-20T11:08:19.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.439+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132404e970 con 0x7f13240cdc30 2024-01-20T11:08:19.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.440+0000 7f131aa00640 1 -- 172.21.15.162:0/2066012797 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1314013470 con 0x7f13240cdc30 2024-01-20T11:08:19.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.441+0000 7f131aa00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f12fc06aed0 0x7f12fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.441+0000 7f131aa00640 1 -- 172.21.15.162:0/2066012797 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1314089880 con 0x7f13240cdc30 2024-01-20T11:08:19.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.441+0000 7f131be00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f12fc06aed0 0x7f12fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.442+0000 7f131be00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f12fc06aed0 0x7f12fc06d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f130c034000 tx=0x7f130c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:19.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.445+0000 7f131aa00640 1 -- 172.21.15.162:0/2066012797 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1314054650 con 0x7f13240cdc30 2024-01-20T11:08:19.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.649+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13240cff80 con 0x7f13240cdc30 2024-01-20T11:08:19.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.650+0000 7f131aa00640 1 -- 172.21.15.162:0/2066012797 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1314057c70 con 0x7f13240cdc30 2024-01-20T11:08:19.650 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:19.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f12fc06aed0 msgr2=0x7f12fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f12fc06aed0 0x7f12fc06d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f130c034000 tx=0x7f130c008030 comp rx=0 tx=0).stop 2024-01-20T11:08:19.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13240cdc30 msgr2=0x7f13241f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13240cdc30 0x7f13241f11e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f131400e870 tx=0x7f131400ed30 comp rx=0 tx=0).stop 2024-01-20T11:08:19.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 shutdown_connections 2024-01-20T11:08:19.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1324141bb0 0x7f13240af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f12fc06aed0 0x7f12fc06d390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13240ce6a0 0x7f13241f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 --2- 172.21.15.162:0/2066012797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13240cdc30 0x7f13241f11e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.652+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 >> 172.21.15.162:0/2066012797 conn(0x7f132406a600 msgr2=0x7f1324144340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:19.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.653+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 shutdown_connections 2024-01-20T11:08:19.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.653+0000 7f1329c00640 1 -- 172.21.15.162:0/2066012797 wait complete. 2024-01-20T11:08:19.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:19.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.880+0000 7ff195c00640 1 Processor -- start 2024-01-20T11:08:19.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.880+0000 7ff195c00640 1 -- start start 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff195c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff19013e380 0x7ff19015efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff195c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff19015f520 0x7ff19006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff195c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19013e760 con 0x7ff19006cb10 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff195c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19006d3a0 con 0x7ff19013e380 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff195c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1900ccc70 con 0x7ff19015f520 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff18ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff19013e380 0x7ff19015efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff18f400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff19006cb10 0x7ff190140c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44952/0 (socket says 172.21.15.162:44952) 2024-01-20T11:08:19.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.882+0000 7ff18f400640 1 -- 172.21.15.162:0/3066729225 learned_addr learned my addr 172.21.15.162:0/3066729225 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:19.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.883+0000 7ff185e00640 1 --2- 172.21.15.162:0/3066729225 >> v2:172.21.15.179:3300/0 conn(0x7ff19015f520 0x7ff19006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.883+0000 7ff18ea00640 1 -- 172.21.15.162:0/3066729225 >> v2:172.21.15.179:3300/0 conn(0x7ff19015f520 msgr2=0x7ff19006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:19.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.883+0000 7ff18ea00640 1 --2- 172.21.15.162:0/3066729225 >> v2:172.21.15.179:3300/0 conn(0x7ff19015f520 0x7ff19006c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.883+0000 7ff18ea00640 1 -- 172.21.15.162:0/3066729225 >> v1:172.21.15.162:6789/0 conn(0x7ff19006cb10 legacy=0x7ff190140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.883+0000 7ff18ea00640 1 -- 172.21.15.162:0/3066729225 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19013fa50 con 0x7ff19013e380 2024-01-20T11:08:19.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.883+0000 7ff18e000640 1 -- 172.21.15.162:0/3066729225 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032800142 0 0) 0x7ff19013e760 con 0x7ff19006cb10 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.884+0000 7ff18ea00640 1 --2- 172.21.15.162:0/3066729225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19013e380 0x7ff19015efe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff19006bf90 tx=0x7ff18002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac177659c05c086 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.884+0000 7ff18e000640 1 -- 172.21.15.162:0/3066729225 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180031830 con 0x7ff19013e380 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.884+0000 7ff18e000640 1 -- 172.21.15.162:0/3066729225 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180031990 con 0x7ff19013e380 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.884+0000 7ff18e000640 1 -- 172.21.15.162:0/3066729225 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180031d20 con 0x7ff19013e380 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 -- 172.21.15.162:0/3066729225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19013e380 msgr2=0x7ff19015efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 --2- 172.21.15.162:0/3066729225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19013e380 0x7ff19015efe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff19006bf90 tx=0x7ff18002b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 -- 172.21.15.162:0/3066729225 shutdown_connections 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 --2- 172.21.15.162:0/3066729225 >> v2:172.21.15.179:3300/0 conn(0x7ff19015f520 0x7ff19006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 --2- 172.21.15.162:0/3066729225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19013e380 0x7ff19015efe0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 -- 172.21.15.162:0/3066729225 >> 172.21.15.162:0/3066729225 conn(0x7ff19006a600 msgr2=0x7ff19006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 -- 172.21.15.162:0/3066729225 shutdown_connections 2024-01-20T11:08:19.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.885+0000 7ff195c00640 1 -- 172.21.15.162:0/3066729225 wait complete. 2024-01-20T11:08:19.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.887+0000 7ff195c00640 1 Processor -- start 2024-01-20T11:08:19.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.887+0000 7ff195c00640 1 -- start start 2024-01-20T11:08:19.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff195c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19006cb10 0x7ff190151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff195c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19013e380 0x7ff190070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff195c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19015f520 0x7ff1900c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff195c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900c4330 con 0x7ff19015f520 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff195c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff190151c40 con 0x7ff19006cb10 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff195c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff190071920 con 0x7ff19013e380 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff18f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19015f520 0x7ff1900c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff18f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19015f520 0x7ff1900c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34660/0 (socket says 172.21.15.162:34660) 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.888+0000 7ff18f400640 1 -- 172.21.15.162:0/1352568748 learned_addr learned my addr 172.21.15.162:0/1352568748 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18ea00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19006cb10 0x7ff190151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18f400640 1 -- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19013e380 msgr2=0x7ff190070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff185e00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19013e380 0x7ff190070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18f400640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19013e380 0x7ff190070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18f400640 1 -- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19006cb10 msgr2=0x7ff190151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18f400640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19006cb10 0x7ff190151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18f400640 1 -- 172.21.15.162:0/1352568748 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff180009400 con 0x7ff19015f520 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff185e00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19013e380 0x7ff190070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:19.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18ea00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19006cb10 0x7ff190151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:19.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff18f400640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19015f520 0x7ff1900c6570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c780 tx=0x7ff18800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:19.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.889+0000 7ff187400640 1 -- 172.21.15.162:0/1352568748 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18800ce90 con 0x7ff19015f520 2024-01-20T11:08:19.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.890+0000 7ff187400640 1 -- 172.21.15.162:0/1352568748 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18800a640 con 0x7ff19015f520 2024-01-20T11:08:19.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.890+0000 7ff187400640 1 -- 172.21.15.162:0/1352568748 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18800a9d0 con 0x7ff19015f520 2024-01-20T11:08:19.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.890+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff190071c00 con 0x7ff19015f520 2024-01-20T11:08:19.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.890+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff190071ee0 con 0x7ff19015f520 2024-01-20T11:08:19.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.891+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1900c44e0 con 0x7ff19015f520 2024-01-20T11:08:19.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.892+0000 7ff187400640 1 -- 172.21.15.162:0/1352568748 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff18800ab30 con 0x7ff19015f520 2024-01-20T11:08:19.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.893+0000 7ff187400640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff16806aed0 0x7ff16806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:19.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.893+0000 7ff187400640 1 -- 172.21.15.162:0/1352568748 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff188088c50 con 0x7ff19015f520 2024-01-20T11:08:19.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.893+0000 7ff18ea00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff16806aed0 0x7ff16806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:19.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.894+0000 7ff18ea00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff16806aed0 0x7ff16806d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff180036000 tx=0x7ff180008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:19.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:19.898+0000 7ff187400640 1 -- 172.21.15.162:0/1352568748 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff1900c44e0 con 0x7ff19015f520 2024-01-20T11:08:20.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.094+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff19004e970 con 0x7ff19015f520 2024-01-20T11:08:20.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.094+0000 7ff187400640 1 -- 172.21.15.162:0/1352568748 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff188018020 con 0x7ff19015f520 2024-01-20T11:08:20.095 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:20.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.097+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff16806aed0 msgr2=0x7ff16806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.097+0000 7ff195c00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff16806aed0 0x7ff16806d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff180036000 tx=0x7ff180008030 comp rx=0 tx=0).stop 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.097+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19015f520 msgr2=0x7ff1900c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.097+0000 7ff195c00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19015f520 0x7ff1900c6570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c780 tx=0x7ff18800cc40 comp rx=0 tx=0).stop 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.097+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 shutdown_connections 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.097+0000 7ff195c00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19015f520 0x7ff1900c6570 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.097+0000 7ff195c00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19013e380 0x7ff190070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.098+0000 7ff195c00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff16806aed0 0x7ff16806d390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.098+0000 7ff195c00640 1 --2- 172.21.15.162:0/1352568748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19006cb10 0x7ff190151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.098+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 >> 172.21.15.162:0/1352568748 conn(0x7ff19006a600 msgr2=0x7ff190152270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.098+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 shutdown_connections 2024-01-20T11:08:20.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.098+0000 7ff195c00640 1 -- 172.21.15.162:0/1352568748 wait complete. 2024-01-20T11:08:20.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:20.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.328+0000 7fc9bf000640 1 Processor -- start 2024-01-20T11:08:20.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.328+0000 7fc9bf000640 1 -- start start 2024-01-20T11:08:20.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.329+0000 7fc9bf000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9b815d5b0 0x7fc9b806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.329+0000 7fc9bf000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc9b81618e0 0x7fc9b8161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.329+0000 7fc9bf000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b80b2040 0x7fc9b80b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.329+0000 7fc9bf000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80ae130 con 0x7fc9b815d5b0 2024-01-20T11:08:20.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.329+0000 7fc9bf000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80ae410 con 0x7fc9b81618e0 2024-01-20T11:08:20.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.329+0000 7fc9bf000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80ae6f0 con 0x7fc9b80b2040 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9b815d5b0 0x7fc9b806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9b815d5b0 0x7fc9b806c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34662/0 (socket says 172.21.15.162:34662) 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 -- 172.21.15.162:0/2324803867 learned_addr learned my addr 172.21.15.162:0/2324803867 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7400640 1 --2- 172.21.15.162:0/2324803867 >> v2:172.21.15.179:3300/0 conn(0x7fc9b81618e0 0x7fc9b8161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 -- 172.21.15.162:0/2324803867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b80b2040 msgr2=0x7fc9b80b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 --2- 172.21.15.162:0/2324803867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b80b2040 0x7fc9b80b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 -- 172.21.15.162:0/2324803867 >> v2:172.21.15.179:3300/0 conn(0x7fc9b81618e0 msgr2=0x7fc9b8161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:20.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 --2- 172.21.15.162:0/2324803867 >> v2:172.21.15.179:3300/0 conn(0x7fc9b81618e0 0x7fc9b8161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7e00640 1 -- 172.21.15.162:0/2324803867 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b81613c0 con 0x7fc9b815d5b0 2024-01-20T11:08:20.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.330+0000 7fc9b7400640 1 --2- 172.21.15.162:0/2324803867 >> v2:172.21.15.179:3300/0 conn(0x7fc9b81618e0 0x7fc9b8161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:20.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.331+0000 7fc9b7e00640 1 --2- 172.21.15.162:0/2324803867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b815d5b0 0x7fc9b806c3b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9b81622f0 tx=0x7fc9a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dbb19b5b67bada server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:20.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9b6a00640 1 -- 172.21.15.162:0/2324803867 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8031640 con 0x7fc9b815d5b0 2024-01-20T11:08:20.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9b6a00640 1 -- 172.21.15.162:0/2324803867 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a80317a0 con 0x7fc9b815d5b0 2024-01-20T11:08:20.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9b6a00640 1 -- 172.21.15.162:0/2324803867 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8031b30 con 0x7fc9b815d5b0 2024-01-20T11:08:20.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9bf000640 1 -- 172.21.15.162:0/2324803867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b815d5b0 msgr2=0x7fc9b806c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9bf000640 1 --2- 172.21.15.162:0/2324803867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b815d5b0 0x7fc9b806c3b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9b81622f0 tx=0x7fc9a802b8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9bf000640 1 -- 172.21.15.162:0/2324803867 shutdown_connections 2024-01-20T11:08:20.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9bf000640 1 --2- 172.21.15.162:0/2324803867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b80b2040 0x7fc9b80b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9bf000640 1 --2- 172.21.15.162:0/2324803867 >> v2:172.21.15.179:3300/0 conn(0x7fc9b81618e0 0x7fc9b8161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9bf000640 1 --2- 172.21.15.162:0/2324803867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b815d5b0 0x7fc9b806c3b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.332+0000 7fc9bf000640 1 -- 172.21.15.162:0/2324803867 >> 172.21.15.162:0/2324803867 conn(0x7fc9b806a600 msgr2=0x7fc9b806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:20.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.333+0000 7fc9bf000640 1 -- 172.21.15.162:0/2324803867 shutdown_connections 2024-01-20T11:08:20.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.333+0000 7fc9bf000640 1 -- 172.21.15.162:0/2324803867 wait complete. 2024-01-20T11:08:20.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.334+0000 7fc9bf000640 1 Processor -- start 2024-01-20T11:08:20.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.334+0000 7fc9bf000640 1 -- start start 2024-01-20T11:08:20.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.335+0000 7fc9bf000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9b80b2040 0x7fc9b8159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.335+0000 7fc9bf000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b815d5b0 0x7fc9b81541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.335+0000 7fc9bf000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b81618e0 0x7fc9b8157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.335+0000 7fc9bf000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8158440 con 0x7fc9b81618e0 2024-01-20T11:08:20.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.335+0000 7fc9bf000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8154730 con 0x7fc9b80b2040 2024-01-20T11:08:20.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.335+0000 7fc9bf000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8157e90 con 0x7fc9b815d5b0 2024-01-20T11:08:20.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b81618e0 0x7fc9b8157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b81618e0 0x7fc9b8157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34668/0 (socket says 172.21.15.162:34668) 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 -- 172.21.15.162:0/925913864 learned_addr learned my addr 172.21.15.162:0/925913864 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9b7e00640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9b80b2040 0x7fc9b8159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9b7400640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b815d5b0 0x7fc9b81541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 -- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b815d5b0 msgr2=0x7fc9b81541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b815d5b0 0x7fc9b81541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 -- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9b80b2040 msgr2=0x7fc9b8159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9b80b2040 0x7fc9b8159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 -- 172.21.15.162:0/925913864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80094d0 con 0x7fc9b81618e0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.336+0000 7fc9bd000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b81618e0 0x7fc9b8157950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000b970 tx=0x7fc9b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.337+0000 7fc9afe00640 1 -- 172.21.15.162:0/925913864 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000cb40 con 0x7fc9b81618e0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.337+0000 7fc9afe00640 1 -- 172.21.15.162:0/925913864 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000ccc0 con 0x7fc9b81618e0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.337+0000 7fc9afe00640 1 -- 172.21.15.162:0/925913864 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0014680 con 0x7fc9b81618e0 2024-01-20T11:08:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.337+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b8158160 con 0x7fc9b81618e0 2024-01-20T11:08:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.337+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b80af030 con 0x7fc9b81618e0 2024-01-20T11:08:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.338+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b804e970 con 0x7fc9b81618e0 2024-01-20T11:08:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.339+0000 7fc9afe00640 1 -- 172.21.15.162:0/925913864 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc9b0007370 con 0x7fc9b81618e0 2024-01-20T11:08:20.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.340+0000 7fc9afe00640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc99006aed0 0x7fc99006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.340+0000 7fc9afe00640 1 -- 172.21.15.162:0/925913864 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc9b0089610 con 0x7fc9b81618e0 2024-01-20T11:08:20.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.340+0000 7fc9b7e00640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc99006aed0 0x7fc99006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.341+0000 7fc9b7e00640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc99006aed0 0x7fc99006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8036000 tx=0x7fc9a803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:20.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.344+0000 7fc9afe00640 1 -- 172.21.15.162:0/925913864 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc9b0054450 con 0x7fc9b81618e0 2024-01-20T11:08:20.542 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.542+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9b80ce100 con 0x7fc9b81618e0 2024-01-20T11:08:20.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.542+0000 7fc9afe00640 1 -- 172.21.15.162:0/925913864 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9b0057a70 con 0x7fc9b81618e0 2024-01-20T11:08:20.543 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:20.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.545+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc99006aed0 msgr2=0x7fc99006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.545+0000 7fc9bf000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc99006aed0 0x7fc99006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8036000 tx=0x7fc9a803c040 comp rx=0 tx=0).stop 2024-01-20T11:08:20.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.545+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b81618e0 msgr2=0x7fc9b8157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.545+0000 7fc9bf000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b81618e0 0x7fc9b8157950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000b970 tx=0x7fc9b000be30 comp rx=0 tx=0).stop 2024-01-20T11:08:20.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 shutdown_connections 2024-01-20T11:08:20.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9b81618e0 0x7fc9b8157950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9b815d5b0 0x7fc9b81541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc99006aed0 0x7fc99006d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 --2- 172.21.15.162:0/925913864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9b80b2040 0x7fc9b8159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 >> 172.21.15.162:0/925913864 conn(0x7fc9b806a600 msgr2=0x7fc9b80ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:20.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 shutdown_connections 2024-01-20T11:08:20.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.546+0000 7fc9bf000640 1 -- 172.21.15.162:0/925913864 wait complete. 2024-01-20T11:08:20.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T11:08:20.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.767+0000 7f3f86800640 1 Processor -- start 2024-01-20T11:08:20.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.767+0000 7f3f86800640 1 -- start start 2024-01-20T11:08:20.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f86800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f80143bd0 0x7f3f8015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f86800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8015ea60 con 0x7f3f8006dfe0 2024-01-20T11:08:20.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f86800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8015b610 con 0x7f3f80071c90 2024-01-20T11:08:20.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f86800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8015dc40 con 0x7f3f80143bd0 2024-01-20T11:08:20.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f84a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3f8006dfe0 0x7f3f80071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44968/0 (socket says 172.21.15.162:44968) 2024-01-20T11:08:20.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f84a00640 1 -- 172.21.15.162:0/224610075 learned_addr learned my addr 172.21.15.162:0/224610075 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485719404 0 0) 0x7f3f8015ea60 con 0x7f3f8006dfe0 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.769+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f60003520 con 0x7f3f8006dfe0 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f85400640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f80143bd0 0x7f3f8015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1241016978 0 0) 0x7f3f60003520 con 0x7f3f8006dfe0 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f80143bd0 msgr2=0x7f3f8015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f80143bd0 0x7f3f8015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 >> v1:172.21.15.179:6789/0 conn(0x7f3f80071c90 legacy=0x7f3f8015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8015de50 con 0x7f3f8006dfe0 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f3f68001670 con 0x7f3f8006dfe0 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 >> v1:172.21.15.162:6789/0 conn(0x7f3f8006dfe0 legacy=0x7f3f80071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600047c0 0x7f3f60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f80143bd0 0x7f3f60005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8015dc40 con 0x7f3f600039a0 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6000bb40 con 0x7f3f600047c0 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6000df10 con 0x7f3f80143bd0 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.770+0000 7f3f85400640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.771+0000 7f3f85400640 1 -- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f80143bd0 msgr2=0x7f3f60005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.771+0000 7f3f85400640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f80143bd0 0x7f3f60005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.771+0000 7f3f85400640 1 -- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600047c0 msgr2=0x7f3f60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.771+0000 7f3f84a00640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600047c0 0x7f3f60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.771+0000 7f3f85400640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600047c0 0x7f3f60004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.771+0000 7f3f85400640 1 -- 172.21.15.162:0/224610075 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60003520 con 0x7f3f600039a0 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.772+0000 7f3f85400640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f60003da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000ba30 tx=0x7f3f600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9584b47120b46093 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.772+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70033650 con 0x7f3f600039a0 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.772+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f700337b0 con 0x7f3f600039a0 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.772+0000 7f3f7fe00640 1 -- 172.21.15.162:0/224610075 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70033b40 con 0x7f3f600039a0 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.772+0000 7f3f86800640 1 -- 172.21.15.162:0/224610075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 msgr2=0x7f3f60003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.772+0000 7f3f86800640 1 --2- 172.21.15.162:0/224610075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f60003da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000ba30 tx=0x7f3f600057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.773+0000 7f3f85e00640 1 -- 172.21.15.162:0/224610075 reap_dead start 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.773+0000 7f3f86800640 1 -- 172.21.15.162:0/224610075 shutdown_connections 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.773+0000 7f3f86800640 1 -- 172.21.15.162:0/224610075 >> 172.21.15.162:0/224610075 conn(0x7f3f800b0c40 msgr2=0x7f3f800b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.773+0000 7f3f86800640 1 -- 172.21.15.162:0/224610075 shutdown_connections 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.773+0000 7f3f86800640 1 -- 172.21.15.162:0/224610075 wait complete. 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.774+0000 7f3f86800640 1 Processor -- start 2024-01-20T11:08:20.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.775+0000 7f3f86800640 1 -- start start 2024-01-20T11:08:20.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.775+0000 7f3f86800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f800ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.775+0000 7f3f86800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8013c8c0 0x7f3f801357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.775+0000 7f3f86800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f800b2cd0 0x7f3f800b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.775+0000 7f3f86800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800b3690 con 0x7f3f600039a0 2024-01-20T11:08:20.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.775+0000 7f3f86800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f80156380 con 0x7f3f8013c8c0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.775+0000 7f3f86800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f80135cf0 con 0x7f3f800b2cd0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f800ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f800ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34694/0 (socket says 172.21.15.162:34694) 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 -- 172.21.15.162:0/715155559 learned_addr learned my addr 172.21.15.162:0/715155559 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 -- 172.21.15.162:0/715155559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f800b2cd0 msgr2=0x7f3f800b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f800b2cd0 0x7f3f800b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 -- 172.21.15.162:0/715155559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8013c8c0 msgr2=0x7f3f801357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8013c8c0 0x7f3f801357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 -- 172.21.15.162:0/715155559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f800cee20 con 0x7f3f600039a0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.776+0000 7f3f85400640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f800ce840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3f7002bf00 tx=0x7f3f70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.777+0000 7f3f7d600640 1 -- 172.21.15.162:0/715155559 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70046600 con 0x7f3f600039a0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.777+0000 7f3f7d600640 1 -- 172.21.15.162:0/715155559 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70040070 con 0x7f3f600039a0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.777+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f800cf100 con 0x7f3f600039a0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.777+0000 7f3f7d600640 1 -- 172.21.15.162:0/715155559 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700469c0 con 0x7f3f600039a0 2024-01-20T11:08:20.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.777+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f800cf6c0 con 0x7f3f600039a0 2024-01-20T11:08:20.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.778+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f80074a30 con 0x7f3f600039a0 2024-01-20T11:08:20.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.779+0000 7f3f7d600640 1 -- 172.21.15.162:0/715155559 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3f7002f030 con 0x7f3f600039a0 2024-01-20T11:08:20.780 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.780+0000 7f3f7d600640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f5806aed0 0x7f3f5806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:20.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.780+0000 7f3f7d600640 1 -- 172.21.15.162:0/715155559 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3f700ab160 con 0x7f3f600039a0 2024-01-20T11:08:20.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.780+0000 7f3f84a00640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f5806aed0 0x7f3f5806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:20.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.781+0000 7f3f84a00640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f5806aed0 0x7f3f5806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f680017a0 tx=0x7f3f68009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:20.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.784+0000 7f3f7d600640 1 -- 172.21.15.162:0/715155559 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3f70075f20 con 0x7f3f600039a0 2024-01-20T11:08:20.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.992+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3f8006cb50 con 0x7f3f600039a0 2024-01-20T11:08:20.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.993+0000 7f3f7d600640 1 -- 172.21.15.162:0/715155559 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3f70033610 con 0x7f3f600039a0 2024-01-20T11:08:20.994 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-01-20T11:08:20.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f5806aed0 msgr2=0x7f3f5806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f5806aed0 0x7f3f5806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f680017a0 tx=0x7f3f68009040 comp rx=0 tx=0).stop 2024-01-20T11:08:20.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 msgr2=0x7f3f800ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:20.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f800ce840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3f7002bf00 tx=0x7f3f70004730 comp rx=0 tx=0).stop 2024-01-20T11:08:20.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 shutdown_connections 2024-01-20T11:08:20.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f800b2cd0 0x7f3f800b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f5806aed0 0x7f3f5806d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8013c8c0 0x7f3f801357b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 --2- 172.21.15.162:0/715155559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f600039a0 0x7f3f800ce840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:20.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.995+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 >> 172.21.15.162:0/715155559 conn(0x7f3f800b0c40 msgr2=0x7f3f8013ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:20.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.996+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 shutdown_connections 2024-01-20T11:08:20.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:20.996+0000 7f3f86800640 1 -- 172.21.15.162:0/715155559 wait complete. 2024-01-20T11:08:21.015 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-01-20T11:08:21.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:21.016 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-01-20T11:08:21.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:08:21.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:21.113 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-20T11:08:21.165 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:08:21.165 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:21.225 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:08:21.225 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:21.276 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:08:21.276 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:21.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:21.542 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.541+0000 7f5910000640 1 Processor -- start 2024-01-20T11:08:21.542 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.542+0000 7f5910000640 1 -- start start 2024-01-20T11:08:21.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.543+0000 7f5910000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f590815b300 0x7f59080ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.543+0000 7f5910000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590815b6e0 con 0x7f59080c8350 2024-01-20T11:08:21.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.543+0000 7f5910000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59080ce580 con 0x7f590806df10 2024-01-20T11:08:21.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.543+0000 7f5910000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5908162060 con 0x7f590815b300 2024-01-20T11:08:21.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.543+0000 7f590d600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f590815b300 0x7f59080ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.543+0000 7f590cc00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f59080c8350 0x7f5908161240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44974/0 (socket says 172.21.15.162:44974) 2024-01-20T11:08:21.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.543+0000 7f590cc00640 1 -- 172.21.15.162:0/2988790253 learned_addr learned my addr 172.21.15.162:0/2988790253 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:21.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.544+0000 7f5907e00640 1 -- 172.21.15.162:0/2988790253 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964468251 0 0) 0x7f590815b6e0 con 0x7f59080c8350 2024-01-20T11:08:21.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.544+0000 7f5907e00640 1 -- 172.21.15.162:0/2988790253 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e8003520 con 0x7f59080c8350 2024-01-20T11:08:21.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.544+0000 7f590d600640 1 -- 172.21.15.162:0/2988790253 >> v1:172.21.15.179:6789/0 conn(0x7f590806df10 legacy=0x7f5908161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:21.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.544+0000 7f590d600640 1 -- 172.21.15.162:0/2988790253 >> v1:172.21.15.162:6789/0 conn(0x7f59080c8350 legacy=0x7f5908161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.544+0000 7f590d600640 1 -- 172.21.15.162:0/2988790253 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59080cd6d0 con 0x7f590815b300 2024-01-20T11:08:21.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.545+0000 7f590d600640 1 --2- 172.21.15.162:0/2988790253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590815b300 0x7f59080ae4a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f58f80097a0 tx=0x7f58f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8182860dba55f8ca server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:21.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.545+0000 7f5907e00640 1 -- 172.21.15.162:0/2988790253 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8031830 con 0x7f590815b300 2024-01-20T11:08:21.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.545+0000 7f5907e00640 1 -- 172.21.15.162:0/2988790253 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8031990 con 0x7f590815b300 2024-01-20T11:08:21.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5907e00640 1 -- 172.21.15.162:0/2988790253 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8031d20 con 0x7f590815b300 2024-01-20T11:08:21.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5910000640 1 -- 172.21.15.162:0/2988790253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590815b300 msgr2=0x7f59080ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5910000640 1 --2- 172.21.15.162:0/2988790253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590815b300 0x7f59080ae4a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f58f80097a0 tx=0x7f58f802b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5910000640 1 -- 172.21.15.162:0/2988790253 shutdown_connections 2024-01-20T11:08:21.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5910000640 1 --2- 172.21.15.162:0/2988790253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590815b300 0x7f59080ae4a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5910000640 1 -- 172.21.15.162:0/2988790253 >> 172.21.15.162:0/2988790253 conn(0x7f59080b0cd0 msgr2=0x7f59080b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:21.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5910000640 1 -- 172.21.15.162:0/2988790253 shutdown_connections 2024-01-20T11:08:21.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.546+0000 7f5910000640 1 -- 172.21.15.162:0/2988790253 wait complete. 2024-01-20T11:08:21.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.548+0000 7f5910000640 1 Processor -- start 2024-01-20T11:08:21.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.548+0000 7f5910000640 1 -- start start 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f5910000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590806df10 0x7f59081f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f5910000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59080c8350 0x7f59080af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f5910000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590815b300 0x7f59080afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f5910000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59081f44a0 con 0x7f590806df10 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f5910000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59081f4930 con 0x7f59080c8350 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f5910000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59081f3890 con 0x7f590815b300 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f590d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590806df10 0x7f59081f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f590d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590806df10 0x7f59081f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34722/0 (socket says 172.21.15.162:34722) 2024-01-20T11:08:21.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.549+0000 7f590d600640 1 -- 172.21.15.162:0/3822051304 learned_addr learned my addr 172.21.15.162:0/3822051304 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f590cc00640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59080c8350 0x7f59080af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f590d600640 1 -- 172.21.15.162:0/3822051304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590815b300 msgr2=0x7f59080afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f590d600640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590815b300 0x7f59080afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f590d600640 1 -- 172.21.15.162:0/3822051304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59080c8350 msgr2=0x7f59080af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f590d600640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59080c8350 0x7f59080af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f590d600640 1 -- 172.21.15.162:0/3822051304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f8009400 con 0x7f590806df10 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f590d600640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590806df10 0x7f59081f64c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000c00 tx=0x7f58f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f5905600640 1 -- 172.21.15.162:0/3822051304 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f803a8f0 con 0x7f590806df10 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f5905600640 1 -- 172.21.15.162:0/3822051304 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f803aa50 con 0x7f590806df10 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.550+0000 7f5905600640 1 -- 172.21.15.162:0/3822051304 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f803ae00 con 0x7f590806df10 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.551+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59081f3b70 con 0x7f590806df10 2024-01-20T11:08:21.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.551+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59081f4130 con 0x7f590806df10 2024-01-20T11:08:21.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.552+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590804e970 con 0x7f590806df10 2024-01-20T11:08:21.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.553+0000 7f5905600640 1 -- 172.21.15.162:0/3822051304 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f58f804d450 con 0x7f590806df10 2024-01-20T11:08:21.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.553+0000 7f5905600640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f58e006af00 0x7f58e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.554+0000 7f5905600640 1 -- 172.21.15.162:0/3822051304 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f58f80ab710 con 0x7f590806df10 2024-01-20T11:08:21.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.554+0000 7f590cc00640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f58e006af00 0x7f58e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.554+0000 7f590cc00640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f58e006af00 0x7f58e006d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5908153260 tx=0x7f58f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:21.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.558+0000 7f5905600640 1 -- 172.21.15.162:0/3822051304 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f58f80764d0 con 0x7f590806df10 2024-01-20T11:08:21.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.752+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f590806caa0 con 0x7f590806df10 2024-01-20T11:08:21.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.754+0000 7f5905600640 1 -- 172.21.15.162:0/3822051304 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16779 (secure 0 0 0) 0x7f58f8035090 con 0x7f590806df10 2024-01-20T11:08:21.755 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:21.755 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":24,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:19.556914+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:21.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f58e006af00 msgr2=0x7f58e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f58e006af00 0x7f58e006d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5908153260 tx=0x7f58f0009040 comp rx=0 tx=0).stop 2024-01-20T11:08:21.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590806df10 msgr2=0x7f59081f64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590806df10 0x7f59081f64c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000c00 tx=0x7f58f80046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 shutdown_connections 2024-01-20T11:08:21.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590815b300 0x7f59080afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f58e006af00 0x7f58e006d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59080c8350 0x7f59080af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 --2- 172.21.15.162:0/3822051304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590806df10 0x7f59081f64c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 >> 172.21.15.162:0/3822051304 conn(0x7f59080b0cd0 msgr2=0x7f59080cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:21.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 shutdown_connections 2024-01-20T11:08:21.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.757+0000 7f5910000640 1 -- 172.21.15.162:0/3822051304 wait complete. 2024-01-20T11:08:21.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:21.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:21.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.976+0000 7ffb1ae00640 1 Processor -- start 2024-01-20T11:08:21.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.976+0000 7ffb1ae00640 1 -- start start 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb1ae00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb140d3200 0x7ffb140cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb1ae00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb1415d720 0x7ffb140d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb1ae00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb140d22f0 con 0x7ffb140d1000 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb1ae00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140d3b20 con 0x7ffb140d3200 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb1ae00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140d1d30 con 0x7ffb1415d720 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb19a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb140d3200 0x7ffb140cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb19a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb140d3200 0x7ffb140cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34724/0 (socket says 172.21.15.162:34724) 2024-01-20T11:08:21.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.978+0000 7ffb19a00640 1 -- 172.21.15.162:0/3973777060 learned_addr learned my addr 172.21.15.162:0/3973777060 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:21.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.979+0000 7ffb19000640 1 --2- 172.21.15.162:0/3973777060 >> v2:172.21.15.179:3300/0 conn(0x7ffb1415d720 0x7ffb140d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.979+0000 7ffb19a00640 1 -- 172.21.15.162:0/3973777060 >> v2:172.21.15.179:3300/0 conn(0x7ffb1415d720 msgr2=0x7ffb140d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:21.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.979+0000 7ffb19a00640 1 --2- 172.21.15.162:0/3973777060 >> v2:172.21.15.179:3300/0 conn(0x7ffb1415d720 0x7ffb140d35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.979+0000 7ffb19a00640 1 -- 172.21.15.162:0/3973777060 >> v1:172.21.15.179:6789/0 conn(0x7ffb140d1000 legacy=0x7ffb140d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:21.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.979+0000 7ffb19a00640 1 -- 172.21.15.162:0/3973777060 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb140d2010 con 0x7ffb140d3200 2024-01-20T11:08:21.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.980+0000 7ffb19a00640 1 --2- 172.21.15.162:0/3973777060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d3200 0x7ffb140cddf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb140d0d70 tx=0x7ffb0402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32ea339e90545e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:21.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.980+0000 7ffb13e00640 1 -- 172.21.15.162:0/3973777060 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0402ca80 con 0x7ffb140d3200 2024-01-20T11:08:21.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.980+0000 7ffb13e00640 1 -- 172.21.15.162:0/3973777060 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0402cbe0 con 0x7ffb140d3200 2024-01-20T11:08:21.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.980+0000 7ffb13e00640 1 -- 172.21.15.162:0/3973777060 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb040343f0 con 0x7ffb140d3200 2024-01-20T11:08:21.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 -- 172.21.15.162:0/3973777060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d3200 msgr2=0x7ffb140cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/3973777060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d3200 0x7ffb140cddf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb140d0d70 tx=0x7ffb0402bee0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 -- 172.21.15.162:0/3973777060 shutdown_connections 2024-01-20T11:08:21.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/3973777060 >> v2:172.21.15.179:3300/0 conn(0x7ffb1415d720 0x7ffb140d35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/3973777060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d3200 0x7ffb140cddf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 -- 172.21.15.162:0/3973777060 >> 172.21.15.162:0/3973777060 conn(0x7ffb1408cc80 msgr2=0x7ffb1409c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:21.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 -- 172.21.15.162:0/3973777060 shutdown_connections 2024-01-20T11:08:21.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.981+0000 7ffb1ae00640 1 -- 172.21.15.162:0/3973777060 wait complete. 2024-01-20T11:08:21.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.983+0000 7ffb1ae00640 1 Processor -- start 2024-01-20T11:08:21.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.983+0000 7ffb1ae00640 1 -- start start 2024-01-20T11:08:21.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb1ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d1000 0x7ffb14160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb1ae00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb140d3200 0x7ffb1415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb1ae00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415d720 0x7ffb1415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb1ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1414ed60 con 0x7ffb140d1000 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb1ae00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1415f5d0 con 0x7ffb1415d720 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb1ae00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1415f8b0 con 0x7ffb140d3200 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb19a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d1000 0x7ffb14160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb19a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d1000 0x7ffb14160670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34740/0 (socket says 172.21.15.162:34740) 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.984+0000 7ffb19a00640 1 -- 172.21.15.162:0/898618939 learned_addr learned my addr 172.21.15.162:0/898618939 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb1a400640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415d720 0x7ffb1415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb19a00640 1 -- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb140d3200 msgr2=0x7ffb1415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb19000640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb140d3200 0x7ffb1415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb19a00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb140d3200 0x7ffb1415e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb19a00640 1 -- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415d720 msgr2=0x7ffb1415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb19a00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415d720 0x7ffb1415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb19a00640 1 -- 172.21.15.162:0/898618939 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009b30 con 0x7ffb140d1000 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb1a400640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415d720 0x7ffb1415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:21.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb19a00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d1000 0x7ffb14160670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb04000f80 tx=0x7ffb04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:21.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb11600640 1 -- 172.21.15.162:0/898618939 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04009510 con 0x7ffb140d1000 2024-01-20T11:08:21.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb11600640 1 -- 172.21.15.162:0/898618939 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0403e450 con 0x7ffb140d1000 2024-01-20T11:08:21.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb11600640 1 -- 172.21.15.162:0/898618939 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0403e800 con 0x7ffb140d1000 2024-01-20T11:08:21.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.985+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1415fb90 con 0x7ffb140d1000 2024-01-20T11:08:21.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.986+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb14160150 con 0x7ffb140d1000 2024-01-20T11:08:21.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.987+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb14160370 con 0x7ffb140d1000 2024-01-20T11:08:21.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.987+0000 7ffb11600640 1 -- 172.21.15.162:0/898618939 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ffb0402cd50 con 0x7ffb140d1000 2024-01-20T11:08:21.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.988+0000 7ffb11600640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffaec06aed0 0x7ffaec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:21.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.988+0000 7ffb11600640 1 -- 172.21.15.162:0/898618939 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ffb040ac200 con 0x7ffb140d1000 2024-01-20T11:08:21.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.989+0000 7ffb19000640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffaec06aed0 0x7ffaec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:21.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.989+0000 7ffb19000640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffaec06aed0 0x7ffaec06d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffafc006fd0 tx=0x7ffafc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:21.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:21.993+0000 7ffb11600640 1 -- 172.21.15.162:0/898618939 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ffb04077040 con 0x7ffb140d1000 2024-01-20T11:08:22.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.186+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb14074a30 con 0x7ffb140d1000 2024-01-20T11:08:22.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.187+0000 7ffb11600640 1 -- 172.21.15.162:0/898618939 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb0407a660 con 0x7ffb140d1000 2024-01-20T11:08:22.188 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.189+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffaec06aed0 msgr2=0x7ffaec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.189+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffaec06aed0 0x7ffaec06d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffafc006fd0 tx=0x7ffafc008040 comp rx=0 tx=0).stop 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d1000 msgr2=0x7ffb14160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d1000 0x7ffb14160670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb04000f80 tx=0x7ffb04004a40 comp rx=0 tx=0).stop 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 shutdown_connections 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffaec06aed0 0x7ffaec06d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415d720 0x7ffb1415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb140d3200 0x7ffb1415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 --2- 172.21.15.162:0/898618939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb140d1000 0x7ffb14160670 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 >> 172.21.15.162:0/898618939 conn(0x7ffb1408cc80 msgr2=0x7ffb140d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:22.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 shutdown_connections 2024-01-20T11:08:22.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.190+0000 7ffb1ae00640 1 -- 172.21.15.162:0/898618939 wait complete. 2024-01-20T11:08:22.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:22.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.422+0000 7f9e29c00640 1 Processor -- start 2024-01-20T11:08:22.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.423+0000 7f9e29c00640 1 -- start start 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.424+0000 7f9e29c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e2415d6b0 0x7f9e2406b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.424+0000 7f9e29c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e2406cc70 0x7f9e240b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.424+0000 7f9e29c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e24161290 0x7f9e240b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.424+0000 7f9e29c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e240b3870 con 0x7f9e2415d6b0 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.424+0000 7f9e29c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2406a7a0 con 0x7f9e2406cc70 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.424+0000 7f9e29c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2406aa80 con 0x7f9e24161290 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e2415d6b0 0x7f9e2406b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e2415d6b0 0x7f9e2406b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34742/0 (socket says 172.21.15.162:34742) 2024-01-20T11:08:22.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 -- 172.21.15.162:0/2121353749 learned_addr learned my addr 172.21.15.162:0/2121353749 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:22.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22000640 1 --2- 172.21.15.162:0/2121353749 >> v2:172.21.15.179:3300/0 conn(0x7f9e2406cc70 0x7f9e240b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e23400640 1 --2- 172.21.15.162:0/2121353749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e24161290 0x7f9e240b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 -- 172.21.15.162:0/2121353749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e24161290 msgr2=0x7f9e240b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:22.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 --2- 172.21.15.162:0/2121353749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e24161290 0x7f9e240b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 -- 172.21.15.162:0/2121353749 >> v2:172.21.15.179:3300/0 conn(0x7f9e2406cc70 msgr2=0x7f9e240b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:22.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 --2- 172.21.15.162:0/2121353749 >> v2:172.21.15.179:3300/0 conn(0x7f9e2406cc70 0x7f9e240b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22a00640 1 -- 172.21.15.162:0/2121353749 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2406ad60 con 0x7f9e2415d6b0 2024-01-20T11:08:22.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.425+0000 7f9e22000640 1 --2- 172.21.15.162:0/2121353749 >> v2:172.21.15.179:3300/0 conn(0x7f9e2406cc70 0x7f9e240b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:08:22.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.427+0000 7f9e22a00640 1 --2- 172.21.15.162:0/2121353749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2415d6b0 0x7f9e2406b840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9e24066a90 tx=0x7f9e0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922e6a6a81e1a3c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:22.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.427+0000 7f9e21600640 1 -- 172.21.15.162:0/2121353749 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c030860 con 0x7f9e2415d6b0 2024-01-20T11:08:22.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.427+0000 7f9e21600640 1 -- 172.21.15.162:0/2121353749 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c0309c0 con 0x7f9e2415d6b0 2024-01-20T11:08:22.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.427+0000 7f9e21600640 1 -- 172.21.15.162:0/2121353749 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c030d50 con 0x7f9e2415d6b0 2024-01-20T11:08:22.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 -- 172.21.15.162:0/2121353749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2415d6b0 msgr2=0x7f9e2406b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 --2- 172.21.15.162:0/2121353749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2415d6b0 0x7f9e2406b840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9e24066a90 tx=0x7f9e0c02b9a0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 -- 172.21.15.162:0/2121353749 shutdown_connections 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 --2- 172.21.15.162:0/2121353749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e24161290 0x7f9e240b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 --2- 172.21.15.162:0/2121353749 >> v2:172.21.15.179:3300/0 conn(0x7f9e2406cc70 0x7f9e240b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 --2- 172.21.15.162:0/2121353749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2415d6b0 0x7f9e2406b840 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 -- 172.21.15.162:0/2121353749 >> 172.21.15.162:0/2121353749 conn(0x7f9e240cf940 msgr2=0x7f9e240cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 -- 172.21.15.162:0/2121353749 shutdown_connections 2024-01-20T11:08:22.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.428+0000 7f9e29c00640 1 -- 172.21.15.162:0/2121353749 wait complete. 2024-01-20T11:08:22.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.430+0000 7f9e29c00640 1 Processor -- start 2024-01-20T11:08:22.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.430+0000 7f9e29c00640 1 -- start start 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e29c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2406cc70 0x7f9e24140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e29c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e2415d6b0 0x7f9e2414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e29c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24161290 0x7f9e240ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e29c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e241f6c20 con 0x7f9e2406cc70 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e29c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e241f6f00 con 0x7f9e24161290 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e29c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e241f71e0 con 0x7f9e2415d6b0 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e22a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2406cc70 0x7f9e24140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e22a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2406cc70 0x7f9e24140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34746/0 (socket says 172.21.15.162:34746) 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e22a00640 1 -- 172.21.15.162:0/3631669954 learned_addr learned my addr 172.21.15.162:0/3631669954 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e23400640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24161290 0x7f9e240ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.431+0000 7f9e22000640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e2415d6b0 0x7f9e2414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e22a00640 1 -- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e2415d6b0 msgr2=0x7f9e2414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e22a00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e2415d6b0 0x7f9e2414a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e22a00640 1 -- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24161290 msgr2=0x7f9e240ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e22a00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24161290 0x7f9e240ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e22a00640 1 -- 172.21.15.162:0/3631669954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0094d0 con 0x7f9e2406cc70 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e23400640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24161290 0x7f9e240ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e22a00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2406cc70 0x7f9e24140400 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c02b9e0 tx=0x7f9e0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e1aa00640 1 -- 172.21.15.162:0/3631669954 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c039d60 con 0x7f9e2406cc70 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e1aa00640 1 -- 172.21.15.162:0/3631669954 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c043400 con 0x7f9e2406cc70 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e1aa00640 1 -- 172.21.15.162:0/3631669954 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0437b0 con 0x7f9e2406cc70 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e241f74c0 con 0x7f9e2406cc70 2024-01-20T11:08:22.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.432+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2414d060 con 0x7f9e2406cc70 2024-01-20T11:08:22.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.434+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e241f7b10 con 0x7f9e2406cc70 2024-01-20T11:08:22.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.434+0000 7f9e1aa00640 1 -- 172.21.15.162:0/3631669954 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9e0c043910 con 0x7f9e2406cc70 2024-01-20T11:08:22.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.435+0000 7f9e1aa00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9dfc06af00 0x7f9dfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.435+0000 7f9e1aa00640 1 -- 172.21.15.162:0/3631669954 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9e0c03e070 con 0x7f9e2406cc70 2024-01-20T11:08:22.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.436+0000 7f9e22000640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9dfc06af00 0x7f9dfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.436+0000 7f9e22000640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9dfc06af00 0x7f9dfc06d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e240b1030 tx=0x7f9e1400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:22.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.440+0000 7f9e1aa00640 1 -- 172.21.15.162:0/3631669954 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9e241f7b10 con 0x7f9e2406cc70 2024-01-20T11:08:22.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.635+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e241f7b10 con 0x7f9e2406cc70 2024-01-20T11:08:22.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.636+0000 7f9e1aa00640 1 -- 172.21.15.162:0/3631669954 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e0c034020 con 0x7f9e2406cc70 2024-01-20T11:08:22.636 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:22.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9dfc06af00 msgr2=0x7f9dfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9dfc06af00 0x7f9dfc06d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e240b1030 tx=0x7f9e1400b040 comp rx=0 tx=0).stop 2024-01-20T11:08:22.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2406cc70 msgr2=0x7f9e24140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2406cc70 0x7f9e24140400 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c02b9e0 tx=0x7f9e0c004730 comp rx=0 tx=0).stop 2024-01-20T11:08:22.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 shutdown_connections 2024-01-20T11:08:22.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9dfc06af00 0x7f9dfc06d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24161290 0x7f9e240ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e2415d6b0 0x7f9e2414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.638+0000 7f9e29c00640 1 --2- 172.21.15.162:0/3631669954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e2406cc70 0x7f9e24140400 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.639+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 >> 172.21.15.162:0/3631669954 conn(0x7f9e240cf940 msgr2=0x7f9e2406e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:22.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.639+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 shutdown_connections 2024-01-20T11:08:22.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.639+0000 7f9e29c00640 1 -- 172.21.15.162:0/3631669954 wait complete. 2024-01-20T11:08:22.657 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:22.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.866+0000 7fc909800640 1 Processor -- start 2024-01-20T11:08:22.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.867+0000 7fc909800640 1 -- start start 2024-01-20T11:08:22.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.868+0000 7fc909800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc90415d7b0 0x7fc9040d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.868+0000 7fc909800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9040b1850 0x7fc9040d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.868+0000 7fc909800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9040cf2c0 con 0x7fc9040d16a0 2024-01-20T11:08:22.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.868+0000 7fc909800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9040b03b0 con 0x7fc90415d7b0 2024-01-20T11:08:22.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.868+0000 7fc909800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90415db90 con 0x7fc9040b1850 2024-01-20T11:08:22.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.868+0000 7fc8fb200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc9040d16a0 0x7fc9040cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44978/0 (socket says 172.21.15.162:44978) 2024-01-20T11:08:22.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.868+0000 7fc8fb200640 1 -- 172.21.15.162:0/829458845 learned_addr learned my addr 172.21.15.162:0/829458845 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc908e00640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9040b1850 0x7fc9040d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903e00640 1 --2- 172.21.15.162:0/829458845 >> v2:172.21.15.179:3300/0 conn(0x7fc90415d7b0 0x7fc9040d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705335465 0 0) 0x7fc9040cf2c0 con 0x7fc9040d16a0 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e4003520 con 0x7fc9040d16a0 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4234015139 0 0) 0x7fc8e4003520 con 0x7fc9040d16a0 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9040b1850 msgr2=0x7fc9040d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9040b1850 0x7fc9040d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 >> v2:172.21.15.179:3300/0 conn(0x7fc90415d7b0 msgr2=0x7fc9040d3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 --2- 172.21.15.162:0/829458845 >> v2:172.21.15.179:3300/0 conn(0x7fc90415d7b0 0x7fc9040d3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040d2040 con 0x7fc9040d16a0 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fc8ec001670 con 0x7fc9040d16a0 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 >> v1:172.21.15.162:6789/0 conn(0x7fc9040d16a0 legacy=0x7fc9040cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8e4003970 0x7fc8e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e40047c0 0x7fc8e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9040b1850 0x7fc8e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040b03b0 con 0x7fc8e40047c0 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90415db90 con 0x7fc8e4003970 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.869+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e400b980 con 0x7fc9040b1850 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.870+0000 7fc8fb200640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e40047c0 0x7fc8e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.870+0000 7fc903e00640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8e4003970 0x7fc8e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.870+0000 7fc8fb200640 1 -- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9040b1850 msgr2=0x7fc8e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.870+0000 7fc8fb200640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9040b1850 0x7fc8e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.870+0000 7fc8fb200640 1 -- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8e4003970 msgr2=0x7fc8e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:22.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.870+0000 7fc8fb200640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8e4003970 0x7fc8e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.870+0000 7fc8fb200640 1 -- 172.21.15.162:0/829458845 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4003520 con 0x7fc8e40047c0 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.871+0000 7fc8fb200640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e40047c0 0x7fc8e4004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c240 tx=0x7fc8e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c0ea5eafb3c64e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.871+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec02cb00 con 0x7fc8e40047c0 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.871+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec02cc60 con 0x7fc8e40047c0 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.871+0000 7fc903400640 1 -- 172.21.15.162:0/829458845 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0058d0 con 0x7fc8e40047c0 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.872+0000 7fc909800640 1 -- 172.21.15.162:0/829458845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e40047c0 msgr2=0x7fc8e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.872+0000 7fc909800640 1 --2- 172.21.15.162:0/829458845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e40047c0 0x7fc8e4004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c240 tx=0x7fc8e40057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.872+0000 7fc908e00640 1 -- 172.21.15.162:0/829458845 reap_dead start 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.872+0000 7fc909800640 1 -- 172.21.15.162:0/829458845 shutdown_connections 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.872+0000 7fc909800640 1 -- 172.21.15.162:0/829458845 >> 172.21.15.162:0/829458845 conn(0x7fc90409c5b0 msgr2=0x7fc9040d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.872+0000 7fc909800640 1 -- 172.21.15.162:0/829458845 shutdown_connections 2024-01-20T11:08:22.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.872+0000 7fc909800640 1 -- 172.21.15.162:0/829458845 wait complete. 2024-01-20T11:08:22.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.874+0000 7fc909800640 1 Processor -- start 2024-01-20T11:08:22.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.874+0000 7fc909800640 1 -- start start 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc909800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8e40047c0 0x7fc904159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc909800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9040b7990 0x7fc90415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc909800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc90415aa30 0x7fc9040c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc909800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040b68f0 con 0x7fc90415aa30 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc909800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040b6bd0 con 0x7fc9040b7990 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc909800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040b6eb0 con 0x7fc8e40047c0 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc908e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc90415aa30 0x7fc9040c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc908e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc90415aa30 0x7fc9040c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34774/0 (socket says 172.21.15.162:34774) 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.875+0000 7fc908e00640 1 -- 172.21.15.162:0/526714635 learned_addr learned my addr 172.21.15.162:0/526714635 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc8fb200640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9040b7990 0x7fc90415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc903e00640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8e40047c0 0x7fc904159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc908e00640 1 -- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8e40047c0 msgr2=0x7fc904159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc908e00640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8e40047c0 0x7fc904159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc908e00640 1 -- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9040b7990 msgr2=0x7fc90415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc908e00640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9040b7990 0x7fc90415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc908e00640 1 -- 172.21.15.162:0/526714635 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040b7190 con 0x7fc90415aa30 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc908e00640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc90415aa30 0x7fc9040c7e20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc90408c700 tx=0x7fc8fc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc900c00640 1 -- 172.21.15.162:0/526714635 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc010040 con 0x7fc90415aa30 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc900c00640 1 -- 172.21.15.162:0/526714635 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc00bce0 con 0x7fc90415aa30 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9040b7470 con 0x7fc90415aa30 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.876+0000 7fc900c00640 1 -- 172.21.15.162:0/526714635 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc014640 con 0x7fc90415aa30 2024-01-20T11:08:22.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.877+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9040c8360 con 0x7fc90415aa30 2024-01-20T11:08:22.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.878+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc904074a30 con 0x7fc90415aa30 2024-01-20T11:08:22.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.879+0000 7fc900c00640 1 -- 172.21.15.162:0/526714635 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc8fc0147a0 con 0x7fc90415aa30 2024-01-20T11:08:22.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.879+0000 7fc900c00640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc8dc06aed0 0x7fc8dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:22.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.879+0000 7fc900c00640 1 -- 172.21.15.162:0/526714635 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc8fc089d60 con 0x7fc90415aa30 2024-01-20T11:08:22.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.880+0000 7fc903e00640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc8dc06aed0 0x7fc8dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:22.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.880+0000 7fc903e00640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc8dc06aed0 0x7fc8dc06d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009990 tx=0x7fc8f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:22.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:22.884+0000 7fc900c00640 1 -- 172.21.15.162:0/526714635 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc8fc054c40 con 0x7fc90415aa30 2024-01-20T11:08:23.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.077+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9040cd730 con 0x7fc90415aa30 2024-01-20T11:08:23.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.078+0000 7fc900c00640 1 -- 172.21.15.162:0/526714635 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8fc058260 con 0x7fc90415aa30 2024-01-20T11:08:23.079 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc8dc06aed0 msgr2=0x7fc8dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc8dc06aed0 0x7fc8dc06d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009990 tx=0x7fc8f4008040 comp rx=0 tx=0).stop 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc90415aa30 msgr2=0x7fc9040c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc90415aa30 0x7fc9040c7e20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc90408c700 tx=0x7fc8fc00b480 comp rx=0 tx=0).stop 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 shutdown_connections 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc90415aa30 0x7fc9040c7e20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc8dc06aed0 0x7fc8dc06d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9040b7990 0x7fc90415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 --2- 172.21.15.162:0/526714635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8e40047c0 0x7fc904159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 >> 172.21.15.162:0/526714635 conn(0x7fc90409c5b0 msgr2=0x7fc90406cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:23.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 shutdown_connections 2024-01-20T11:08:23.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.081+0000 7fc909800640 1 -- 172.21.15.162:0/526714635 wait complete. 2024-01-20T11:08:23.099 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T11:08:23.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.309+0000 7f833f000640 1 Processor -- start 2024-01-20T11:08:23.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.310+0000 7f833f000640 1 -- start start 2024-01-20T11:08:23.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.311+0000 7f833f000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f8338071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.311+0000 7f833f000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83380b3560 con 0x7f83380cefe0 2024-01-20T11:08:23.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.311+0000 7f833f000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8338161f60 con 0x7f8338165690 2024-01-20T11:08:23.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.311+0000 7f833f000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8338072830 con 0x7f8338161b80 2024-01-20T11:08:23.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.311+0000 7f8337400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f83380cefe0 0x7f83380cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44986/0 (socket says 172.21.15.162:44986) 2024-01-20T11:08:23.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.311+0000 7f8337400640 1 -- 172.21.15.162:0/1044974713 learned_addr learned my addr 172.21.15.162:0/1044974713 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:23.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.312+0000 7f8337e00640 1 --2- 172.21.15.162:0/1044974713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f8338071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.312+0000 7f8336a00640 1 -- 172.21.15.162:0/1044974713 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124869387 0 0) 0x7f83380b3560 con 0x7f83380cefe0 2024-01-20T11:08:23.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.312+0000 7f8336a00640 1 -- 172.21.15.162:0/1044974713 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8318003520 con 0x7f83380cefe0 2024-01-20T11:08:23.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.312+0000 7f8337e00640 1 -- 172.21.15.162:0/1044974713 >> v1:172.21.15.179:6789/0 conn(0x7f8338165690 legacy=0x7f8338165b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.312+0000 7f8337e00640 1 -- 172.21.15.162:0/1044974713 >> v1:172.21.15.162:6789/0 conn(0x7f83380cefe0 legacy=0x7f83380cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.312+0000 7f8337e00640 1 -- 172.21.15.162:0/1044974713 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380b3de0 con 0x7f8338161b80 2024-01-20T11:08:23.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.314+0000 7f8337e00640 1 --2- 172.21.15.162:0/1044974713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f8338071d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8328009dc0 tx=0x7f832802be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced4ca042ce5d5cd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:23.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.314+0000 7f8336a00640 1 -- 172.21.15.162:0/1044974713 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832802cc30 con 0x7f8338161b80 2024-01-20T11:08:23.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.314+0000 7f8336a00640 1 -- 172.21.15.162:0/1044974713 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832802cd90 con 0x7f8338161b80 2024-01-20T11:08:23.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.314+0000 7f8336a00640 1 -- 172.21.15.162:0/1044974713 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328034660 con 0x7f8338161b80 2024-01-20T11:08:23.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.315+0000 7f833f000640 1 -- 172.21.15.162:0/1044974713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 msgr2=0x7f8338071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.315+0000 7f833f000640 1 --2- 172.21.15.162:0/1044974713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f8338071d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8328009dc0 tx=0x7f832802be80 comp rx=0 tx=0).stop 2024-01-20T11:08:23.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.315+0000 7f833f000640 1 -- 172.21.15.162:0/1044974713 shutdown_connections 2024-01-20T11:08:23.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.315+0000 7f833f000640 1 --2- 172.21.15.162:0/1044974713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f8338071d40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.315+0000 7f833f000640 1 -- 172.21.15.162:0/1044974713 >> 172.21.15.162:0/1044974713 conn(0x7f833806a600 msgr2=0x7f833806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:23.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.315+0000 7f833f000640 1 -- 172.21.15.162:0/1044974713 shutdown_connections 2024-01-20T11:08:23.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.315+0000 7f833f000640 1 -- 172.21.15.162:0/1044974713 wait complete. 2024-01-20T11:08:23.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.317+0000 7f833f000640 1 Processor -- start 2024-01-20T11:08:23.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.317+0000 7f833f000640 1 -- start start 2024-01-20T11:08:23.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f833f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380cefe0 0x7f8338159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f833f000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f83380a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f833f000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8338165690 0x7f83380ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f833f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833815a2d0 con 0x7f83380cefe0 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f833f000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380a99e0 con 0x7f8338165690 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f833f000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833815f970 con 0x7f8338161b80 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f8337e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380cefe0 0x7f8338159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.318+0000 7f8337e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380cefe0 0x7f8338159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34780/0 (socket says 172.21.15.162:34780) 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337e00640 1 -- 172.21.15.162:0/2032425900 learned_addr learned my addr 172.21.15.162:0/2032425900 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337400640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f83380a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337e00640 1 -- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 msgr2=0x7f83380a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337e00640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f83380a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f833d000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8338165690 0x7f83380ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337e00640 1 -- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8338165690 msgr2=0x7f83380ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337e00640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8338165690 0x7f83380ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337e00640 1 -- 172.21.15.162:0/2032425900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328009a70 con 0x7f83380cefe0 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f833d000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8338165690 0x7f83380ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.319+0000 7f8337e00640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380cefe0 0x7f8338159d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8328000f80 tx=0x7f8328004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:23.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.320+0000 7f832fe00640 1 -- 172.21.15.162:0/2032425900 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328040650 con 0x7f83380cefe0 2024-01-20T11:08:23.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.320+0000 7f832fe00640 1 -- 172.21.15.162:0/2032425900 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83280407b0 con 0x7f83380cefe0 2024-01-20T11:08:23.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.320+0000 7f832fe00640 1 -- 172.21.15.162:0/2032425900 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328040b60 con 0x7f83380cefe0 2024-01-20T11:08:23.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.320+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833815fc50 con 0x7f83380cefe0 2024-01-20T11:08:23.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.320+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83380a96d0 con 0x7f83380cefe0 2024-01-20T11:08:23.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.321+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83380cccf0 con 0x7f83380cefe0 2024-01-20T11:08:23.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.322+0000 7f832fe00640 1 -- 172.21.15.162:0/2032425900 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8328040cc0 con 0x7f83380cefe0 2024-01-20T11:08:23.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.323+0000 7f832fe00640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f831006aed0 0x7f831006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.323+0000 7f832fe00640 1 -- 172.21.15.162:0/2032425900 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f83280ac3c0 con 0x7f83380cefe0 2024-01-20T11:08:23.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.323+0000 7f8337400640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f831006aed0 0x7f831006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.324+0000 7f8337400640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f831006aed0 0x7f831006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f833815adc0 tx=0x7f8320009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:23.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.327+0000 7f832fe00640 1 -- 172.21.15.162:0/2032425900 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f83280772a0 con 0x7f83380cefe0 2024-01-20T11:08:23.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.534+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f833804e970 con 0x7f83380cefe0 2024-01-20T11:08:23.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.535+0000 7f832fe00640 1 -- 172.21.15.162:0/2032425900 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f832807a8c0 con 0x7f83380cefe0 2024-01-20T11:08:23.536 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f831006aed0 msgr2=0x7f831006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f831006aed0 0x7f831006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f833815adc0 tx=0x7f8320009040 comp rx=0 tx=0).stop 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380cefe0 msgr2=0x7f8338159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380cefe0 0x7f8338159d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8328000f80 tx=0x7f8328004a40 comp rx=0 tx=0).stop 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 shutdown_connections 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f831006aed0 0x7f831006d390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8338165690 0x7f83380ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338161b80 0x7f83380a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 --2- 172.21.15.162:0/2032425900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83380cefe0 0x7f8338159d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 >> 172.21.15.162:0/2032425900 conn(0x7f833806a600 msgr2=0x7f833815c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 shutdown_connections 2024-01-20T11:08:23.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.538+0000 7f833f000640 1 -- 172.21.15.162:0/2032425900 wait complete. 2024-01-20T11:08:23.556 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-01-20T11:08:23.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:23.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-01-20T11:08:23.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:08:23.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:23.658 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-20T11:08:23.705 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-20T11:08:23.705 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:23.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.911+0000 7fa9bf600640 1 Processor -- start 2024-01-20T11:08:23.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.911+0000 7fa9bf600640 1 -- start start 2024-01-20T11:08:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.913+0000 7fa9bf600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa9b8070630 0x7fa9b80adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.913+0000 7fa9bf600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b8070b60 con 0x7fa9b815c6e0 2024-01-20T11:08:23.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.913+0000 7fa9bf600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b815bc00 con 0x7fa9b8155a30 2024-01-20T11:08:23.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.913+0000 7fa9bf600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b815ba10 con 0x7fa9b8070630 2024-01-20T11:08:23.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.913+0000 7fa9bd600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa9b815c6e0 0x7fa9b806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44992/0 (socket says 172.21.15.162:44992) 2024-01-20T11:08:23.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.913+0000 7fa9bd600640 1 -- 172.21.15.162:0/382372577 learned_addr learned my addr 172.21.15.162:0/382372577 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7e00640 1 --2- 172.21.15.162:0/382372577 >> v2:172.21.15.179:3300/0 conn(0x7fa9b8070630 0x7fa9b80adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929092329 0 0) 0x7fa9b8070b60 con 0x7fa9b815c6e0 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa998003520 con 0x7fa9b815c6e0 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2513122535 0 0) 0x7fa998003520 con 0x7fa9b815c6e0 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 >> v2:172.21.15.179:3300/0 conn(0x7fa9b8070630 msgr2=0x7fa9b80adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 --2- 172.21.15.162:0/382372577 >> v2:172.21.15.179:3300/0 conn(0x7fa9b8070630 0x7fa9b80adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 >> v1:172.21.15.179:6789/0 conn(0x7fa9b8155a30 legacy=0x7fa9b80ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b815bee0 con 0x7fa9b815c6e0 2024-01-20T11:08:23.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fa9b00019f0 con 0x7fa9b815c6e0 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 >> v1:172.21.15.162:6789/0 conn(0x7fa9b815c6e0 legacy=0x7fa9b806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980039c0 0x7fa998003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9980047c0 0x7fa998004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa998005180 0x7fa99800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99800c050 con 0x7fa9980047c0 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99800c1c0 con 0x7fa9980039c0 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.914+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99800c380 con 0x7fa998005180 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9b7e00640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9980047c0 0x7fa998004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9b7e00640 1 -- 172.21.15.162:0/382372577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa998005180 msgr2=0x7fa99800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9b7e00640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa998005180 0x7fa99800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9b7e00640 1 -- 172.21.15.162:0/382372577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980039c0 msgr2=0x7fa998003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9bcc00640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980039c0 0x7fa998003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9b7e00640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980039c0 0x7fa998003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9b7e00640 1 -- 172.21.15.162:0/382372577 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998003520 con 0x7fa9980047c0 2024-01-20T11:08:23.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.915+0000 7fa9bd600640 1 -- 172.21.15.162:0/382372577 reap_dead start 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.916+0000 7fa9b7e00640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9980047c0 0x7fa998004c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009ac0 tx=0x7fa9980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e496a8552cd6f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.916+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a002c6b0 con 0x7fa9980047c0 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.916+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a002c810 con 0x7fa9980047c0 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.916+0000 7fa9b7400640 1 -- 172.21.15.162:0/382372577 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a002cba0 con 0x7fa9980047c0 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.917+0000 7fa9bf600640 1 -- 172.21.15.162:0/382372577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9980047c0 msgr2=0x7fa998004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.917+0000 7fa9bf600640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9980047c0 0x7fa998004c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009ac0 tx=0x7fa9980057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.917+0000 7fa9bf600640 1 -- 172.21.15.162:0/382372577 shutdown_connections 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.917+0000 7fa9bf600640 1 --2- 172.21.15.162:0/382372577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9980047c0 0x7fa998004c40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.917+0000 7fa9bf600640 1 -- 172.21.15.162:0/382372577 >> 172.21.15.162:0/382372577 conn(0x7fa9b80b0cd0 msgr2=0x7fa9b80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.917+0000 7fa9bf600640 1 -- 172.21.15.162:0/382372577 shutdown_connections 2024-01-20T11:08:23.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.917+0000 7fa9bf600640 1 -- 172.21.15.162:0/382372577 wait complete. 2024-01-20T11:08:23.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.919+0000 7fa9bf600640 1 Processor -- start 2024-01-20T11:08:23.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.919+0000 7fa9bf600640 1 -- start start 2024-01-20T11:08:23.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bf600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980047c0 0x7fa9b809c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bf600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b81f0f10 0x7fa9b81f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bf600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9b80ae930 0x7fa9b80aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bf600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b81f2740 con 0x7fa9b80ae930 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bf600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80af2f0 con 0x7fa9980047c0 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bf600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b81f1aa0 con 0x7fa9b81f0f10 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9b80ae930 0x7fa9b80aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9b80ae930 0x7fa9b80aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34798/0 (socket says 172.21.15.162:34798) 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 -- 172.21.15.162:0/3193361508 learned_addr learned my addr 172.21.15.162:0/3193361508 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 -- 172.21.15.162:0/3193361508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b81f0f10 msgr2=0x7fa9b81f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b81f0f10 0x7fa9b81f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 -- 172.21.15.162:0/3193361508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980047c0 msgr2=0x7fa9b809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bcc00640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980047c0 0x7fa9b809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980047c0 0x7fa9b809c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.920+0000 7fa9bd600640 1 -- 172.21.15.162:0/3193361508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8155f90 con 0x7fa9b80ae930 2024-01-20T11:08:23.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.921+0000 7fa9bd600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9b80ae930 0x7fa9b80aedb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0001560 tx=0x7fa9b000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:23.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.921+0000 7fa9b4c00640 1 -- 172.21.15.162:0/3193361508 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000a5b0 con 0x7fa9b80ae930 2024-01-20T11:08:23.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.921+0000 7fa9b4c00640 1 -- 172.21.15.162:0/3193361508 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b000a710 con 0x7fa9b80ae930 2024-01-20T11:08:23.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.921+0000 7fa9b4c00640 1 -- 172.21.15.162:0/3193361508 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000aac0 con 0x7fa9b80ae930 2024-01-20T11:08:23.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.921+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b81f1d80 con 0x7fa9b80ae930 2024-01-20T11:08:23.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.921+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b81f2060 con 0x7fa9b80ae930 2024-01-20T11:08:23.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.922+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b81f2880 con 0x7fa9b80ae930 2024-01-20T11:08:23.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.923+0000 7fa9b4c00640 1 -- 172.21.15.162:0/3193361508 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa9b000ac20 con 0x7fa9b80ae930 2024-01-20T11:08:23.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.924+0000 7fa9b4c00640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa99006af00 0x7fa99006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:23.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.924+0000 7fa9b4c00640 1 -- 172.21.15.162:0/3193361508 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa9b0088f40 con 0x7fa9b80ae930 2024-01-20T11:08:23.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.924+0000 7fa9bcc00640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa99006af00 0x7fa99006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:23.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.925+0000 7fa9bcc00640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa99006af00 0x7fa99006d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8000c00 tx=0x7fa9a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:23.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:23.928+0000 7fa9b4c00640 1 -- 172.21.15.162:0/3193361508 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa9b81f2880 con 0x7fa9b80ae930 2024-01-20T11:08:24.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.156+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9b81f2880 con 0x7fa9b80ae930 2024-01-20T11:08:24.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.158+0000 7fa9b4c00640 1 -- 172.21.15.162:0/3193361508 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fa9b81f2880 con 0x7fa9b80ae930 2024-01-20T11:08:24.158 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:24.158 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:08:24.159 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:08:24.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa99006af00 msgr2=0x7fa99006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa99006af00 0x7fa99006d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8000c00 tx=0x7fa9a8009040 comp rx=0 tx=0).stop 2024-01-20T11:08:24.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9b80ae930 msgr2=0x7fa9b80aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9b80ae930 0x7fa9b80aedb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0001560 tx=0x7fa9b000ccd0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 shutdown_connections 2024-01-20T11:08:24.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9b80ae930 0x7fa9b80aedb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b81f0f10 0x7fa9b81f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa99006af00 0x7fa99006d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 --2- 172.21.15.162:0/3193361508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9980047c0 0x7fa9b809c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.160+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 >> 172.21.15.162:0/3193361508 conn(0x7fa9b80b0cd0 msgr2=0x7fa9b815d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:24.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.161+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 shutdown_connections 2024-01-20T11:08:24.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.161+0000 7fa9bf600640 1 -- 172.21.15.162:0/3193361508 wait complete. 2024-01-20T11:08:24.180 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:24.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.387+0000 7f8179a00640 1 Processor -- start 2024-01-20T11:08:24.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.388+0000 7f8179a00640 1 -- start start 2024-01-20T11:08:24.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.389+0000 7f8179a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8174155a30 0x7f81740ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.389+0000 7f8179a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174070630 0x7f81740adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.389+0000 7f8179a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f817415c6e0 0x7f81740ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.389+0000 7f8179a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817415ba10 con 0x7f817415c6e0 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.389+0000 7f8179a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8174070b60 con 0x7f8174155a30 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.389+0000 7f8179a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817415bc00 con 0x7f8174070630 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.389+0000 7f8173400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f817415c6e0 0x7f81740ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8173400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f817415c6e0 0x7f81740ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34800/0 (socket says 172.21.15.162:34800) 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8173400640 1 -- 172.21.15.162:0/575741086 learned_addr learned my addr 172.21.15.162:0/575741086 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8172a00640 1 --2- 172.21.15.162:0/575741086 >> v2:172.21.15.179:3300/0 conn(0x7f8174155a30 0x7f81740ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8169e00640 1 --2- 172.21.15.162:0/575741086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174070630 0x7f81740adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8173400640 1 -- 172.21.15.162:0/575741086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174070630 msgr2=0x7f81740adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8173400640 1 --2- 172.21.15.162:0/575741086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174070630 0x7f81740adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8173400640 1 -- 172.21.15.162:0/575741086 >> v2:172.21.15.179:3300/0 conn(0x7f8174155a30 msgr2=0x7f81740ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:24.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8173400640 1 --2- 172.21.15.162:0/575741086 >> v2:172.21.15.179:3300/0 conn(0x7f8174155a30 0x7f81740ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8173400640 1 -- 172.21.15.162:0/575741086 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817415bee0 con 0x7f817415c6e0 2024-01-20T11:08:24.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8172a00640 1 --2- 172.21.15.162:0/575741086 >> v2:172.21.15.179:3300/0 conn(0x7f8174155a30 0x7f81740ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:24.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.390+0000 7f8169e00640 1 --2- 172.21.15.162:0/575741086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174070630 0x7f81740adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.391+0000 7f8173400640 1 --2- 172.21.15.162:0/575741086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f81740ae4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f81740ccb20 tx=0x7f816c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f98b9a3495da3d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.391+0000 7f8172000640 1 -- 172.21.15.162:0/575741086 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0317e0 con 0x7f817415c6e0 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8172000640 1 -- 172.21.15.162:0/575741086 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c031940 con 0x7f817415c6e0 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8172000640 1 -- 172.21.15.162:0/575741086 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c031cd0 con 0x7f817415c6e0 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 -- 172.21.15.162:0/575741086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 msgr2=0x7f81740ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 --2- 172.21.15.162:0/575741086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f81740ae4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f81740ccb20 tx=0x7f816c02b880 comp rx=0 tx=0).stop 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 -- 172.21.15.162:0/575741086 shutdown_connections 2024-01-20T11:08:24.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 --2- 172.21.15.162:0/575741086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f81740ae4e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 --2- 172.21.15.162:0/575741086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174070630 0x7f81740adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 --2- 172.21.15.162:0/575741086 >> v2:172.21.15.179:3300/0 conn(0x7f8174155a30 0x7f81740ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 -- 172.21.15.162:0/575741086 >> 172.21.15.162:0/575741086 conn(0x7f81740b0cd0 msgr2=0x7f81740b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:24.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 -- 172.21.15.162:0/575741086 shutdown_connections 2024-01-20T11:08:24.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.392+0000 7f8179a00640 1 -- 172.21.15.162:0/575741086 wait complete. 2024-01-20T11:08:24.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.394+0000 7f8179a00640 1 Processor -- start 2024-01-20T11:08:24.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.394+0000 7f8179a00640 1 -- start start 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8179a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174070630 0x7f81740cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8179a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174155a30 0x7f81740cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8179a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f817409ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8179a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81741f2210 con 0x7f817415c6e0 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8179a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81741f1f10 con 0x7f8174070630 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8179a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817409b8f0 con 0x7f8174155a30 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8173400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f817409ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8173400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f817409ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34802/0 (socket says 172.21.15.162:34802) 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.395+0000 7f8173400640 1 -- 172.21.15.162:0/69456102 learned_addr learned my addr 172.21.15.162:0/69456102 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8169e00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174155a30 0x7f81740cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8172a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174070630 0x7f81740cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8173400640 1 -- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174155a30 msgr2=0x7f81740cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8173400640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174155a30 0x7f81740cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8173400640 1 -- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174070630 msgr2=0x7f81740cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8173400640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174070630 0x7f81740cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8173400640 1 -- 172.21.15.162:0/69456102 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c0094d0 con 0x7f817415c6e0 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8172a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174070630 0x7f81740cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f8173400640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f817409ab80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f816c0090b0 tx=0x7f816c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.396+0000 7f816b400640 1 -- 172.21.15.162:0/69456102 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c032900 con 0x7f817415c6e0 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.397+0000 7f816b400640 1 -- 172.21.15.162:0/69456102 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c032a80 con 0x7f817415c6e0 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.397+0000 7f816b400640 1 -- 172.21.15.162:0/69456102 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c032e30 con 0x7f817415c6e0 2024-01-20T11:08:24.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.397+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817409bbd0 con 0x7f817415c6e0 2024-01-20T11:08:24.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.397+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8174149dc0 con 0x7f817415c6e0 2024-01-20T11:08:24.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.398+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81741f2380 con 0x7f817415c6e0 2024-01-20T11:08:24.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.399+0000 7f816b400640 1 -- 172.21.15.162:0/69456102 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f816c04d3f0 con 0x7f817415c6e0 2024-01-20T11:08:24.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.400+0000 7f816b400640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f814c06aed0 0x7f814c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.400+0000 7f816b400640 1 -- 172.21.15.162:0/69456102 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f816c0ab580 con 0x7f817415c6e0 2024-01-20T11:08:24.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.400+0000 7f8172a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f814c06aed0 0x7f814c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.400+0000 7f8172a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f814c06aed0 0x7f814c06d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8164007fd0 tx=0x7f8164007520 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:24.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.404+0000 7f816b400640 1 -- 172.21.15.162:0/69456102 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f816c076480 con 0x7f817415c6e0 2024-01-20T11:08:24.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.582+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f817404e970 con 0x7f817415c6e0 2024-01-20T11:08:24.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.584+0000 7f816b400640 1 -- 172.21.15.162:0/69456102 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16779 (secure 0 0 0) 0x7f816c079aa0 con 0x7f817415c6e0 2024-01-20T11:08:24.586 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:24.586 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":24,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:19.556914+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:24.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f814c06aed0 msgr2=0x7f814c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f814c06aed0 0x7f814c06d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8164007fd0 tx=0x7f8164007520 comp rx=0 tx=0).stop 2024-01-20T11:08:24.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 msgr2=0x7f817409ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f817409ab80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f816c0090b0 tx=0x7f816c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 shutdown_connections 2024-01-20T11:08:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f817415c6e0 0x7f817409ab80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174155a30 0x7f81740cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f814c06aed0 0x7f814c06d390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 --2- 172.21.15.162:0/69456102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174070630 0x7f81740cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 >> 172.21.15.162:0/69456102 conn(0x7f81740b0cd0 msgr2=0x7f81740cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.587+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 shutdown_connections 2024-01-20T11:08:24.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.588+0000 7f8179a00640 1 -- 172.21.15.162:0/69456102 wait complete. 2024-01-20T11:08:24.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:07:29.823472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:07:30.927769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:24.605 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:24.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.800+0000 7f74de200640 1 Processor -- start 2024-01-20T11:08:24.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.801+0000 7f74de200640 1 -- start start 2024-01-20T11:08:24.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.802+0000 7f74de200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74d8161b80 0x7f74d8071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.802+0000 7f74de200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d80b3560 con 0x7f74d80cefe0 2024-01-20T11:08:24.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.802+0000 7f74de200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d8161f60 con 0x7f74d8165690 2024-01-20T11:08:24.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.802+0000 7f74de200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d8072830 con 0x7f74d8161b80 2024-01-20T11:08:24.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.803+0000 7f74d7400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74d8161b80 0x7f74d8071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.803+0000 7f74ce800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f74d80cefe0 0x7f74d80cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45000/0 (socket says 172.21.15.162:45000) 2024-01-20T11:08:24.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.803+0000 7f74ce800640 1 -- 172.21.15.162:0/1001769181 learned_addr learned my addr 172.21.15.162:0/1001769181 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:24.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.803+0000 7f74d7400640 1 -- 172.21.15.162:0/1001769181 >> v1:172.21.15.179:6789/0 conn(0x7f74d8165690 legacy=0x7f74d8165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:24.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.803+0000 7f74d7400640 1 -- 172.21.15.162:0/1001769181 >> v1:172.21.15.162:6789/0 conn(0x7f74d80cefe0 legacy=0x7f74d80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.803+0000 7f74d7400640 1 -- 172.21.15.162:0/1001769181 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80b3de0 con 0x7f74d8161b80 2024-01-20T11:08:24.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.804+0000 7f74d7400640 1 --2- 172.21.15.162:0/1001769181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8161b80 0x7f74d8071d40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74c80097a0 tx=0x7f74c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6761783ec2b66fda server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:24.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74d6a00640 1 -- 172.21.15.162:0/1001769181 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c802e070 con 0x7f74d8161b80 2024-01-20T11:08:24.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74d6a00640 1 -- 172.21.15.162:0/1001769181 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c80315a0 con 0x7f74d8161b80 2024-01-20T11:08:24.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74d6a00640 1 -- 172.21.15.162:0/1001769181 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8031930 con 0x7f74d8161b80 2024-01-20T11:08:24.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74de200640 1 -- 172.21.15.162:0/1001769181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8161b80 msgr2=0x7f74d8071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74de200640 1 --2- 172.21.15.162:0/1001769181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8161b80 0x7f74d8071d40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74c80097a0 tx=0x7f74c802b840 comp rx=0 tx=0).stop 2024-01-20T11:08:24.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74de200640 1 -- 172.21.15.162:0/1001769181 shutdown_connections 2024-01-20T11:08:24.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74de200640 1 --2- 172.21.15.162:0/1001769181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8161b80 0x7f74d8071d40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.805+0000 7f74de200640 1 -- 172.21.15.162:0/1001769181 >> 172.21.15.162:0/1001769181 conn(0x7f74d806a600 msgr2=0x7f74d806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:24.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.806+0000 7f74de200640 1 -- 172.21.15.162:0/1001769181 shutdown_connections 2024-01-20T11:08:24.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.806+0000 7f74de200640 1 -- 172.21.15.162:0/1001769181 wait complete. 2024-01-20T11:08:24.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.807+0000 7f74de200640 1 Processor -- start 2024-01-20T11:08:24.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.807+0000 7f74de200640 1 -- start start 2024-01-20T11:08:24.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.808+0000 7f74de200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d80cefe0 0x7f74d80af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.808+0000 7f74de200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d8161b80 0x7f74d81f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.808+0000 7f74de200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8165690 0x7f74d8153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.808+0000 7f74de200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d81576d0 con 0x7f74d8165690 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.808+0000 7f74de200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80afe10 con 0x7f74d80cefe0 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.808+0000 7f74de200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8157970 con 0x7f74d8161b80 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8165690 0x7f74d8153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8165690 0x7f74d8153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34816/0 (socket says 172.21.15.162:34816) 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 -- 172.21.15.162:0/2713021140 learned_addr learned my addr 172.21.15.162:0/2713021140 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7400640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d80cefe0 0x7f74d80af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 -- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d8161b80 msgr2=0x7f74d81f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d8161b80 0x7f74d81f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 -- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d80cefe0 msgr2=0x7f74d80af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:24.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d80cefe0 0x7f74d80af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:24.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 -- 172.21.15.162:0/2713021140 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8009400 con 0x7f74d8165690 2024-01-20T11:08:24.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7400640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d80cefe0 0x7f74d80af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:24.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.809+0000 7f74d7e00640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8165690 0x7f74d8153330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f74d000b410 tx=0x7f74d000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:24.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.810+0000 7f74cfe00640 1 -- 172.21.15.162:0/2713021140 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0004020 con 0x7f74d8165690 2024-01-20T11:08:24.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.810+0000 7f74cfe00640 1 -- 172.21.15.162:0/2713021140 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d0004180 con 0x7f74d8165690 2024-01-20T11:08:24.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.810+0000 7f74cfe00640 1 -- 172.21.15.162:0/2713021140 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0011630 con 0x7f74d8165690 2024-01-20T11:08:24.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.810+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d8157c50 con 0x7f74d8165690 2024-01-20T11:08:24.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.810+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d80afb00 con 0x7f74d8165690 2024-01-20T11:08:24.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.811+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d8158170 con 0x7f74d8165690 2024-01-20T11:08:24.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.812+0000 7f74cfe00640 1 -- 172.21.15.162:0/2713021140 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f74d0011790 con 0x7f74d8165690 2024-01-20T11:08:24.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.813+0000 7f74cfe00640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f74b006af00 0x7f74b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:24.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.813+0000 7f74cfe00640 1 -- 172.21.15.162:0/2713021140 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f74d0089330 con 0x7f74d8165690 2024-01-20T11:08:24.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.813+0000 7f74d7400640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f74b006af00 0x7f74b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:24.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.814+0000 7f74d7400640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f74b006af00 0x7f74b006d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f74c8036000 tx=0x7f74c803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:24.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:24.817+0000 7f74cfe00640 1 -- 172.21.15.162:0/2713021140 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f74d8158170 con 0x7f74d8165690 2024-01-20T11:08:25.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.013+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74d8158170 con 0x7f74d8165690 2024-01-20T11:08:25.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.014+0000 7f74cfe00640 1 -- 172.21.15.162:0/2713021140 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74d8158170 con 0x7f74d8165690 2024-01-20T11:08:25.014 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:25.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f74b006af00 msgr2=0x7f74b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f74b006af00 0x7f74b006d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f74c8036000 tx=0x7f74c803d040 comp rx=0 tx=0).stop 2024-01-20T11:08:25.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8165690 msgr2=0x7f74d8153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8165690 0x7f74d8153330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f74d000b410 tx=0x7f74d000b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 shutdown_connections 2024-01-20T11:08:25.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d8165690 0x7f74d8153330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d8161b80 0x7f74d81f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f74b006af00 0x7f74b006d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 --2- 172.21.15.162:0/2713021140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d80cefe0 0x7f74d80af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 >> 172.21.15.162:0/2713021140 conn(0x7f74d806a600 msgr2=0x7f74d8164710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:25.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 shutdown_connections 2024-01-20T11:08:25.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.016+0000 7f74de200640 1 -- 172.21.15.162:0/2713021140 wait complete. 2024-01-20T11:08:25.036 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:08:25.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.248+0000 7fcb30c00640 1 Processor -- start 2024-01-20T11:08:25.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.248+0000 7fcb30c00640 1 -- start start 2024-01-20T11:08:25.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.249+0000 7fcb30c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c15d500 0x7fcb2c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.249+0000 7fcb30c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c0b4350 con 0x7fcb2c0cf140 2024-01-20T11:08:25.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.249+0000 7fcb30c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c06cc70 con 0x7fcb2c06c850 2024-01-20T11:08:25.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.249+0000 7fcb30c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0b40b0 con 0x7fcb2c15d500 2024-01-20T11:08:25.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.249+0000 7fcb21200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcb2c0cf140 0x7fcb2c0b5e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45016/0 (socket says 172.21.15.162:45016) 2024-01-20T11:08:25.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.249+0000 7fcb21200640 1 -- 172.21.15.162:0/435451506 learned_addr learned my addr 172.21.15.162:0/435451506 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29e00640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c15d500 0x7fcb2c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243561100 0 0) 0x7fcb2c0b4350 con 0x7fcb2c0cf140 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb0c003520 con 0x7fcb2c0cf140 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 235736704 0 0) 0x7fcb0c003520 con 0x7fcb2c0cf140 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c15d500 msgr2=0x7fcb2c15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c15d500 0x7fcb2c15d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 >> v1:172.21.15.179:6789/0 conn(0x7fcb2c06c850 legacy=0x7fcb2c0701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c06cf30 con 0x7fcb2c0cf140 2024-01-20T11:08:25.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fcb140019f0 con 0x7fcb2c0cf140 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 >> v1:172.21.15.162:6789/0 conn(0x7fcb2c0cf140 legacy=0x7fcb2c0b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.250+0000 7fcb29400640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb0c0047c0 0x7fcb0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29400640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c15d500 0x7fcb0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0b40b0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c00ba30 con 0x7fcb0c0047c0 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c00bbf0 con 0x7fcb2c15d500 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29e00640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb21200640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb0c0047c0 0x7fcb0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29e00640 1 -- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c15d500 msgr2=0x7fcb0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29e00640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c15d500 0x7fcb0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29e00640 1 -- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb0c0047c0 msgr2=0x7fcb0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29e00640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb0c0047c0 0x7fcb0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb29e00640 1 -- 172.21.15.162:0/435451506 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c003520 con 0x7fcb0c0039a0 2024-01-20T11:08:25.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.251+0000 7fcb21200640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb0c0047c0 0x7fcb0c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:25.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.252+0000 7fcb29e00640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb0c003dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009a90 tx=0x7fcb0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b91386467dd157 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c02c6b0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c02c810 con 0x7fcb0c0039a0 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb29400640 1 -- 172.21.15.162:0/435451506 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c02cba0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb30c00640 1 -- 172.21.15.162:0/435451506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 msgr2=0x7fcb0c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb30c00640 1 --2- 172.21.15.162:0/435451506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb0c003dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009a90 tx=0x7fcb0c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb2a800640 1 -- 172.21.15.162:0/435451506 reap_dead start 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb30c00640 1 -- 172.21.15.162:0/435451506 shutdown_connections 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb30c00640 1 -- 172.21.15.162:0/435451506 >> 172.21.15.162:0/435451506 conn(0x7fcb2c06e970 msgr2=0x7fcb2c06ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb30c00640 1 -- 172.21.15.162:0/435451506 shutdown_connections 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.253+0000 7fcb30c00640 1 -- 172.21.15.162:0/435451506 wait complete. 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.255+0000 7fcb30c00640 1 Processor -- start 2024-01-20T11:08:25.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.255+0000 7fcb30c00640 1 -- start start 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb30c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb2c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb30c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c154b50 0x7fcb2c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb30c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c152c90 0x7fcb2c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb30c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1554f0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb30c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c153630 con 0x7fcb2c154b50 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb30c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c155cb0 con 0x7fcb2c152c90 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb29e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb2c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb29e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb2c146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34820/0 (socket says 172.21.15.162:34820) 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.256+0000 7fcb29e00640 1 -- 172.21.15.162:0/4156216713 learned_addr learned my addr 172.21.15.162:0/4156216713 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb21200640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c154b50 0x7fcb2c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb29e00640 1 -- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c152c90 msgr2=0x7fcb2c1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb2a800640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c152c90 0x7fcb2c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb29e00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c152c90 0x7fcb2c1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb29e00640 1 -- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c154b50 msgr2=0x7fcb2c154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb29e00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c154b50 0x7fcb2c154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb29e00640 1 -- 172.21.15.162:0/4156216713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c1501a0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb29e00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb2c146d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009bb0 tx=0x7fcb1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.257+0000 7fcb22a00640 1 -- 172.21.15.162:0/4156216713 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c003810 con 0x7fcb0c0039a0 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.258+0000 7fcb22a00640 1 -- 172.21.15.162:0/4156216713 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c003990 con 0x7fcb0c0039a0 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.258+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c1556f0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.258+0000 7fcb22a00640 1 -- 172.21.15.162:0/4156216713 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c003d40 con 0x7fcb0c0039a0 2024-01-20T11:08:25.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.258+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c1508c0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.259+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c04e970 con 0x7fcb0c0039a0 2024-01-20T11:08:25.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.260+0000 7fcb22a00640 1 -- 172.21.15.162:0/4156216713 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcb1c034440 con 0x7fcb0c0039a0 2024-01-20T11:08:25.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.260+0000 7fcb22a00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcb0406af00 0x7fcb0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.261+0000 7fcb22a00640 1 -- 172.21.15.162:0/4156216713 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcb1c0ab4d0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.261+0000 7fcb21200640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcb0406af00 0x7fcb0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.261+0000 7fcb21200640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcb0406af00 0x7fcb0406d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb14002230 tx=0x7fcb14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:25.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.265+0000 7fcb22a00640 1 -- 172.21.15.162:0/4156216713 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcb1c0764e0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.457+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb2c0d1ff0 con 0x7fcb0c0039a0 2024-01-20T11:08:25.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.458+0000 7fcb22a00640 1 -- 172.21.15.162:0/4156216713 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb1c079b00 con 0x7fcb0c0039a0 2024-01-20T11:08:25.459 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:08:25.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcb0406af00 msgr2=0x7fcb0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcb0406af00 0x7fcb0406d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb14002230 tx=0x7fcb14009040 comp rx=0 tx=0).stop 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 msgr2=0x7fcb2c146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb2c146d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009bb0 tx=0x7fcb1c004730 comp rx=0 tx=0).stop 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 shutdown_connections 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c152c90 0x7fcb2c1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcb0406af00 0x7fcb0406d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c154b50 0x7fcb2c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 --2- 172.21.15.162:0/4156216713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb0c0039a0 0x7fcb2c146d30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 >> 172.21.15.162:0/4156216713 conn(0x7fcb2c06e970 msgr2=0x7fcb2c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 shutdown_connections 2024-01-20T11:08:25.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.461+0000 7fcb30c00640 1 -- 172.21.15.162:0/4156216713 wait complete. 2024-01-20T11:08:25.480 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:08:25.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.693+0000 7fa216e00640 1 Processor -- start 2024-01-20T11:08:25.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.693+0000 7fa216e00640 1 -- start start 2024-01-20T11:08:25.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa216e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa21006d600 0x7fa2100b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa216e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 0x7fa2100ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa216e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21015d9a0 con 0x7fa21015d5c0 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa216e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2100acca0 con 0x7fa21006d600 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa216e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100b2c30 con 0x7fa2100b2820 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa215a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa21015d5c0 0x7fa210072020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45018/0 (socket says 172.21.15.162:45018) 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa215a00640 1 -- 172.21.15.162:0/1870567252 learned_addr learned my addr 172.21.15.162:0/1870567252 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa215000640 1 --2- 172.21.15.162:0/1870567252 >> v2:172.21.15.179:3300/0 conn(0x7fa21006d600 0x7fa2100b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.695+0000 7fa216400640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 0x7fa2100ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468954431 0 0) 0x7fa200001110 con 0x7fa21015d5c0 2024-01-20T11:08:25.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f0003520 con 0x7fa21015d5c0 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142296447 0 0) 0x7fa1f0003520 con 0x7fa21015d5c0 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 msgr2=0x7fa2100ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 0x7fa2100ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 >> v2:172.21.15.179:3300/0 conn(0x7fa21006d600 msgr2=0x7fa2100b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 --2- 172.21.15.162:0/1870567252 >> v2:172.21.15.179:3300/0 conn(0x7fa21006d600 0x7fa2100b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21006dba0 con 0x7fa21015d5c0 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fa200001800 con 0x7fa21015d5c0 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 >> v1:172.21.15.162:6789/0 conn(0x7fa21015d5c0 legacy=0x7fa210072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1f0003970 0x7fa1f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 0x7fa1f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f0004d00 0x7fa1f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100acca0 con 0x7fa1f0004d00 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100b2c30 con 0x7fa1f0003970 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.696+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f000b980 con 0x7fa2100b2820 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa216400640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f0004d00 0x7fa1f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa215000640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 0x7fa1f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa215a00640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1f0003970 0x7fa1f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa216400640 1 -- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 msgr2=0x7fa1f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa216400640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2100b2820 0x7fa1f00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa216400640 1 -- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1f0003970 msgr2=0x7fa1f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa216400640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1f0003970 0x7fa1f0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.697+0000 7fa216400640 1 -- 172.21.15.162:0/1870567252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0003520 con 0x7fa1f0004d00 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.698+0000 7fa216400640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f0004d00 0x7fa1f0005180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa208009fc0 tx=0x7fa1f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266e8ad52cffcb4a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.698+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20802cc20 con 0x7fa1f0004d00 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20800f040 con 0x7fa1f0004d00 2024-01-20T11:08:25.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa20fe00640 1 -- 172.21.15.162:0/1870567252 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208034440 con 0x7fa1f0004d00 2024-01-20T11:08:25.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa216e00640 1 -- 172.21.15.162:0/1870567252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f0004d00 msgr2=0x7fa1f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa216e00640 1 --2- 172.21.15.162:0/1870567252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f0004d00 0x7fa1f0005180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa208009fc0 tx=0x7fa1f00057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa216400640 1 -- 172.21.15.162:0/1870567252 reap_dead start 2024-01-20T11:08:25.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa216e00640 1 -- 172.21.15.162:0/1870567252 shutdown_connections 2024-01-20T11:08:25.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa216e00640 1 -- 172.21.15.162:0/1870567252 >> 172.21.15.162:0/1870567252 conn(0x7fa2100b0c40 msgr2=0x7fa2100b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:25.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa216e00640 1 -- 172.21.15.162:0/1870567252 shutdown_connections 2024-01-20T11:08:25.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.699+0000 7fa216e00640 1 -- 172.21.15.162:0/1870567252 wait complete. 2024-01-20T11:08:25.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.701+0000 7fa216e00640 1 Processor -- start 2024-01-20T11:08:25.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.701+0000 7fa216e00640 1 -- start start 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.702+0000 7fa216e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1f0004d00 0x7fa2101f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.702+0000 7fa216e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa210159d10 0x7fa21015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.702+0000 7fa216e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21015b060 0x7fa2101f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.702+0000 7fa216e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21015b4e0 con 0x7fa21015b060 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.702+0000 7fa216e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2101f3bf0 con 0x7fa210159d10 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.702+0000 7fa216e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100c61f0 con 0x7fa1f0004d00 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.702+0000 7fa216400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21015b060 0x7fa2101f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21015b060 0x7fa2101f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34828/0 (socket says 172.21.15.162:34828) 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 -- 172.21.15.162:0/4110370891 learned_addr learned my addr 172.21.15.162:0/4110370891 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa215a00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1f0004d00 0x7fa2101f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 -- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1f0004d00 msgr2=0x7fa2101f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa215000640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa210159d10 0x7fa21015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1f0004d00 0x7fa2101f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 -- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa210159d10 msgr2=0x7fa21015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa210159d10 0x7fa21015ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 -- 172.21.15.162:0/4110370891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2100c64d0 con 0x7fa21015b060 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.703+0000 7fa216400640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21015b060 0x7fa2101f6220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa208037040 tx=0x7fa208009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.704+0000 7fa20d600640 1 -- 172.21.15.162:0/4110370891 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208043070 con 0x7fa21015b060 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.704+0000 7fa20d600640 1 -- 172.21.15.162:0/4110370891 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa208034b50 con 0x7fa21015b060 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.704+0000 7fa20d600640 1 -- 172.21.15.162:0/4110370891 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208003990 con 0x7fa21015b060 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.704+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2100c67b0 con 0x7fa21015b060 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.704+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2100c6d70 con 0x7fa21015b060 2024-01-20T11:08:25.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.705+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa210074a30 con 0x7fa21015b060 2024-01-20T11:08:25.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.706+0000 7fa20d600640 1 -- 172.21.15.162:0/4110370891 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa20803e440 con 0x7fa21015b060 2024-01-20T11:08:25.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.707+0000 7fa20d600640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa1e806aed0 0x7fa1e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:25.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.707+0000 7fa20d600640 1 -- 172.21.15.162:0/4110370891 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa2080ab060 con 0x7fa21015b060 2024-01-20T11:08:25.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.707+0000 7fa215a00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa1e806aed0 0x7fa1e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:25.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.708+0000 7fa215a00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa1e806aed0 0x7fa1e806d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa200000f60 tx=0x7fa200009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:25.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.711+0000 7fa20d600640 1 -- 172.21.15.162:0/4110370891 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa208075f40 con 0x7fa21015b060 2024-01-20T11:08:25.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.908+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2100ae3b0 con 0x7fa21015b060 2024-01-20T11:08:25.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.909+0000 7fa20d600640 1 -- 172.21.15.162:0/4110370891 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2080390a0 con 0x7fa21015b060 2024-01-20T11:08:25.909 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.911+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa1e806aed0 msgr2=0x7fa1e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.911+0000 7fa216e00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa1e806aed0 0x7fa1e806d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa200000f60 tx=0x7fa200009040 comp rx=0 tx=0).stop 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21015b060 msgr2=0x7fa2101f6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21015b060 0x7fa2101f6220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa208037040 tx=0x7fa208009750 comp rx=0 tx=0).stop 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 shutdown_connections 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21015b060 0x7fa2101f6220 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa1e806aed0 0x7fa1e806d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa210159d10 0x7fa21015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 --2- 172.21.15.162:0/4110370891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1f0004d00 0x7fa2101f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 >> 172.21.15.162:0/4110370891 conn(0x7fa2100b0c40 msgr2=0x7fa21015db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 shutdown_connections 2024-01-20T11:08:25.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:25.912+0000 7fa216e00640 1 -- 172.21.15.162:0/4110370891 wait complete. 2024-01-20T11:08:25.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:26.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.142+0000 7fb2cbe00640 1 Processor -- start 2024-01-20T11:08:26.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.142+0000 7fb2cbe00640 1 -- start start 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.143+0000 7fb2cbe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2cc13e040 0x7fb2cc0cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.143+0000 7fb2cbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2cc0cd9c0 0x7fb2cc0cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.143+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2cbe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc15b910 con 0x7fb2cc0cd9c0 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2cbe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc15bbf0 con 0x7fb2cc13e040 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2cbe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc15bed0 con 0x7fb2cc0cb9d0 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2cc0cd9c0 0x7fb2cc0cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2cc0cd9c0 0x7fb2cc0cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34840/0 (socket says 172.21.15.162:34840) 2024-01-20T11:08:26.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 -- 172.21.15.162:0/2974438304 learned_addr learned my addr 172.21.15.162:0/2974438304 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2caa00640 1 --2- 172.21.15.162:0/2974438304 >> v2:172.21.15.179:3300/0 conn(0x7fb2cc13e040 0x7fb2cc0cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2cb400640 1 --2- 172.21.15.162:0/2974438304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 -- 172.21.15.162:0/2974438304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 msgr2=0x7fb2cc0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 --2- 172.21.15.162:0/2974438304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 -- 172.21.15.162:0/2974438304 >> v2:172.21.15.179:3300/0 conn(0x7fb2cc13e040 msgr2=0x7fb2cc0cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 --2- 172.21.15.162:0/2974438304 >> v2:172.21.15.179:3300/0 conn(0x7fb2cc13e040 0x7fb2cc0cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2c1e00640 1 -- 172.21.15.162:0/2974438304 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc15c1b0 con 0x7fb2cc0cd9c0 2024-01-20T11:08:26.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.144+0000 7fb2cb400640 1 --2- 172.21.15.162:0/2974438304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:26.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.145+0000 7fb2c1e00640 1 --2- 172.21.15.162:0/2974438304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc0cf8b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0b5080 tx=0x7fb2b402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05ce17082387e1d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:26.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.146+0000 7fb2ca000640 1 -- 172.21.15.162:0/2974438304 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40317d0 con 0x7fb2cc0cd9c0 2024-01-20T11:08:26.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.146+0000 7fb2ca000640 1 -- 172.21.15.162:0/2974438304 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b4031930 con 0x7fb2cc0cd9c0 2024-01-20T11:08:26.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.146+0000 7fb2ca000640 1 -- 172.21.15.162:0/2974438304 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4031cc0 con 0x7fb2cc0cd9c0 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.146+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2974438304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc0cd9c0 msgr2=0x7fb2cc0cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2974438304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc0cf8b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0b5080 tx=0x7fb2b402b870 comp rx=0 tx=0).stop 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2974438304 shutdown_connections 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2974438304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2974438304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc0cf8b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2974438304 >> v2:172.21.15.179:3300/0 conn(0x7fb2cc13e040 0x7fb2cc0cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2974438304 >> 172.21.15.162:0/2974438304 conn(0x7fb2cc06aa20 msgr2=0x7fb2cc06ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2974438304 shutdown_connections 2024-01-20T11:08:26.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.147+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2974438304 wait complete. 2024-01-20T11:08:26.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.148+0000 7fb2cbe00640 1 Processor -- start 2024-01-20T11:08:26.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.149+0000 7fb2cbe00640 1 -- start start 2024-01-20T11:08:26.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.149+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.149+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc1f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.149+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc13e040 0x7fb2cc15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc1f2dc0 con 0x7fb2cc13e040 2024-01-20T11:08:26.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cbe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc136e90 con 0x7fb2cc0cd9c0 2024-01-20T11:08:26.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cbe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc137170 con 0x7fb2cc0cb9d0 2024-01-20T11:08:26.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc13e040 0x7fb2cc15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc13e040 0x7fb2cc15a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34852/0 (socket says 172.21.15.162:34852) 2024-01-20T11:08:26.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 -- 172.21.15.162:0/2192037291 learned_addr learned my addr 172.21.15.162:0/2192037291 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2c1e00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc1f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 -- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 msgr2=0x7fb2cc1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 -- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2cc0cd9c0 msgr2=0x7fb2cc1f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc1f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2cb400640 1 -- 172.21.15.162:0/2192037291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40094d0 con 0x7fb2cc13e040 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.150+0000 7fb2c1e00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc1f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.151+0000 7fb2cb400640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc13e040 0x7fb2cc15a2d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400cef0 tx=0x7fb2c400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:26.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.151+0000 7fb2c3400640 1 -- 172.21.15.162:0/2192037291 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400d840 con 0x7fb2cc13e040 2024-01-20T11:08:26.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.151+0000 7fb2c3400640 1 -- 172.21.15.162:0/2192037291 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c400d9a0 con 0x7fb2cc13e040 2024-01-20T11:08:26.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.151+0000 7fb2c3400640 1 -- 172.21.15.162:0/2192037291 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400dd50 con 0x7fb2cc13e040 2024-01-20T11:08:26.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.151+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc070ee0 con 0x7fb2cc13e040 2024-01-20T11:08:26.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.151+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc153eb0 con 0x7fb2cc13e040 2024-01-20T11:08:26.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.152+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc137340 con 0x7fb2cc13e040 2024-01-20T11:08:26.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.153+0000 7fb2c3400640 1 -- 172.21.15.162:0/2192037291 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb2c401e3b0 con 0x7fb2cc13e040 2024-01-20T11:08:26.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.154+0000 7fb2c3400640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb2a406aed0 0x7fb2a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.154+0000 7fb2c3400640 1 -- 172.21.15.162:0/2192037291 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb2c408a260 con 0x7fb2cc13e040 2024-01-20T11:08:26.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.155+0000 7fb2caa00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb2a406aed0 0x7fb2a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.155+0000 7fb2caa00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb2a406aed0 0x7fb2a406d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc006fd0 tx=0x7fb2bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:26.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.159+0000 7fb2c3400640 1 -- 172.21.15.162:0/2192037291 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb2c4054f80 con 0x7fb2cc13e040 2024-01-20T11:08:26.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.395+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2cc070d20 con 0x7fb2cc13e040 2024-01-20T11:08:26.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.396+0000 7fb2c3400640 1 -- 172.21.15.162:0/2192037291 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fb2c401a090 con 0x7fb2cc13e040 2024-01-20T11:08:26.397 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:26.397 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:08:26.397 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:08:26.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb2a406aed0 msgr2=0x7fb2a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb2a406aed0 0x7fb2a406d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc006fd0 tx=0x7fb2bc008040 comp rx=0 tx=0).stop 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc13e040 msgr2=0x7fb2cc15a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc13e040 0x7fb2cc15a2d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400cef0 tx=0x7fb2c400a710 comp rx=0 tx=0).stop 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 shutdown_connections 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2cc13e040 0x7fb2cc15a2d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb2a406aed0 0x7fb2a406d390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2cc0cd9c0 0x7fb2cc1f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 --2- 172.21.15.162:0/2192037291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2cc0cb9d0 0x7fb2cc1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 >> 172.21.15.162:0/2192037291 conn(0x7fb2cc06aa20 msgr2=0x7fb2cc0cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 shutdown_connections 2024-01-20T11:08:26.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.399+0000 7fb2cbe00640 1 -- 172.21.15.162:0/2192037291 wait complete. 2024-01-20T11:08:26.419 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:26.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.626+0000 7f3c48200640 1 Processor -- start 2024-01-20T11:08:26.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.626+0000 7f3c48200640 1 -- start start 2024-01-20T11:08:26.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.627+0000 7f3c48200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c40071260 0x7f3c400716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.627+0000 7f3c48200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c4006d7a0 0x7f3c4006dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.627+0000 7f3c48200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4015a910 con 0x7f3c4015a530 2024-01-20T11:08:26.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.627+0000 7f3c48200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400ca390 con 0x7f3c4006d7a0 2024-01-20T11:08:26.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.627+0000 7f3c48200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4006e170 con 0x7f3c40071260 2024-01-20T11:08:26.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c45800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3c4015a530 0x7f3c400cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45734/0 (socket says 172.21.15.162:45734) 2024-01-20T11:08:26.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c45800640 1 -- 172.21.15.162:0/269515413 learned_addr learned my addr 172.21.15.162:0/269515413 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:26.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c46200640 1 --2- 172.21.15.162:0/269515413 >> v2:172.21.15.162:3300/0 conn(0x7f3c4006d7a0 0x7f3c4006dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c44e00640 1 --2- 172.21.15.162:0/269515413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c40071260 0x7f3c400716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c46200640 1 -- 172.21.15.162:0/269515413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c40071260 msgr2=0x7f3c400716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c46200640 1 --2- 172.21.15.162:0/269515413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c40071260 0x7f3c400716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c46200640 1 -- 172.21.15.162:0/269515413 >> v1:172.21.15.162:6789/0 conn(0x7f3c4015a530 legacy=0x7f3c400cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c46200640 1 -- 172.21.15.162:0/269515413 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40072960 con 0x7f3c4006d7a0 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c3fe00640 1 -- 172.21.15.162:0/269515413 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827895392 0 0) 0x7f3c4015a910 con 0x7f3c4015a530 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.628+0000 7f3c44e00640 1 --2- 172.21.15.162:0/269515413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c40071260 0x7f3c400716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.629+0000 7f3c46200640 1 --2- 172.21.15.162:0/269515413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c4006dc30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009dc0 tx=0x7f3c3802be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8019fbf25371f8e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c3fe00640 1 -- 172.21.15.162:0/269515413 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3802cbb0 con 0x7f3c4006d7a0 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c3fe00640 1 -- 172.21.15.162:0/269515413 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3802cd10 con 0x7f3c4006d7a0 2024-01-20T11:08:26.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c3fe00640 1 -- 172.21.15.162:0/269515413 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38034660 con 0x7f3c4006d7a0 2024-01-20T11:08:26.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 -- 172.21.15.162:0/269515413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 msgr2=0x7f3c4006dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 --2- 172.21.15.162:0/269515413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c4006dc30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009dc0 tx=0x7f3c3802be00 comp rx=0 tx=0).stop 2024-01-20T11:08:26.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 -- 172.21.15.162:0/269515413 shutdown_connections 2024-01-20T11:08:26.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 --2- 172.21.15.162:0/269515413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c40071260 0x7f3c400716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 --2- 172.21.15.162:0/269515413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c4006dc30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 -- 172.21.15.162:0/269515413 >> 172.21.15.162:0/269515413 conn(0x7f3c400b0cd0 msgr2=0x7f3c400b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:26.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 -- 172.21.15.162:0/269515413 shutdown_connections 2024-01-20T11:08:26.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.630+0000 7f3c48200640 1 -- 172.21.15.162:0/269515413 wait complete. 2024-01-20T11:08:26.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.632+0000 7f3c48200640 1 Processor -- start 2024-01-20T11:08:26.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.632+0000 7f3c48200640 1 -- start start 2024-01-20T11:08:26.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.633+0000 7f3c48200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c400b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.633+0000 7f3c48200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c40071260 0x7f3c40144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.633+0000 7f3c48200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c4015a530 0x7f3c400ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.633+0000 7f3c48200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4009c940 con 0x7f3c4006d7a0 2024-01-20T11:08:26.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.633+0000 7f3c48200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40159ec0 con 0x7f3c40071260 2024-01-20T11:08:26.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.633+0000 7f3c48200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4009c380 con 0x7f3c4015a530 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c400b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c400b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36176/0 (socket says 172.21.15.162:36176) 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 -- 172.21.15.162:0/1499729227 learned_addr learned my addr 172.21.15.162:0/1499729227 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c44e00640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c40071260 0x7f3c40144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c46200640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c4015a530 0x7f3c400ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 -- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c4015a530 msgr2=0x7f3c400ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c4015a530 0x7f3c400ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 -- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c40071260 msgr2=0x7f3c40144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c40071260 0x7f3c40144c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 -- 172.21.15.162:0/1499729227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38009a70 con 0x7f3c4006d7a0 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.634+0000 7f3c45800640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c400b47e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c430 tx=0x7f3c3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.635+0000 7f3c3d600640 1 -- 172.21.15.162:0/1499729227 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300074e0 con 0x7f3c4006d7a0 2024-01-20T11:08:26.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.635+0000 7f3c3d600640 1 -- 172.21.15.162:0/1499729227 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c30007660 con 0x7f3c4006d7a0 2024-01-20T11:08:26.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.635+0000 7f3c3d600640 1 -- 172.21.15.162:0/1499729227 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30004a20 con 0x7f3c4006d7a0 2024-01-20T11:08:26.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.635+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4009c660 con 0x7f3c4006d7a0 2024-01-20T11:08:26.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.635+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c401451b0 con 0x7f3c4006d7a0 2024-01-20T11:08:26.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.636+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c40145530 con 0x7f3c4006d7a0 2024-01-20T11:08:26.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.637+0000 7f3c3d600640 1 -- 172.21.15.162:0/1499729227 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3c30004b80 con 0x7f3c4006d7a0 2024-01-20T11:08:26.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.638+0000 7f3c3d600640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3c1806af00 0x7f3c1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:26.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.638+0000 7f3c3d600640 1 -- 172.21.15.162:0/1499729227 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3c30089570 con 0x7f3c4006d7a0 2024-01-20T11:08:26.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.638+0000 7f3c44e00640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3c1806af00 0x7f3c1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:26.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.639+0000 7f3c44e00640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3c1806af00 0x7f3c1806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c4015a070 tx=0x7f3c28008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:26.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.642+0000 7f3c3d600640 1 -- 172.21.15.162:0/1499729227 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3c40145530 con 0x7f3c4006d7a0 2024-01-20T11:08:26.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.837+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c40145910 con 0x7f3c4006d7a0 2024-01-20T11:08:26.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.840+0000 7f3c3d600640 1 -- 172.21.15.162:0/1499729227 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16779 (secure 0 0 0) 0x7f3c40145910 con 0x7f3c4006d7a0 2024-01-20T11:08:26.841 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:26.841 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":24,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:19.556914+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3c1806af00 msgr2=0x7f3c1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3c1806af00 0x7f3c1806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c4015a070 tx=0x7f3c28008040 comp rx=0 tx=0).stop 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 msgr2=0x7f3c400b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c400b47e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c430 tx=0x7f3c3000c8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 shutdown_connections 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c4015a530 0x7f3c400ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3c1806af00 0x7f3c1806d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c40071260 0x7f3c40144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 --2- 172.21.15.162:0/1499729227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c4006d7a0 0x7f3c400b47e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 >> 172.21.15.162:0/1499729227 conn(0x7f3c400b0cd0 msgr2=0x7f3c400ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 shutdown_connections 2024-01-20T11:08:26.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:26.843+0000 7f3c48200640 1 -- 172.21.15.162:0/1499729227 wait complete. 2024-01-20T11:08:26.863 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T11:08:26.863 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:27.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.072+0000 7f3a80000640 1 Processor -- start 2024-01-20T11:08:27.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.072+0000 7f3a80000640 1 -- start start 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a80000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a780c9630 0x7f3a78162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a80000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a780c9a10 0x7f3a780cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a80000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7806c730 con 0x7f3a7806d1d0 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a80000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a780cbee0 con 0x7f3a780c9a10 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a80000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a780cc1a0 con 0x7f3a780c9630 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a7cc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a780c9a10 0x7f3a780cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a7cc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a780c9a10 0x7f3a780cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36188/0 (socket says 172.21.15.162:36188) 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.074+0000 7f3a7cc00640 1 -- 172.21.15.162:0/3142160960 learned_addr learned my addr 172.21.15.162:0/3142160960 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:27.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.075+0000 7f3a7d600640 1 --2- 172.21.15.162:0/3142160960 >> v2:172.21.15.179:3300/0 conn(0x7f3a780c9630 0x7f3a78162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.075+0000 7f3a7cc00640 1 -- 172.21.15.162:0/3142160960 >> v2:172.21.15.179:3300/0 conn(0x7f3a780c9630 msgr2=0x7f3a78162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:27.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.075+0000 7f3a7cc00640 1 --2- 172.21.15.162:0/3142160960 >> v2:172.21.15.179:3300/0 conn(0x7f3a780c9630 0x7f3a78162c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.075+0000 7f3a7cc00640 1 -- 172.21.15.162:0/3142160960 >> v1:172.21.15.179:6789/0 conn(0x7f3a7806d1d0 legacy=0x7f3a78070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:27.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.075+0000 7f3a7cc00640 1 -- 172.21.15.162:0/3142160960 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7806c9d0 con 0x7f3a780c9a10 2024-01-20T11:08:27.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.076+0000 7f3a7cc00640 1 --2- 172.21.15.162:0/3142160960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9a10 0x7f3a780cb9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a780b1c00 tx=0x7f3a6002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747eca300e1ec19d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:27.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.076+0000 7f3a77e00640 1 -- 172.21.15.162:0/3142160960 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a600317e0 con 0x7f3a780c9a10 2024-01-20T11:08:27.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.076+0000 7f3a77e00640 1 -- 172.21.15.162:0/3142160960 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60031940 con 0x7f3a780c9a10 2024-01-20T11:08:27.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.076+0000 7f3a77e00640 1 -- 172.21.15.162:0/3142160960 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60031cd0 con 0x7f3a780c9a10 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 -- 172.21.15.162:0/3142160960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9a10 msgr2=0x7f3a780cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 --2- 172.21.15.162:0/3142160960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9a10 0x7f3a780cb9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a780b1c00 tx=0x7f3a6002b880 comp rx=0 tx=0).stop 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 -- 172.21.15.162:0/3142160960 shutdown_connections 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 --2- 172.21.15.162:0/3142160960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9a10 0x7f3a780cb9a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 --2- 172.21.15.162:0/3142160960 >> v2:172.21.15.179:3300/0 conn(0x7f3a780c9630 0x7f3a78162c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 -- 172.21.15.162:0/3142160960 >> 172.21.15.162:0/3142160960 conn(0x7f3a780b0cd0 msgr2=0x7f3a780b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 -- 172.21.15.162:0/3142160960 shutdown_connections 2024-01-20T11:08:27.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.077+0000 7f3a80000640 1 -- 172.21.15.162:0/3142160960 wait complete. 2024-01-20T11:08:27.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.079+0000 7f3a80000640 1 Processor -- start 2024-01-20T11:08:27.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.080+0000 7f3a80000640 1 -- start start 2024-01-20T11:08:27.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a80000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7806d1d0 0x7f3a780cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a80000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9630 0x7f3a781465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a80000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780c9a10 0x7f3a780b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a80000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78146ae0 con 0x7f3a780c9630 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a80000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780cecc0 con 0x7f3a7806d1d0 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a80000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780ce9e0 con 0x7f3a780c9a10 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a7cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9630 0x7f3a781465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a7cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9630 0x7f3a781465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36192/0 (socket says 172.21.15.162:36192) 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.081+0000 7f3a7cc00640 1 -- 172.21.15.162:0/649912188 learned_addr learned my addr 172.21.15.162:0/649912188 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7d600640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7806d1d0 0x7f3a780cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7e000640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780c9a10 0x7f3a780b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7cc00640 1 -- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780c9a10 msgr2=0x7f3a780b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7cc00640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780c9a10 0x7f3a780b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7cc00640 1 -- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7806d1d0 msgr2=0x7f3a780cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7cc00640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7806d1d0 0x7f3a780cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7cc00640 1 -- 172.21.15.162:0/649912188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600094d0 con 0x7f3a780c9630 2024-01-20T11:08:27.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a7cc00640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9630 0x7f3a781465a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3a60000c00 tx=0x7f3a600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:27.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a75600640 1 -- 172.21.15.162:0/649912188 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60032880 con 0x7f3a780c9630 2024-01-20T11:08:27.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a75600640 1 -- 172.21.15.162:0/649912188 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a600329e0 con 0x7f3a780c9630 2024-01-20T11:08:27.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.082+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a780cd010 con 0x7f3a780c9630 2024-01-20T11:08:27.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.083+0000 7f3a75600640 1 -- 172.21.15.162:0/649912188 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60032d90 con 0x7f3a780c9630 2024-01-20T11:08:27.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.083+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a780cd5d0 con 0x7f3a780c9630 2024-01-20T11:08:27.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.084+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a780cee00 con 0x7f3a780c9630 2024-01-20T11:08:27.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.085+0000 7f3a75600640 1 -- 172.21.15.162:0/649912188 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3a6004d3f0 con 0x7f3a780c9630 2024-01-20T11:08:27.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.085+0000 7f3a75600640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3a5006aed0 0x7f3a5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.086+0000 7f3a75600640 1 -- 172.21.15.162:0/649912188 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3a600ab500 con 0x7f3a780c9630 2024-01-20T11:08:27.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.086+0000 7f3a7d600640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3a5006aed0 0x7f3a5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.087+0000 7f3a7d600640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3a5006aed0 0x7f3a5006d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009ae0 tx=0x7f3a68003a10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:27.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.090+0000 7f3a75600640 1 -- 172.21.15.162:0/649912188 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3a600763f0 con 0x7f3a780c9630 2024-01-20T11:08:27.313 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:08:27.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:08:27.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.324+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a780cfee0 con 0x7f3a780c9630 2024-01-20T11:08:27.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.325+0000 7f3a75600640 1 -- 172.21.15.162:0/649912188 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f3a60079a10 con 0x7f3a780c9630 2024-01-20T11:08:27.326 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:27.326 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:08:27.326 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:08:27.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.327+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3a5006aed0 msgr2=0x7f3a5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.327+0000 7f3a80000640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3a5006aed0 0x7f3a5006d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009ae0 tx=0x7f3a68003a10 comp rx=0 tx=0).stop 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.327+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9630 msgr2=0x7f3a781465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.327+0000 7f3a80000640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9630 0x7f3a781465a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3a60000c00 tx=0x7f3a600046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 shutdown_connections 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780c9a10 0x7f3a780b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a780c9630 0x7f3a781465a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3a5006aed0 0x7f3a5006d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 --2- 172.21.15.162:0/649912188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7806d1d0 0x7f3a780cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 >> 172.21.15.162:0/649912188 conn(0x7f3a780b0cd0 msgr2=0x7f3a780ac950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 shutdown_connections 2024-01-20T11:08:27.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.328+0000 7f3a80000640 1 -- 172.21.15.162:0/649912188 wait complete. 2024-01-20T11:08:27.345 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:27.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.583+0000 7f38c0a00640 1 Processor -- start 2024-01-20T11:08:27.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.583+0000 7f38c0a00640 1 -- start start 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38c0a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f38b8155a30 0x7f38b80ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38c0a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38b80ae6b0 0x7f38b806c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38c0a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b8070b60 con 0x7f38b8070630 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38c0a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b815ba10 con 0x7f38b8155a30 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38c0a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b815bc00 con 0x7f38b80ae6b0 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38bd600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f38b8070630 0x7f38b80adfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45738/0 (socket says 172.21.15.162:45738) 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38bd600640 1 -- 172.21.15.162:0/4287844304 learned_addr learned my addr 172.21.15.162:0/4287844304 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:27.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38be000640 1 --2- 172.21.15.162:0/4287844304 >> v2:172.21.15.162:3300/0 conn(0x7f38b8155a30 0x7f38b80ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.585+0000 7f38bea00640 1 --2- 172.21.15.162:0/4287844304 >> v2:172.21.15.179:3300/0 conn(0x7f38b80ae6b0 0x7f38b806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.586+0000 7f38be000640 1 -- 172.21.15.162:0/4287844304 >> v2:172.21.15.179:3300/0 conn(0x7f38b80ae6b0 msgr2=0x7f38b806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:27.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.586+0000 7f38be000640 1 --2- 172.21.15.162:0/4287844304 >> v2:172.21.15.179:3300/0 conn(0x7f38b80ae6b0 0x7f38b806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.586+0000 7f38be000640 1 -- 172.21.15.162:0/4287844304 >> v1:172.21.15.162:6789/0 conn(0x7f38b8070630 legacy=0x7f38b80adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.586+0000 7f38bcc00640 1 -- 172.21.15.162:0/4287844304 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809672682 0 0) 0x7f38b8070b60 con 0x7f38b8070630 2024-01-20T11:08:27.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.586+0000 7f38be000640 1 -- 172.21.15.162:0/4287844304 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b815bee0 con 0x7f38b8155a30 2024-01-20T11:08:27.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.587+0000 7f38be000640 1 --2- 172.21.15.162:0/4287844304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b8155a30 0x7f38b80ce800 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f38b8071ba0 tx=0x7f38a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c516d1b3a5ead30a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:27.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.587+0000 7f38bcc00640 1 -- 172.21.15.162:0/4287844304 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a802e070 con 0x7f38b8155a30 2024-01-20T11:08:27.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.587+0000 7f38bcc00640 1 -- 172.21.15.162:0/4287844304 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a80315a0 con 0x7f38b8155a30 2024-01-20T11:08:27.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.587+0000 7f38bcc00640 1 -- 172.21.15.162:0/4287844304 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8031930 con 0x7f38b8155a30 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 -- 172.21.15.162:0/4287844304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b8155a30 msgr2=0x7f38b80ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 --2- 172.21.15.162:0/4287844304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b8155a30 0x7f38b80ce800 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f38b8071ba0 tx=0x7f38a802b840 comp rx=0 tx=0).stop 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 -- 172.21.15.162:0/4287844304 shutdown_connections 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 --2- 172.21.15.162:0/4287844304 >> v2:172.21.15.179:3300/0 conn(0x7f38b80ae6b0 0x7f38b806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 --2- 172.21.15.162:0/4287844304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b8155a30 0x7f38b80ce800 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 -- 172.21.15.162:0/4287844304 >> 172.21.15.162:0/4287844304 conn(0x7f38b80b0cd0 msgr2=0x7f38b80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 -- 172.21.15.162:0/4287844304 shutdown_connections 2024-01-20T11:08:27.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.588+0000 7f38c0a00640 1 -- 172.21.15.162:0/4287844304 wait complete. 2024-01-20T11:08:27.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.590+0000 7f38c0a00640 1 Processor -- start 2024-01-20T11:08:27.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.590+0000 7f38c0a00640 1 -- start start 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38c0a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38b8070630 0x7f38b809cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38c0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b80ae6b0 0x7f38b81462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38c0a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38b8155a30 0x7f38b80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38c0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b809bf40 con 0x7f38b80ae6b0 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38c0a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b809c220 con 0x7f38b8155a30 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38c0a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b809c500 con 0x7f38b8070630 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38bd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b80ae6b0 0x7f38b81462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38bd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b80ae6b0 0x7f38b81462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36204/0 (socket says 172.21.15.162:36204) 2024-01-20T11:08:27.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.591+0000 7f38bd600640 1 -- 172.21.15.162:0/3391396457 learned_addr learned my addr 172.21.15.162:0/3391396457 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bea00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38b8155a30 0x7f38b80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38be000640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38b8070630 0x7f38b809cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bd600640 1 -- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38b8070630 msgr2=0x7f38b809cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bd600640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38b8070630 0x7f38b809cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bd600640 1 -- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38b8155a30 msgr2=0x7f38b80c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bd600640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38b8155a30 0x7f38b80c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bd600640 1 -- 172.21.15.162:0/3391396457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a8009400 con 0x7f38b80ae6b0 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38be000640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38b8070630 0x7f38b809cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bea00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38b8155a30 0x7f38b80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38bd600640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b80ae6b0 0x7f38b81462d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c430 tx=0x7f38a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38b6000640 1 -- 172.21.15.162:0/3391396457 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00074e0 con 0x7f38b80ae6b0 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38b6000640 1 -- 172.21.15.162:0/3391396457 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0007660 con 0x7f38b80ae6b0 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b809c7e0 con 0x7f38b80ae6b0 2024-01-20T11:08:27.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.592+0000 7f38b6000640 1 -- 172.21.15.162:0/3391396457 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0004a20 con 0x7f38b80ae6b0 2024-01-20T11:08:27.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.593+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b809bb60 con 0x7f38b80ae6b0 2024-01-20T11:08:27.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.594+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b804e970 con 0x7f38b80ae6b0 2024-01-20T11:08:27.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.594+0000 7f38b6000640 1 -- 172.21.15.162:0/3391396457 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f38a0004b80 con 0x7f38b80ae6b0 2024-01-20T11:08:27.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.595+0000 7f38b6000640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f389006aed0 0x7f389006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:27.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.596+0000 7f38b6000640 1 -- 172.21.15.162:0/3391396457 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f38a00895e0 con 0x7f38b80ae6b0 2024-01-20T11:08:27.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.596+0000 7f38be000640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f389006aed0 0x7f389006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:27.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.596+0000 7f38be000640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f389006aed0 0x7f389006d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38a8036000 tx=0x7f38a803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:27.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.600+0000 7f38b6000640 1 -- 172.21.15.162:0/3391396457 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f38a0054390 con 0x7f38b80ae6b0 2024-01-20T11:08:27.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.833+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38b809c080 con 0x7f38b80ae6b0 2024-01-20T11:08:27.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.834+0000 7f38b6000640 1 -- 172.21.15.162:0/3391396457 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f38b809c080 con 0x7f38b80ae6b0 2024-01-20T11:08:27.835 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:27.835 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/168769233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":168769233},{"type":"v1","addr":"172.21.15.162:6837","nonce":168769233}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1545821403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1545821403},{"type":"v1","addr":"172.21.15.162:6835","nonce":1545821403}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3562947151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3562947151},{"type":"v1","addr":"172.21.15.179:6834","nonce":3562947151}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:07:31.927045+0000","modified":"2024-01-20T11:07:35.046211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2704155734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2704155734},{"type":"v1","addr":"172.21.15.179:6835","nonce":2704155734}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T11:08:27.835 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 8 2024-01-20T11:08:27.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.836+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f389006aed0 msgr2=0x7f389006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.836+0000 7f38c0a00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f389006aed0 0x7f389006d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38a8036000 tx=0x7f38a803d040 comp rx=0 tx=0).stop 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.836+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b80ae6b0 msgr2=0x7f38b81462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b80ae6b0 0x7f38b81462d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c430 tx=0x7f38a000c8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 shutdown_connections 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f389006aed0 0x7f389006d390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38b8155a30 0x7f38b80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b80ae6b0 0x7f38b81462d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 --2- 172.21.15.162:0/3391396457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38b8070630 0x7f38b809cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 >> 172.21.15.162:0/3391396457 conn(0x7f38b80b0cd0 msgr2=0x7f38b806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 shutdown_connections 2024-01-20T11:08:27.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:27.837+0000 7f38c0a00640 1 -- 172.21.15.162:0/3391396457 wait complete. 2024-01-20T11:08:27.854 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:28.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.055+0000 7f3bffe00640 1 Processor -- start 2024-01-20T11:08:28.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.056+0000 7f3bffe00640 1 -- start start 2024-01-20T11:08:28.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.057+0000 7f3bffe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c0015d420 0x7f3c000d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.057+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000d1f90 0x7f3c000b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.057+0000 7f3bffe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000b2880 con 0x7f3c0015d800 2024-01-20T11:08:28.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.057+0000 7f3bffe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c00161110 con 0x7f3c0015d420 2024-01-20T11:08:28.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.057+0000 7f3bffe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001613f0 con 0x7f3c000d1f90 2024-01-20T11:08:28.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.057+0000 7f3bfe000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3c0015d800 0x7f3c000d1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45750/0 (socket says 172.21.15.162:45750) 2024-01-20T11:08:28.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.057+0000 7f3bfe000640 1 -- 172.21.15.162:0/1974546973 learned_addr learned my addr 172.21.15.162:0/1974546973 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:28.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfea00640 1 --2- 172.21.15.162:0/1974546973 >> v2:172.21.15.179:3300/0 conn(0x7f3c0015d420 0x7f3c000d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564923646 0 0) 0x7f3c000b2880 con 0x7f3c0015d800 2024-01-20T11:08:28.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be0003520 con 0x7f3c0015d800 2024-01-20T11:08:28.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bff400640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000d1f90 0x7f3c000b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1072717697 0 0) 0x7f3be0003520 con 0x7f3c0015d800 2024-01-20T11:08:28.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000d1f90 msgr2=0x7f3c000b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000d1f90 0x7f3c000b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 >> v2:172.21.15.179:3300/0 conn(0x7f3c0015d420 msgr2=0x7f3c000d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 --2- 172.21.15.162:0/1974546973 >> v2:172.21.15.179:3300/0 conn(0x7f3c0015d420 0x7f3c000d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c001616d0 con 0x7f3c0015d800 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f3be8001690 con 0x7f3c0015d800 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 >> v1:172.21.15.162:6789/0 conn(0x7f3c0015d800 legacy=0x7f3c000d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be0003970 0x7f3be0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000d1f90 0x7f3be00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3be0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00161110 con 0x7f3be0004d00 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001613f0 con 0x7f3be0003970 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.058+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be000bac0 con 0x7f3c000d1f90 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.059+0000 7f3bff400640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3be0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.059+0000 7f3bff400640 1 -- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000d1f90 msgr2=0x7f3be00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.059+0000 7f3bff400640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000d1f90 0x7f3be00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.059+0000 7f3bff400640 1 -- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be0003970 msgr2=0x7f3be0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.059+0000 7f3bfea00640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be0003970 0x7f3be0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.059+0000 7f3bff400640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be0003970 0x7f3be0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.059+0000 7f3bff400640 1 -- 172.21.15.162:0/1974546973 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0003520 con 0x7f3be0004d00 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.060+0000 7f3bff400640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3be0005180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007330 tx=0x7f3be00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971656b69ad6dac6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.060+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf802ccd0 con 0x7f3be0004d00 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.060+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf802ce30 con 0x7f3be0004d00 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.060+0000 7f3bfd600640 1 -- 172.21.15.162:0/1974546973 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8034660 con 0x7f3be0004d00 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.061+0000 7f3bffe00640 1 -- 172.21.15.162:0/1974546973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 msgr2=0x7f3be0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.061+0000 7f3bffe00640 1 --2- 172.21.15.162:0/1974546973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3be0005180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007330 tx=0x7f3be00057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.061+0000 7f3bff400640 1 -- 172.21.15.162:0/1974546973 reap_dead start 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.061+0000 7f3bffe00640 1 -- 172.21.15.162:0/1974546973 shutdown_connections 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.061+0000 7f3bffe00640 1 -- 172.21.15.162:0/1974546973 >> 172.21.15.162:0/1974546973 conn(0x7f3c0008cc50 msgr2=0x7f3c0009c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.061+0000 7f3bffe00640 1 -- 172.21.15.162:0/1974546973 shutdown_connections 2024-01-20T11:08:28.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.061+0000 7f3bffe00640 1 -- 172.21.15.162:0/1974546973 wait complete. 2024-01-20T11:08:28.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.063+0000 7f3bffe00640 1 Processor -- start 2024-01-20T11:08:28.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.064+0000 7f3bffe00640 1 -- start start 2024-01-20T11:08:28.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3c001512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000c9340 0x7f3c0015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c000c7930 0x7f3c000b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bffe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000b0d60 con 0x7f3be0004d00 2024-01-20T11:08:28.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bffe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015e150 con 0x7f3c000c7930 2024-01-20T11:08:28.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bffe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000c6e70 con 0x7f3c000c9340 2024-01-20T11:08:28.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bfea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3c001512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bfea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3c001512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36226/0 (socket says 172.21.15.162:36226) 2024-01-20T11:08:28.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bfea00640 1 -- 172.21.15.162:0/406434135 learned_addr learned my addr 172.21.15.162:0/406434135 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.065+0000 7f3bfea00640 1 -- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000c9340 msgr2=0x7f3c0015dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bfe000640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000c9340 0x7f3c0015dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bff400640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c000c7930 0x7f3c000b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bfea00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000c9340 0x7f3c0015dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bfea00640 1 -- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c000c7930 msgr2=0x7f3c000b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bfea00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c000c7930 0x7f3c000b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bfea00640 1 -- 172.21.15.162:0/406434135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000c7150 con 0x7f3be0004d00 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bfe000640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000c9340 0x7f3c0015dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bff400640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c000c7930 0x7f3c000b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bfea00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3c001512d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00108c0 tx=0x7f3bf0010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bf6a00640 1 -- 172.21.15.162:0/406434135 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0009630 con 0x7f3be0004d00 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bf6a00640 1 -- 172.21.15.162:0/406434135 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf000eb60 con 0x7f3be0004d00 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bf6a00640 1 -- 172.21.15.162:0/406434135 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf001c400 con 0x7f3be0004d00 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c000c7430 con 0x7f3be0004d00 2024-01-20T11:08:28.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.066+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c000c9ad0 con 0x7f3be0004d00 2024-01-20T11:08:28.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.068+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000c7620 con 0x7f3be0004d00 2024-01-20T11:08:28.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.068+0000 7f3bf6a00640 1 -- 172.21.15.162:0/406434135 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3bf00143f0 con 0x7f3be0004d00 2024-01-20T11:08:28.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.069+0000 7f3bf6a00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3bd806aed0 0x7f3bd806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.069+0000 7f3bf6a00640 1 -- 172.21.15.162:0/406434135 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3bf0089c80 con 0x7f3be0004d00 2024-01-20T11:08:28.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.069+0000 7f3bfe000640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3bd806aed0 0x7f3bd806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.070+0000 7f3bfe000640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3bd806aed0 0x7f3bd806d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3be80017c0 tx=0x7f3be8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.075+0000 7f3bf6a00640 1 -- 172.21.15.162:0/406434135 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3c000c7620 con 0x7f3be0004d00 2024-01-20T11:08:28.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.253+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c000c7620 con 0x7f3be0004d00 2024-01-20T11:08:28.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.255+0000 7f3bf6a00640 1 -- 172.21.15.162:0/406434135 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16779 (secure 0 0 0) 0x7f3c000c7620 con 0x7f3be0004d00 2024-01-20T11:08:28.256 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:28.256 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":24,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:19.556914+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:07:29.823472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T11:07:30.927769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:28.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3bd806aed0 msgr2=0x7f3bd806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3bd806aed0 0x7f3bd806d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3be80017c0 tx=0x7f3be8009040 comp rx=0 tx=0).stop 2024-01-20T11:08:28.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 msgr2=0x7f3c001512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3c001512d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00108c0 tx=0x7f3bf0010d80 comp rx=0 tx=0).stop 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 shutdown_connections 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3bd806aed0 0x7f3bd806d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c000c7930 0x7f3c000b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c000c9340 0x7f3c0015dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 --2- 172.21.15.162:0/406434135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3be0004d00 0x7f3c001512d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 >> 172.21.15.162:0/406434135 conn(0x7f3c0008cc50 msgr2=0x7f3c0015b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 shutdown_connections 2024-01-20T11:08:28.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.258+0000 7f3bffe00640 1 -- 172.21.15.162:0/406434135 wait complete. 2024-01-20T11:08:28.277 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-20T11:08:28.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.480+0000 7f09d6600640 1 Processor -- start 2024-01-20T11:08:28.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.480+0000 7f09d6600640 1 -- start start 2024-01-20T11:08:28.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09d6600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d00cdf90 0x7f09d00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09d6600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0071830 con 0x7f09d0071cc0 2024-01-20T11:08:28.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09d6600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0070c20 con 0x7f09d0144a10 2024-01-20T11:08:28.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09d6600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0070f00 con 0x7f09d00cdf90 2024-01-20T11:08:28.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09cfe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f09d0071cc0 0x7f09d00cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45766/0 (socket says 172.21.15.162:45766) 2024-01-20T11:08:28.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09cfe00640 1 -- 172.21.15.162:0/1673324712 learned_addr learned my addr 172.21.15.162:0/1673324712 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:28.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09d5c00640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d00cdf90 0x7f09d00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674810153 0 0) 0x7f09d0071830 con 0x7f09d0071cc0 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.482+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b0003520 con 0x7f09d0071cc0 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351200831 0 0) 0x7f09b0003520 con 0x7f09d0071cc0 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d00cdf90 msgr2=0x7f09d00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d00cdf90 0x7f09d00ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 >> v1:172.21.15.179:6789/0 conn(0x7f09d0144a10 legacy=0x7f09d00703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00711e0 con 0x7f09d0071cc0 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f09b8001670 con 0x7f09d0071cc0 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 >> v1:172.21.15.162:6789/0 conn(0x7f09d0071cc0 legacy=0x7f09d00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d00cdf90 0x7f09b00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09b0003f70 0x7f09b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09b0004d00 0x7f09b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0070f00 con 0x7f09b0003f70 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b000bac0 con 0x7f09b0004d00 2024-01-20T11:08:28.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b000bc80 con 0x7f09d00cdf90 2024-01-20T11:08:28.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cfe00640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09b0003f70 0x7f09b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09d5c00640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09b0004d00 0x7f09b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cfe00640 1 -- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d00cdf90 msgr2=0x7f09b00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.483+0000 7f09cfe00640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d00cdf90 0x7f09b00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.484+0000 7f09cfe00640 1 -- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09b0004d00 msgr2=0x7f09b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.484+0000 7f09cfe00640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09b0004d00 0x7f09b0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.484+0000 7f09cfe00640 1 -- 172.21.15.162:0/1673324712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0003520 con 0x7f09b0003f70 2024-01-20T11:08:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.484+0000 7f09cfe00640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09b0003f70 0x7f09b00047c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c0e0 tx=0x7f09b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694a79b28bcf3958 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8005ad0 con 0x7f09b0003f70 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b8005c50 con 0x7f09b0003f70 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09cf400640 1 -- 172.21.15.162:0/1673324712 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8007070 con 0x7f09b0003f70 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09d6600640 1 -- 172.21.15.162:0/1673324712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09b0003f70 msgr2=0x7f09b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09d6600640 1 --2- 172.21.15.162:0/1673324712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09b0003f70 0x7f09b00047c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c0e0 tx=0x7f09b00057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09d5c00640 1 -- 172.21.15.162:0/1673324712 reap_dead start 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09d6600640 1 -- 172.21.15.162:0/1673324712 shutdown_connections 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09d6600640 1 -- 172.21.15.162:0/1673324712 >> 172.21.15.162:0/1673324712 conn(0x7f09d00b0c40 msgr2=0x7f09d00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.485+0000 7f09d6600640 1 -- 172.21.15.162:0/1673324712 shutdown_connections 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.486+0000 7f09d6600640 1 -- 172.21.15.162:0/1673324712 wait complete. 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.487+0000 7f09d6600640 1 Processor -- start 2024-01-20T11:08:28.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.487+0000 7f09d6600640 1 -- start start 2024-01-20T11:08:28.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.488+0000 7f09d6600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09b0003f70 0x7f09d013b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.488+0000 7f09d6600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d0158ab0 0x7f09d01582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.488+0000 7f09d6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09d0138ec0 0x7f09d013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.488+0000 7f09d6600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0159c30 con 0x7f09d0138ec0 2024-01-20T11:08:28.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.488+0000 7f09d6600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0159020 con 0x7f09d0158ab0 2024-01-20T11:08:28.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.488+0000 7f09d6600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0159300 con 0x7f09b0003f70 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09d0138ec0 0x7f09d013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09d0138ec0 0x7f09d013aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36230/0 (socket says 172.21.15.162:36230) 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 -- 172.21.15.162:0/1270489898 learned_addr learned my addr 172.21.15.162:0/1270489898 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09cfe00640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d0158ab0 0x7f09d01582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 -- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09b0003f70 msgr2=0x7f09d013b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5200640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09b0003f70 0x7f09d013b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09b0003f70 0x7f09d013b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 -- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d0158ab0 msgr2=0x7f09d01582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d0158ab0 0x7f09d01582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 -- 172.21.15.162:0/1270489898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d01595e0 con 0x7f09d0138ec0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.489+0000 7f09d5c00640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09d0138ec0 0x7f09d013aa70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f09d00b4410 tx=0x7f09c800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.490+0000 7f09ccc00640 1 -- 172.21.15.162:0/1270489898 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800fe90 con 0x7f09d0138ec0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.490+0000 7f09ccc00640 1 -- 172.21.15.162:0/1270489898 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8011040 con 0x7f09d0138ec0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.490+0000 7f09ccc00640 1 -- 172.21.15.162:0/1270489898 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8003bd0 con 0x7f09d0138ec0 2024-01-20T11:08:28.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.490+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d01598c0 con 0x7f09d0138ec0 2024-01-20T11:08:28.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.490+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d0139340 con 0x7f09d0138ec0 2024-01-20T11:08:28.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.491+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d0139560 con 0x7f09d0138ec0 2024-01-20T11:08:28.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.492+0000 7f09ccc00640 1 -- 172.21.15.162:0/1270489898 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f09c8017400 con 0x7f09d0138ec0 2024-01-20T11:08:28.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.493+0000 7f09ccc00640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09a806af00 0x7f09a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.493+0000 7f09ccc00640 1 -- 172.21.15.162:0/1270489898 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f09c8089af0 con 0x7f09d0138ec0 2024-01-20T11:08:28.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.493+0000 7f09d5200640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09a806af00 0x7f09a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.494+0000 7f09d5200640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09a806af00 0x7f09a806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f09c00015d0 tx=0x7f09c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.498+0000 7f09ccc00640 1 -- 172.21.15.162:0/1270489898 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f09d0139560 con 0x7f09d0138ec0 2024-01-20T11:08:28.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.731+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09d0139560 con 0x7f09d0138ec0 2024-01-20T11:08:28.733 INFO:tasks.ceph.mon.a.smithi162.stderr:2024-01-20T11:08:28.733+0000 7f7926600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T11:08:28.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.736+0000 7f09ccc00640 1 -- 172.21.15.162:0/1270489898 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09d0139560 con 0x7f09d0138ec0 2024-01-20T11:08:28.737 INFO:teuthology.orchestra.run.smithi162.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09a806af00 msgr2=0x7f09a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09a806af00 0x7f09a806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f09c00015d0 tx=0x7f09c0009040 comp rx=0 tx=0).stop 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09d0138ec0 msgr2=0x7f09d013aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09d0138ec0 0x7f09d013aa70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f09d00b4410 tx=0x7f09c800f4a0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 shutdown_connections 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09d0138ec0 0x7f09d013aa70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09a806af00 0x7f09a806d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d0158ab0 0x7f09d01582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 --2- 172.21.15.162:0/1270489898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09b0003f70 0x7f09d013b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.739+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 >> 172.21.15.162:0/1270489898 conn(0x7f09d00b0c40 msgr2=0x7f09d00cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:28.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.740+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 shutdown_connections 2024-01-20T11:08:28.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.740+0000 7f09d6600640 1 -- 172.21.15.162:0/1270489898 wait complete. 2024-01-20T11:08:28.759 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-20T11:08:28.777 INFO:tasks.ceph.mds.d.smithi179.stderr: -7495> 2024-01-20T11:07:35.882+0000 7f30c7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T11:08:28.869 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-01-20T11:08:28.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.964+0000 7fa028c00640 1 Processor -- start 2024-01-20T11:08:28.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.964+0000 7fa028c00640 1 -- start start 2024-01-20T11:08:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa028c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa0240cdc30 0x7fa02406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa028c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240cee70 con 0x7fa024141bb0 2024-01-20T11:08:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa028c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240cd7a0 con 0x7fa02406cc20 2024-01-20T11:08:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa028c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02406d0d0 con 0x7fa0240cdc30 2024-01-20T11:08:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa021e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa024141bb0 0x7fa0240ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45768/0 (socket says 172.21.15.162:45768) 2024-01-20T11:08:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa021e00640 1 -- 172.21.15.162:0/1727516732 learned_addr learned my addr 172.21.15.162:0/1727516732 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:28.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611502644 0 0) 0x7fa014001110 con 0x7fa024141bb0 2024-01-20T11:08:28.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa01be00640 1 --2- 172.21.15.162:0/1727516732 >> v2:172.21.15.179:3300/0 conn(0x7fa0240cdc30 0x7fa02406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.966+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa004003520 con 0x7fa024141bb0 2024-01-20T11:08:28.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2237592193 0 0) 0x7fa004003520 con 0x7fa024141bb0 2024-01-20T11:08:28.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 >> v2:172.21.15.179:3300/0 conn(0x7fa0240cdc30 msgr2=0x7fa02406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 --2- 172.21.15.162:0/1727516732 >> v2:172.21.15.179:3300/0 conn(0x7fa0240cdc30 0x7fa02406c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 >> v1:172.21.15.179:6789/0 conn(0x7fa02406cc20 legacy=0x7fa0240717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240ceb90 con 0x7fa024141bb0 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fa014001800 con 0x7fa024141bb0 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 >> v1:172.21.15.162:6789/0 conn(0x7fa024141bb0 legacy=0x7fa0240ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa004003970 0x7fa004003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0040047c0 0x7fa004004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa00400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02406d0d0 con 0x7fa0040052a0 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00400c150 con 0x7fa0040047c0 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00400c310 con 0x7fa004003970 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.967+0000 7fa022800640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa00400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.968+0000 7fa021e00640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa004003970 0x7fa004003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.968+0000 7fa022800640 1 -- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa004003970 msgr2=0x7fa004003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.968+0000 7fa01be00640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0040047c0 0x7fa004004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.968+0000 7fa022800640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa004003970 0x7fa004003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.968+0000 7fa022800640 1 -- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0040047c0 msgr2=0x7fa004004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:28.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.968+0000 7fa022800640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0040047c0 0x7fa004004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.968+0000 7fa022800640 1 -- 172.21.15.162:0/1727516732 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004003520 con 0x7fa0040052a0 2024-01-20T11:08:28.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.969+0000 7fa022800640 1 -- 172.21.15.162:0/1727516732 reap_dead start 2024-01-20T11:08:28.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.969+0000 7fa022800640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa00400b980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa01c004480 tx=0x7fa0040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5967a98de3e309f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.969+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c006b50 con 0x7fa0040052a0 2024-01-20T11:08:28.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.969+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c006cd0 con 0x7fa0040052a0 2024-01-20T11:08:28.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.969+0000 7fa021400640 1 -- 172.21.15.162:0/1727516732 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c007260 con 0x7fa0040052a0 2024-01-20T11:08:28.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.969+0000 7fa028c00640 1 -- 172.21.15.162:0/1727516732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 msgr2=0x7fa00400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.969+0000 7fa028c00640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa00400b980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa01c004480 tx=0x7fa0040057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.970+0000 7fa028c00640 1 -- 172.21.15.162:0/1727516732 shutdown_connections 2024-01-20T11:08:28.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.970+0000 7fa028c00640 1 --2- 172.21.15.162:0/1727516732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa00400b980 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.970+0000 7fa028c00640 1 -- 172.21.15.162:0/1727516732 >> 172.21.15.162:0/1727516732 conn(0x7fa02406a600 msgr2=0x7fa02406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:28.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.970+0000 7fa028c00640 1 -- 172.21.15.162:0/1727516732 shutdown_connections 2024-01-20T11:08:28.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.970+0000 7fa028c00640 1 -- 172.21.15.162:0/1727516732 wait complete. 2024-01-20T11:08:28.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.971+0000 7fa028c00640 1 Processor -- start 2024-01-20T11:08:28.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.971+0000 7fa028c00640 1 -- start start 2024-01-20T11:08:28.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.972+0000 7fa028c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa0240b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.972+0000 7fa028c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0240a84b0 0x7fa0240a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.972+0000 7fa028c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0240aa2a0 0x7fa024158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.972+0000 7fa028c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02413c2a0 con 0x7fa0040052a0 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.972+0000 7fa028c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240a8cc0 con 0x7fa0240a84b0 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.972+0000 7fa028c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240a8fa0 con 0x7fa0240aa2a0 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.972+0000 7fa021e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa0240b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa0240b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36248/0 (socket says 172.21.15.162:36248) 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 -- 172.21.15.162:0/3368354567 learned_addr learned my addr 172.21.15.162:0/3368354567 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa01be00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0240a84b0 0x7fa0240a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 -- 172.21.15.162:0/3368354567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0240aa2a0 msgr2=0x7fa024158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0240aa2a0 0x7fa024158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 -- 172.21.15.162:0/3368354567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0240a84b0 msgr2=0x7fa0240a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0240a84b0 0x7fa0240a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:28.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 -- 172.21.15.162:0/3368354567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240a9280 con 0x7fa0040052a0 2024-01-20T11:08:28.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa021e00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa0240b1080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa01400d730 tx=0x7fa01400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa01a000640 1 -- 172.21.15.162:0/3368354567 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140074e0 con 0x7fa0040052a0 2024-01-20T11:08:28.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.973+0000 7fa01a000640 1 -- 172.21.15.162:0/3368354567 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014007640 con 0x7fa0040052a0 2024-01-20T11:08:28.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.974+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0240a9560 con 0x7fa0040052a0 2024-01-20T11:08:28.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.974+0000 7fa01a000640 1 -- 172.21.15.162:0/3368354567 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014004a00 con 0x7fa0040052a0 2024-01-20T11:08:28.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.974+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0240a8930 con 0x7fa0040052a0 2024-01-20T11:08:28.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.975+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0240a9a80 con 0x7fa0040052a0 2024-01-20T11:08:28.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.975+0000 7fa01a000640 1 -- 172.21.15.162:0/3368354567 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa014004b60 con 0x7fa0040052a0 2024-01-20T11:08:28.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.976+0000 7fa01a000640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9ffc06aed0 0x7f9ffc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:28.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.976+0000 7fa01a000640 1 -- 172.21.15.162:0/3368354567 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fa014089250 con 0x7fa0040052a0 2024-01-20T11:08:28.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.977+0000 7fa01be00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9ffc06aed0 0x7f9ffc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:28.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.977+0000 7fa01be00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9ffc06aed0 0x7f9ffc06d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa02415c940 tx=0x7fa00c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:28.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:28.981+0000 7fa01a000640 1 -- 172.21.15.162:0/3368354567 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa014053ff0 con 0x7fa0040052a0 2024-01-20T11:08:29.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.210+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa0240cee70 con 0x7fa0040052a0 2024-01-20T11:08:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.850+0000 7fa01a000640 1 -- 172.21.15.162:0/3368354567 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa0240cee70 con 0x7fa0040052a0 2024-01-20T11:08:29.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9ffc06aed0 msgr2=0x7f9ffc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:29.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9ffc06aed0 0x7f9ffc06d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa02415c940 tx=0x7fa00c008040 comp rx=0 tx=0).stop 2024-01-20T11:08:29.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 msgr2=0x7fa0240b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:29.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa0240b1080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa01400d730 tx=0x7fa01400dbf0 comp rx=0 tx=0).stop 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 shutdown_connections 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0240aa2a0 0x7fa024158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9ffc06aed0 0x7f9ffc06d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0240a84b0 0x7fa0240a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 --2- 172.21.15.162:0/3368354567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0040052a0 0x7fa0240b1080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 >> 172.21.15.162:0/3368354567 conn(0x7fa02406a600 msgr2=0x7fa02415bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 shutdown_connections 2024-01-20T11:08:29.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:29.854+0000 7fa028c00640 1 -- 172.21.15.162:0/3368354567 wait complete. 2024-01-20T11:08:29.875 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-20T11:08:30.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.090+0000 7f6e92600640 1 Processor -- start 2024-01-20T11:08:30.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.090+0000 7f6e92600640 1 -- start start 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e92600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0ceef0 0x7f6e8c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e92600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6e8c0cd320 0x7f6e8c15bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e92600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d530 con 0x7f6e8c157fa0 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e92600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cd7d0 con 0x7f6e8c0cd320 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e92600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cfb80 con 0x7f6e8c0ceef0 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e8b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6e8c157fa0 0x7f6e8c0cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45780/0 (socket says 172.21.15.162:45780) 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e8b400640 1 -- 172.21.15.162:0/129487277 learned_addr learned my addr 172.21.15.162:0/129487277 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:30.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.092+0000 7f6e8be00640 1 --2- 172.21.15.162:0/129487277 >> v2:172.21.15.162:3300/0 conn(0x7f6e8c0cd320 0x7f6e8c15bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:30.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e82800640 1 --2- 172.21.15.162:0/129487277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0ceef0 0x7f6e8c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:30.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e8aa00640 1 -- 172.21.15.162:0/129487277 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070740429 0 0) 0x7f6e8c06d530 con 0x7f6e8c157fa0 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e8aa00640 1 -- 172.21.15.162:0/129487277 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e6c003520 con 0x7f6e8c157fa0 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e8be00640 1 -- 172.21.15.162:0/129487277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0ceef0 msgr2=0x7f6e8c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e8be00640 1 --2- 172.21.15.162:0/129487277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0ceef0 0x7f6e8c0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e8be00640 1 -- 172.21.15.162:0/129487277 >> v1:172.21.15.162:6789/0 conn(0x7f6e8c157fa0 legacy=0x7f6e8c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e8be00640 1 -- 172.21.15.162:0/129487277 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c06c920 con 0x7f6e8c0cd320 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.093+0000 7f6e82800640 1 --2- 172.21.15.162:0/129487277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0ceef0 0x7f6e8c0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.094+0000 7f6e8be00640 1 --2- 172.21.15.162:0/129487277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c15bbe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009d90 tx=0x7f6e8402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635221aebcfbb610 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.094+0000 7f6e8aa00640 1 -- 172.21.15.162:0/129487277 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8402cc50 con 0x7f6e8c0cd320 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.094+0000 7f6e8aa00640 1 -- 172.21.15.162:0/129487277 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8402cdb0 con 0x7f6e8c0cd320 2024-01-20T11:08:30.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.094+0000 7f6e8aa00640 1 -- 172.21.15.162:0/129487277 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84034660 con 0x7f6e8c0cd320 2024-01-20T11:08:30.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 -- 172.21.15.162:0/129487277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 msgr2=0x7f6e8c15bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:30.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 --2- 172.21.15.162:0/129487277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c15bbe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009d90 tx=0x7f6e8402bea0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 -- 172.21.15.162:0/129487277 shutdown_connections 2024-01-20T11:08:30.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 --2- 172.21.15.162:0/129487277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0ceef0 0x7f6e8c0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 --2- 172.21.15.162:0/129487277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c15bbe0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 -- 172.21.15.162:0/129487277 >> 172.21.15.162:0/129487277 conn(0x7f6e8c06a600 msgr2=0x7f6e8c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:30.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 -- 172.21.15.162:0/129487277 shutdown_connections 2024-01-20T11:08:30.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.095+0000 7f6e92600640 1 -- 172.21.15.162:0/129487277 wait complete. 2024-01-20T11:08:30.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.097+0000 7f6e92600640 1 Processor -- start 2024-01-20T11:08:30.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.097+0000 7f6e92600640 1 -- start start 2024-01-20T11:08:30.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e92600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:30.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e92600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e8c157fa0 0x7f6e8c0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:30.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e92600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0b3310 0x7f6e8c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:30.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e92600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0ad5e0 con 0x7f6e8c0cd320 2024-01-20T11:08:30.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e92600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b37a0 con 0x7f6e8c157fa0 2024-01-20T11:08:30.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e92600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b3a80 con 0x7f6e8c0b3310 2024-01-20T11:08:30.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:30.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c0cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36278/0 (socket says 172.21.15.162:36278) 2024-01-20T11:08:30.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 -- 172.21.15.162:0/3940360468 learned_addr learned my addr 172.21.15.162:0/3940360468 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 -- 172.21.15.162:0/3940360468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0b3310 msgr2=0x7f6e8c0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0b3310 0x7f6e8c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 -- 172.21.15.162:0/3940360468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e8c157fa0 msgr2=0x7f6e8c0c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e8c157fa0 0x7f6e8c0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.098+0000 7f6e8b400640 1 -- 172.21.15.162:0/3940360468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84009a70 con 0x7f6e8c0cd320 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.099+0000 7f6e8b400640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c0cbfc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c390 tx=0x7f6e7c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.099+0000 7f6e83e00640 1 -- 172.21.15.162:0/3940360468 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c005ce0 con 0x7f6e8c0cd320 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.099+0000 7f6e83e00640 1 -- 172.21.15.162:0/3940360468 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c005e40 con 0x7f6e8c0cd320 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.099+0000 7f6e83e00640 1 -- 172.21.15.162:0/3940360468 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0072f0 con 0x7f6e8c0cd320 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.099+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c0b3d60 con 0x7f6e8c0cd320 2024-01-20T11:08:30.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.099+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c0cc500 con 0x7f6e8c0cd320 2024-01-20T11:08:30.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.100+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c04e970 con 0x7f6e8c0cd320 2024-01-20T11:08:30.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.101+0000 7f6e83e00640 1 -- 172.21.15.162:0/3940360468 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6e7c007450 con 0x7f6e8c0cd320 2024-01-20T11:08:30.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.102+0000 7f6e83e00640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6e6406aed0 0x7f6e6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:30.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.102+0000 7f6e83e00640 1 -- 172.21.15.162:0/3940360468 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f6e7c088d10 con 0x7f6e8c0cd320 2024-01-20T11:08:30.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.102+0000 7f6e82800640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6e6406aed0 0x7f6e6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:30.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.103+0000 7f6e82800640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6e6406aed0 0x7f6e6406d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e74006fd0 tx=0x7f6e74008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:30.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.106+0000 7f6e83e00640 1 -- 172.21.15.162:0/3940360468 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6e7c053b10 con 0x7f6e8c0cd320 2024-01-20T11:08:30.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.303+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e8c0ae730 con 0x7f6e8c0cd320 2024-01-20T11:08:30.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.854+0000 7f6e83e00640 1 -- 172.21.15.162:0/3940360468 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6e7c017020 con 0x7f6e8c0cd320 2024-01-20T11:08:30.855 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' removed 2024-01-20T11:08:30.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6e6406aed0 msgr2=0x7f6e6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:30.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6e6406aed0 0x7f6e6406d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e74006fd0 tx=0x7f6e74008040 comp rx=0 tx=0).stop 2024-01-20T11:08:30.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 msgr2=0x7f6e8c0cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:30.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c0cbfc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c390 tx=0x7f6e7c00c850 comp rx=0 tx=0).stop 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 shutdown_connections 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e8c0b3310 0x7f6e8c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6e6406aed0 0x7f6e6406d390 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e74006fd0 tx=0x7f6e74008040 comp rx=0 tx=0).stop 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e8c157fa0 0x7f6e8c0c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 --2- 172.21.15.162:0/3940360468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c0cd320 0x7f6e8c0cbfc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.859+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 >> 172.21.15.162:0/3940360468 conn(0x7f6e8c06a600 msgr2=0x7f6e8c15dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.860+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 shutdown_connections 2024-01-20T11:08:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:30.860+0000 7f6e92600640 1 -- 172.21.15.162:0/3940360468 wait complete. 2024-01-20T11:08:30.887 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-20T11:08:31.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.084+0000 7f2976000640 1 Processor -- start 2024-01-20T11:08:31.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.084+0000 7f2976000640 1 -- start start 2024-01-20T11:08:31.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.085+0000 7f2976000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2970152290 0x7f29700cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:31.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.085+0000 7f2976000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f297015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:31.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.085+0000 7f2976000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f297006d540 0x7f297006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:31.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.085+0000 7f2976000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297015c910 con 0x7f2970152290 2024-01-20T11:08:31.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.085+0000 7f2976000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297006def0 con 0x7f297006d540 2024-01-20T11:08:31.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.085+0000 7f2976000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700d0070 con 0x7f29700ca490 2024-01-20T11:08:31.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2970152290 0x7f29700cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:31.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2970152290 0x7f29700cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36286/0 (socket says 172.21.15.162:36286) 2024-01-20T11:08:31.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 -- 172.21.15.162:0/3513629155 learned_addr learned my addr 172.21.15.162:0/3513629155 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:31.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f2967e00640 1 --2- 172.21.15.162:0/3513629155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f297015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:31.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296fe00640 1 --2- 172.21.15.162:0/3513629155 >> v2:172.21.15.179:3300/0 conn(0x7f297006d540 0x7f297006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:31.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 -- 172.21.15.162:0/3513629155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 msgr2=0x7f297015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:31.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 --2- 172.21.15.162:0/3513629155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f297015c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 -- 172.21.15.162:0/3513629155 >> v2:172.21.15.179:3300/0 conn(0x7f297006d540 msgr2=0x7f297006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:31.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 --2- 172.21.15.162:0/3513629155 >> v2:172.21.15.179:3300/0 conn(0x7f297006d540 0x7f297006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296f400640 1 -- 172.21.15.162:0/3513629155 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700b27d0 con 0x7f2970152290 2024-01-20T11:08:31.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.086+0000 7f296fe00640 1 --2- 172.21.15.162:0/3513629155 >> v2:172.21.15.179:3300/0 conn(0x7f297006d540 0x7f297006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:31.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.087+0000 7f296f400640 1 --2- 172.21.15.162:0/3513629155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700cf110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29700ae890 tx=0x7f296002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23abc57cb5b67360 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:31.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.088+0000 7f296ea00640 1 -- 172.21.15.162:0/3513629155 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29600317e0 con 0x7f2970152290 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.088+0000 7f296ea00640 1 -- 172.21.15.162:0/3513629155 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960031940 con 0x7f2970152290 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.088+0000 7f296ea00640 1 -- 172.21.15.162:0/3513629155 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960031cd0 con 0x7f2970152290 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 -- 172.21.15.162:0/3513629155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 msgr2=0x7f29700cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 --2- 172.21.15.162:0/3513629155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700cf110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29700ae890 tx=0x7f296002b880 comp rx=0 tx=0).stop 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 -- 172.21.15.162:0/3513629155 shutdown_connections 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 --2- 172.21.15.162:0/3513629155 >> v2:172.21.15.179:3300/0 conn(0x7f297006d540 0x7f297006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 --2- 172.21.15.162:0/3513629155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f297015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 --2- 172.21.15.162:0/3513629155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700cf110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 -- 172.21.15.162:0/3513629155 >> 172.21.15.162:0/3513629155 conn(0x7f297006a600 msgr2=0x7f297006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 -- 172.21.15.162:0/3513629155 shutdown_connections 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.089+0000 7f2976000640 1 -- 172.21.15.162:0/3513629155 wait complete. 2024-01-20T11:08:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.091+0000 7f2976000640 1 Processor -- start 2024-01-20T11:08:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.092+0000 7f2976000640 1 -- start start 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f2976000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f297006d540 0x7f29701457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f2976000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f29700c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f2976000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f2976000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297009a4c0 con 0x7f2970152290 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f2976000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700cc9d0 con 0x7f297006d540 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f2976000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700aea10 con 0x7f29700ca490 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f296fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f296fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36294/0 (socket says 172.21.15.162:36294) 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.093+0000 7f296fe00640 1 -- 172.21.15.162:0/962931858 learned_addr learned my addr 172.21.15.162:0/962931858 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f296f400640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f297006d540 0x7f29701457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f2967e00640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f29700c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f296fe00640 1 -- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 msgr2=0x7f29700c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f296fe00640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f29700c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f296fe00640 1 -- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f297006d540 msgr2=0x7f29701457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f296fe00640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f297006d540 0x7f29701457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f296fe00640 1 -- 172.21.15.162:0/962931858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600094d0 con 0x7f2970152290 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f296fe00640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700c8aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f296800cef0 tx=0x7f296800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f2967400640 1 -- 172.21.15.162:0/962931858 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800d840 con 0x7f2970152290 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f2967400640 1 -- 172.21.15.162:0/962931858 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800d9a0 con 0x7f2970152290 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f2967400640 1 -- 172.21.15.162:0/962931858 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800dd50 con 0x7f2970152290 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.094+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700aecf0 con 0x7f2970152290 2024-01-20T11:08:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.095+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700af2b0 con 0x7f2970152290 2024-01-20T11:08:31.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.096+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29700af4d0 con 0x7f2970152290 2024-01-20T11:08:31.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.097+0000 7f2967400640 1 -- 172.21.15.162:0/962931858 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f296801e3b0 con 0x7f2970152290 2024-01-20T11:08:31.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.098+0000 7f2967400640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f294806aed0 0x7f294806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:31.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.098+0000 7f2967400640 1 -- 172.21.15.162:0/962931858 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f2968089fa0 con 0x7f2970152290 2024-01-20T11:08:31.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.098+0000 7f296f400640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f294806aed0 0x7f294806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:31.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.099+0000 7f296f400640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f294806aed0 0x7f294806d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2960036000 tx=0x7f296003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:31.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.103+0000 7f2967400640 1 -- 172.21.15.162:0/962931858 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2968054f40 con 0x7f2970152290 2024-01-20T11:08:31.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.294+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f297004e970 con 0x7f2970152290 2024-01-20T11:08:31.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.877+0000 7f2967400640 1 -- 172.21.15.162:0/962931858 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f296801a020 con 0x7f2970152290 2024-01-20T11:08:31.878 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' removed 2024-01-20T11:08:31.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.881+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f294806aed0 msgr2=0x7f294806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:31.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.881+0000 7f2976000640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f294806aed0 0x7f294806d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2960036000 tx=0x7f296003d040 comp rx=0 tx=0).stop 2024-01-20T11:08:31.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.881+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 msgr2=0x7f29700c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:31.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.881+0000 7f2976000640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700c8aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f296800cef0 tx=0x7f296800a710 comp rx=0 tx=0).stop 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 shutdown_connections 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2970152290 0x7f29700c8aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29700ca490 0x7f29700c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f294806aed0 0x7f294806d390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 --2- 172.21.15.162:0/962931858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f297006d540 0x7f29701457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 >> 172.21.15.162:0/962931858 conn(0x7f297006a600 msgr2=0x7f297015e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 shutdown_connections 2024-01-20T11:08:31.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:31.882+0000 7f2976000640 1 -- 172.21.15.162:0/962931858 wait complete. 2024-01-20T11:08:31.910 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-20T11:08:31.910 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-20T11:08:31.910 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-20T11:08:31.910 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:08:31.910 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-20T11:08:31.910 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-20T11:08:31.911 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-20T11:08:31.911 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:08:31.911 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-20T11:08:31.911 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-20T11:08:31.911 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-20T11:08:31.911 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:08:31.911 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-20T11:08:31.911 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-20T11:08:31.912 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-20T11:08:31.912 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:08:31.929 INFO:tasks.ceph.mds.a:Stopped 2024-01-20T11:08:31.930 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-20T11:08:31.931 INFO:tasks.ceph.mds.c:Stopped 2024-01-20T11:08:31.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-20T11:08:31.933 INFO:tasks.ceph.mds.b:Stopped 2024-01-20T11:08:31.933 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-20T11:08:31.934 INFO:tasks.ceph.mds.d:Stopped 2024-01-20T11:08:31.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-20T11:08:31.976 INFO:tasks.ceph.mds.a:Started 2024-01-20T11:08:31.977 DEBUG:teuthology.parallel:result is None 2024-01-20T11:08:31.981 INFO:tasks.ceph.mds.b:Started 2024-01-20T11:08:31.981 DEBUG:teuthology.parallel:result is None 2024-01-20T11:08:31.982 INFO:tasks.ceph.mds.c:Started 2024-01-20T11:08:31.982 DEBUG:teuthology.parallel:result is None 2024-01-20T11:08:31.987 INFO:tasks.ceph.mds.d:Started 2024-01-20T11:08:31.987 DEBUG:teuthology.parallel:result is None 2024-01-20T11:08:31.988 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-20T11:08:32.127 INFO:tasks.ceph.mds.a.smithi162.stdout:starting mds.a at 2024-01-20T11:08:32.128 INFO:tasks.ceph.mds.c.smithi162.stdout:starting mds.c at 2024-01-20T11:08:32.138 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-01-20T11:08:32.144 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-01-20T11:08:32.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.165+0000 7fe47f000640 1 Processor -- start 2024-01-20T11:08:32.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.165+0000 7fe47f000640 1 -- start start 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe47f000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780b2040 0x7fe47815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe47f000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe4780cf060 0x7fe4780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe47f000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4780b2ec0 con 0x7fe47815a380 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe47f000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe478070eb0 con 0x7fe4780cf060 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe47f000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47815ee30 con 0x7fe4780b2040 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe477400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780b2040 0x7fe47815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe47d000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe4780cf060 0x7fe4780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe477400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780b2040 0x7fe47815e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:48024/0 (socket says 172.21.15.162:48024) 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe47d000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe4780cf060 0x7fe4780cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:45378/0 (socket says 172.21.15.162:45378) 2024-01-20T11:08:32.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe477400640 1 -- 172.21.15.162:0/1339516096 learned_addr learned my addr 172.21.15.162:0/1339516096 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:32.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.166+0000 7fe477e00640 1 --1- 172.21.15.162:0/1339516096 >> v1:172.21.15.179:6789/0 conn(0x7fe47815a380 0x7fe4780707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:54564/0 (socket says 172.21.15.162:54564) 2024-01-20T11:08:32.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.167+0000 7fe477400640 1 -- 172.21.15.162:0/1339516096 >> v2:172.21.15.179:3300/0 conn(0x7fe4780cf060 msgr2=0x7fe4780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:32.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.167+0000 7fe477400640 1 --2- 172.21.15.162:0/1339516096 >> v2:172.21.15.179:3300/0 conn(0x7fe4780cf060 0x7fe4780cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.167+0000 7fe477400640 1 -- 172.21.15.162:0/1339516096 >> v1:172.21.15.179:6789/0 conn(0x7fe47815a380 legacy=0x7fe4780707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.167+0000 7fe477400640 1 -- 172.21.15.162:0/1339516096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780ce700 con 0x7fe4780b2040 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.167+0000 7fe47d000640 1 --2- 172.21.15.162:0/1339516096 >> v2:172.21.15.179:3300/0 conn(0x7fe4780cf060 0x7fe4780cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.167+0000 7fe476a00640 1 -- 172.21.15.162:0/1339516096 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369100684 0 0) 0x7fe468001110 con 0x7fe47815a380 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.168+0000 7fe477400640 1 --2- 172.21.15.162:0/1339516096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780b2040 0x7fe47815e8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe460009870 tx=0x7fe46002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b437a36090cabe1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.168+0000 7fe476a00640 1 -- 172.21.15.162:0/1339516096 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460031640 con 0x7fe4780b2040 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.168+0000 7fe476a00640 1 -- 172.21.15.162:0/1339516096 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4600317a0 con 0x7fe4780b2040 2024-01-20T11:08:32.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.168+0000 7fe476a00640 1 -- 172.21.15.162:0/1339516096 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460031b30 con 0x7fe4780b2040 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 -- 172.21.15.162:0/1339516096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780b2040 msgr2=0x7fe47815e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 --2- 172.21.15.162:0/1339516096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780b2040 0x7fe47815e8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe460009870 tx=0x7fe46002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 -- 172.21.15.162:0/1339516096 shutdown_connections 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 --2- 172.21.15.162:0/1339516096 >> v2:172.21.15.179:3300/0 conn(0x7fe4780cf060 0x7fe4780cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 --2- 172.21.15.162:0/1339516096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780b2040 0x7fe47815e8f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 -- 172.21.15.162:0/1339516096 >> 172.21.15.162:0/1339516096 conn(0x7fe47806a600 msgr2=0x7fe47806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 -- 172.21.15.162:0/1339516096 shutdown_connections 2024-01-20T11:08:32.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.169+0000 7fe47f000640 1 -- 172.21.15.162:0/1339516096 wait complete. 2024-01-20T11:08:32.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.171+0000 7fe47f000640 1 Processor -- start 2024-01-20T11:08:32.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.171+0000 7fe47f000640 1 -- start start 2024-01-20T11:08:32.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.171+0000 7fe47f000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780b2040 0x7fe478157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:32.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47f000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780cf060 0x7fe4780c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:32.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe47815a380 0x7fe4780c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781efeb0 con 0x7fe47815a380 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47f000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781f0170 con 0x7fe4780b2040 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47f000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781f0450 con 0x7fe4780cf060 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe47815a380 0x7fe4780c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe47815a380 0x7fe4780c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36316/0 (socket says 172.21.15.162:36316) 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 -- 172.21.15.162:0/1701456481 learned_addr learned my addr 172.21.15.162:0/1701456481 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe477e00640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780b2040 0x7fe478157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe477400640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780cf060 0x7fe4780c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 -- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780cf060 msgr2=0x7fe4780c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780cf060 0x7fe4780c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 -- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780b2040 msgr2=0x7fe478157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780b2040 0x7fe478157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.172+0000 7fe47d000640 1 -- 172.21.15.162:0/1701456481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47000f050 con 0x7fe47815a380 2024-01-20T11:08:32.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.173+0000 7fe47d000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe47815a380 0x7fe4780c4ce0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe47000f500 tx=0x7fe47000f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:32.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.173+0000 7fe46fe00640 1 -- 172.21.15.162:0/1701456481 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470012050 con 0x7fe47815a380 2024-01-20T11:08:32.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.173+0000 7fe46fe00640 1 -- 172.21.15.162:0/1701456481 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470013040 con 0x7fe47815a380 2024-01-20T11:08:32.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.173+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4600094d0 con 0x7fe47815a380 2024-01-20T11:08:32.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.173+0000 7fe46fe00640 1 -- 172.21.15.162:0/1701456481 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470003dd0 con 0x7fe47815a380 2024-01-20T11:08:32.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.173+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4781f0a10 con 0x7fe47815a380 2024-01-20T11:08:32.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.174+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47804e970 con 0x7fe47815a380 2024-01-20T11:08:32.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.175+0000 7fe46fe00640 1 -- 172.21.15.162:0/1701456481 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe470004030 con 0x7fe47815a380 2024-01-20T11:08:32.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.176+0000 7fe46fe00640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe45006aed0 0x7fe45006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:32.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.176+0000 7fe46fe00640 1 -- 172.21.15.162:0/1701456481 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe47008dfe0 con 0x7fe47815a380 2024-01-20T11:08:32.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.176+0000 7fe477e00640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe45006aed0 0x7fe45006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:32.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.177+0000 7fe477e00640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe45006aed0 0x7fe45006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe468000f60 tx=0x7fe468009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:32.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.180+0000 7fe46fe00640 1 -- 172.21.15.162:0/1701456481 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe470059290 con 0x7fe47815a380 2024-01-20T11:08:32.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:32.386+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe4781f0c00 con 0x7fe47815a380 2024-01-20T11:08:33.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.589+0000 7fe46fe00640 1 -- 172.21.15.162:0/1701456481 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe47005c8b0 con 0x7fe47815a380 2024-01-20T11:08:33.591 INFO:teuthology.orchestra.run.smithi162.stderr: removed all blocklist entries 2024-01-20T11:08:33.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.594+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe45006aed0 msgr2=0x7fe45006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:33.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.594+0000 7fe47f000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe45006aed0 0x7fe45006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe468000f60 tx=0x7fe468009040 comp rx=0 tx=0).stop 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.594+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe47815a380 msgr2=0x7fe4780c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.594+0000 7fe47f000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe47815a380 0x7fe4780c4ce0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe47000f500 tx=0x7fe47000f9c0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 shutdown_connections 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe47815a380 0x7fe4780c4ce0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4780cf060 0x7fe4780c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe45006aed0 0x7fe45006d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 --2- 172.21.15.162:0/1701456481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780b2040 0x7fe478157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 >> 172.21.15.162:0/1701456481 conn(0x7fe47806a600 msgr2=0x7fe478071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 shutdown_connections 2024-01-20T11:08:33.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.595+0000 7fe47f000640 1 -- 172.21.15.162:0/1701456481 wait complete. 2024-01-20T11:08:33.616 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-20T11:08:33.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.817+0000 7fb45b800640 1 Processor -- start 2024-01-20T11:08:33.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.818+0000 7fb45b800640 1 -- start start 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.819+0000 7fb45b800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb4540cf220 0x7fb4540705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.819+0000 7fb45b800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4540cf6b0 0x7fb454070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.819+0000 7fb45b800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb454071020 con 0x7fb4540adf80 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.819+0000 7fb45b800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45406d1d0 con 0x7fb4540cf6b0 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.819+0000 7fb45b800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4540ce460 con 0x7fb4540cf220 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb459800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4540cf6b0 0x7fb454070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb459800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4540cf6b0 0x7fb454070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36324/0 (socket says 172.21.15.162:36324) 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb459800640 1 -- 172.21.15.162:0/3376930390 learned_addr learned my addr 172.21.15.162:0/3376930390 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb44bc00640 1 --2- 172.21.15.162:0/3376930390 >> v2:172.21.15.179:3300/0 conn(0x7fb4540cf220 0x7fb4540705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb459800640 1 -- 172.21.15.162:0/3376930390 >> v2:172.21.15.179:3300/0 conn(0x7fb4540cf220 msgr2=0x7fb4540705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb459800640 1 --2- 172.21.15.162:0/3376930390 >> v2:172.21.15.179:3300/0 conn(0x7fb4540cf220 0x7fb4540705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb459800640 1 -- 172.21.15.162:0/3376930390 >> v1:172.21.15.179:6789/0 conn(0x7fb4540adf80 legacy=0x7fb4540ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb459800640 1 -- 172.21.15.162:0/3376930390 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540ce740 con 0x7fb4540cf6b0 2024-01-20T11:08:33.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.820+0000 7fb44bc00640 1 --2- 172.21.15.162:0/3376930390 >> v2:172.21.15.179:3300/0 conn(0x7fb4540cf220 0x7fb4540705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.821+0000 7fb459800640 1 --2- 172.21.15.162:0/3376930390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454070ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb454072650 tx=0x7fb44c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9d58ed75fdfc93 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.821+0000 7fb453e00640 1 -- 172.21.15.162:0/3376930390 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c02ca80 con 0x7fb4540cf6b0 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb453e00640 1 -- 172.21.15.162:0/3376930390 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c02cbe0 con 0x7fb4540cf6b0 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb453e00640 1 -- 172.21.15.162:0/3376930390 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0343f0 con 0x7fb4540cf6b0 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 -- 172.21.15.162:0/3376930390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 msgr2=0x7fb454070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 --2- 172.21.15.162:0/3376930390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454070ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb454072650 tx=0x7fb44c02bee0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 -- 172.21.15.162:0/3376930390 shutdown_connections 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 --2- 172.21.15.162:0/3376930390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454070ae0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 --2- 172.21.15.162:0/3376930390 >> v2:172.21.15.179:3300/0 conn(0x7fb4540cf220 0x7fb4540705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 -- 172.21.15.162:0/3376930390 >> 172.21.15.162:0/3376930390 conn(0x7fb45406a600 msgr2=0x7fb45406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 -- 172.21.15.162:0/3376930390 shutdown_connections 2024-01-20T11:08:33.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.822+0000 7fb45b800640 1 -- 172.21.15.162:0/3376930390 wait complete. 2024-01-20T11:08:33.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.824+0000 7fb45b800640 1 Processor -- start 2024-01-20T11:08:33.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.824+0000 7fb45b800640 1 -- start start 2024-01-20T11:08:33.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.825+0000 7fb45b800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4540adf80 0x7fb454143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:33.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.825+0000 7fb45b800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4540cf220 0x7fb454145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:33.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.825+0000 7fb45b800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:33.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.825+0000 7fb45b800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb454144f20 con 0x7fb4540cf6b0 2024-01-20T11:08:33.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.825+0000 7fb45b800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4541e6150 con 0x7fb4540adf80 2024-01-20T11:08:33.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.825+0000 7fb45b800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb454144000 con 0x7fb4540cf220 2024-01-20T11:08:33.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:33.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36330/0 (socket says 172.21.15.162:36330) 2024-01-20T11:08:33.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 -- 172.21.15.162:0/1606242015 learned_addr learned my addr 172.21.15.162:0/1606242015 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:33.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb458e00640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4540adf80 0x7fb454143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:33.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb44bc00640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4540cf220 0x7fb454145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:33.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 -- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4540cf220 msgr2=0x7fb454145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:33.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4540cf220 0x7fb454145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 -- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4540adf80 msgr2=0x7fb454143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:33.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4540adf80 0x7fb454143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:33.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 -- 172.21.15.162:0/1606242015 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009b30 con 0x7fb4540cf6b0 2024-01-20T11:08:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.826+0000 7fb459800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454071680 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb44c036040 tx=0x7fb44c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.827+0000 7fb451600640 1 -- 172.21.15.162:0/1606242015 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c03e450 con 0x7fb4540cf6b0 2024-01-20T11:08:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.827+0000 7fb451600640 1 -- 172.21.15.162:0/1606242015 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c03e5d0 con 0x7fb4540cf6b0 2024-01-20T11:08:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.827+0000 7fb451600640 1 -- 172.21.15.162:0/1606242015 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c03e980 con 0x7fb4540cf6b0 2024-01-20T11:08:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.827+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4541442a0 con 0x7fb4540cf6b0 2024-01-20T11:08:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.827+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb454144860 con 0x7fb4540cf6b0 2024-01-20T11:08:33.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.828+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb454145060 con 0x7fb4540cf6b0 2024-01-20T11:08:33.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.829+0000 7fb451600640 1 -- 172.21.15.162:0/1606242015 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb44c02cd50 con 0x7fb4540cf6b0 2024-01-20T11:08:33.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.830+0000 7fb451600640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb42c06af00 0x7fb42c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:33.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.830+0000 7fb451600640 1 -- 172.21.15.162:0/1606242015 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb44c0abc50 con 0x7fb4540cf6b0 2024-01-20T11:08:33.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.830+0000 7fb458e00640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb42c06af00 0x7fb42c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:33.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.831+0000 7fb458e00640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb42c06af00 0x7fb42c06d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb444004ea0 tx=0x7fb444009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:33.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:33.834+0000 7fb451600640 1 -- 172.21.15.162:0/1606242015 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb454145060 con 0x7fb4540cf6b0 2024-01-20T11:08:34.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.088+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb454145060 con 0x7fb4540cf6b0 2024-01-20T11:08:34.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.089+0000 7fb451600640 1 -- 172.21.15.162:0/1606242015 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb454145060 con 0x7fb4540cf6b0 2024-01-20T11:08:34.090 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:34.090 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:08:34.090 INFO:teuthology.orchestra.run.smithi162.stdout: "auth_dump": [ 2024-01-20T11:08:34.090 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.090 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.a", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA2qatli4LXOBAAyHG4hThQHVzhS2VuxtIShQ==", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.b", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatln9JhHRAAThi8suQy0WUJaCK80hNdMQ==", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:08:34.091 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.c", 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatljiNoDRAAF01GIgXhTP8Xw3tCJz4r9w==", 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.092 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.d", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatlO9ZVKxAAlodCLFD0cJVAL5yXVeEqlg==", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.0", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA8qatlmprLFhAA8txfY4VYIHGeFSq4MqTKXA==", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.093 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.1", 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA/qatlvx9yLxAAudg/s2BWxTBkX5HFB2XdcA==", 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.2", 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBDqatly0LLCxAAs92m9lgojdlmvSk6BdLbzA==", 2024-01-20T11:08:34.094 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.3", 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBGqatl2IqpIhAAphkrhMKWP3GywFmTNSymdw==", 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.4", 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBNqatl67EHLhAAU+cN87inhfqC8zSyDhXfwA==", 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.5", 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBRqatljVzrDRAAUPAgVpOxYiDrJyOnvBnUgA==", 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.096 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.6", 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBUqatlbmzXFxAApeFOxi8HAIpzM0qO3gxhZA==", 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.097 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.7", 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBXqatl+MWELxAArrji0ys1SfJ7v5yIwAifFQ==", 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.0", 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatljGIeOBAAZAh1ameerRU000krb9bN6g==", 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.098 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow r", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow rw", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rwx" 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.1", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA4qatl8NRKERAAGAVRlvq6iuXNcwGBrsxjCQ==", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow r", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow rw", 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rwx" 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.2", 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA4qatlChY5BxAAkBXYUjzsz/0ZfA/D7ydtsQ==", 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow r", 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow rw", 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rwx" 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.3", 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA4qatle+5OGxAAqVEOXYysmTEwit512OV0Gw==", 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.100 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow r", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow rw", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rwx" 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.admin", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA1qatlxob7LxAAjSuHtskn16u3B3P3zKkJCg==", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow *", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.bootstrap-mds", 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBgqatlEWbDIBAAAtqnYAFVSmckP5V58x1e5Q==", 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile bootstrap-mds" 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.bootstrap-mgr", 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBgqatlPXXDIBAAneA5/t3Av7oDtCk19WFEUQ==", 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.102 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.bootstrap-osd", 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBgqatljoPDIBAAh9ytqomVIRe4i2W4B9kM5w==", 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile bootstrap-osd" 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.bootstrap-rbd", 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBgqatlmJHDIBAA/zaX/+4hICnqUrWWaNY6qw==", 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-20T11:08:34.103 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBgqatlpaLDIBAAs53Q48l5lNctKDy37ZK3LQ==", 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.bootstrap-rgw", 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBgqatlmLLDIBAAfiQuuAXCJlv3EIf3p+hvWg==", 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mgr.x", 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA2qatleWbxLRAAM9Mru8f0sV5ndjgiwANf4A==", 2024-01-20T11:08:34.104 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow *", 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile mgr", 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mgr.y", 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA2qatlfFkPIxAAg8+vmZmaSmheq0M0JmG30w==", 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow *", 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile mgr", 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-01-20T11:08:34.105 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:08:34.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb42c06af00 msgr2=0x7fb42c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb42c06af00 0x7fb42c06d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb444004ea0 tx=0x7fb444009040 comp rx=0 tx=0).stop 2024-01-20T11:08:34.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 msgr2=0x7fb454071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454071680 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb44c036040 tx=0x7fb44c004a40 comp rx=0 tx=0).stop 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 shutdown_connections 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4540cf6b0 0x7fb454071680 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4540cf220 0x7fb454145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb42c06af00 0x7fb42c06d3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 --2- 172.21.15.162:0/1606242015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4540adf80 0x7fb454143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.092+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 >> 172.21.15.162:0/1606242015 conn(0x7fb45406a600 msgr2=0x7fb454160570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:34.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.093+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 shutdown_connections 2024-01-20T11:08:34.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.093+0000 7fb45b800640 1 -- 172.21.15.162:0/1606242015 wait complete. 2024-01-20T11:08:34.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-20T11:08:34.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.312+0000 7f0739600640 1 Processor -- start 2024-01-20T11:08:34.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.313+0000 7f0739600640 1 -- start start 2024-01-20T11:08:34.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.314+0000 7f0739600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f073415dda0 0x7f0734070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.314+0000 7f0739600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07340706c0 0x7f073406f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.314+0000 7f0739600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073415e520 con 0x7f07341618c0 2024-01-20T11:08:34.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.314+0000 7f0739600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073415edc0 con 0x7f073415dda0 2024-01-20T11:08:34.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.314+0000 7f0739600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073415e800 con 0x7f07340706c0 2024-01-20T11:08:34.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f07341618c0 0x7f0734161ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45804/0 (socket says 172.21.15.162:45804) 2024-01-20T11:08:34.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732a00640 1 -- 172.21.15.162:0/2310496513 learned_addr learned my addr 172.21.15.162:0/2310496513 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:34.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0733400640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07340706c0 0x7f073406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0729e00640 1 --2- 172.21.15.162:0/2310496513 >> v2:172.21.15.179:3300/0 conn(0x7f073415dda0 0x7f0734070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242020279 0 0) 0x7f073415e520 con 0x7f07341618c0 2024-01-20T11:08:34.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0714003520 con 0x7f07341618c0 2024-01-20T11:08:34.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1550595704 0 0) 0x7f0714003520 con 0x7f07341618c0 2024-01-20T11:08:34.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07340706c0 msgr2=0x7f073406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:34.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07340706c0 0x7f073406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 >> v2:172.21.15.179:3300/0 conn(0x7f073415dda0 msgr2=0x7f0734070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:34.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 --2- 172.21.15.162:0/2310496513 >> v2:172.21.15.179:3300/0 conn(0x7f073415dda0 0x7f0734070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073415eae0 con 0x7f07341618c0 2024-01-20T11:08:34.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f0724001a10 con 0x7f07341618c0 2024-01-20T11:08:34.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.315+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 >> v1:172.21.15.162:6789/0 conn(0x7f07341618c0 legacy=0x7f0734161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0732000640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0714003970 0x7f0714003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0732000640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07140047c0 0x7f0714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0732000640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07340706c0 0x7f0714005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073415edc0 con 0x7f07140047c0 2024-01-20T11:08:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073415e800 con 0x7f0714003970 2024-01-20T11:08:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071400b980 con 0x7f07340706c0 2024-01-20T11:08:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0729e00640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07140047c0 0x7f0714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0729e00640 1 -- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07340706c0 msgr2=0x7f0714005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:34.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0729e00640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07340706c0 0x7f0714005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0729e00640 1 -- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0714003970 msgr2=0x7f0714003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:34.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0729e00640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0714003970 0x7f0714003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.316+0000 7f0729e00640 1 -- 172.21.15.162:0/2310496513 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714003520 con 0x7f07140047c0 2024-01-20T11:08:34.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.317+0000 7f0729e00640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07140047c0 0x7f0714004c40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f071c009ac0 tx=0x7f07140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc11851b54316125 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:34.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.317+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c02c710 con 0x7f07140047c0 2024-01-20T11:08:34.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.317+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c02c870 con 0x7f07140047c0 2024-01-20T11:08:34.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.317+0000 7f0732000640 1 -- 172.21.15.162:0/2310496513 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c02cc00 con 0x7f07140047c0 2024-01-20T11:08:34.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.318+0000 7f0739600640 1 -- 172.21.15.162:0/2310496513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07140047c0 msgr2=0x7f0714004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.318+0000 7f0739600640 1 --2- 172.21.15.162:0/2310496513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07140047c0 0x7f0714004c40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f071c009ac0 tx=0x7f07140057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.318+0000 7f0733400640 1 -- 172.21.15.162:0/2310496513 reap_dead start 2024-01-20T11:08:34.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.318+0000 7f0739600640 1 -- 172.21.15.162:0/2310496513 shutdown_connections 2024-01-20T11:08:34.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.318+0000 7f0739600640 1 -- 172.21.15.162:0/2310496513 >> 172.21.15.162:0/2310496513 conn(0x7f07340d1230 msgr2=0x7f07340d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:34.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.318+0000 7f0739600640 1 -- 172.21.15.162:0/2310496513 shutdown_connections 2024-01-20T11:08:34.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.318+0000 7f0739600640 1 -- 172.21.15.162:0/2310496513 wait complete. 2024-01-20T11:08:34.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.320+0000 7f0739600640 1 Processor -- start 2024-01-20T11:08:34.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.320+0000 7f0739600640 1 -- start start 2024-01-20T11:08:34.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0739600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07140047c0 0x7f0734140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0739600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07340cb920 0x7f07341419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0739600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0734143660 0x7f07340ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0739600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073415d380 con 0x7f0734143660 2024-01-20T11:08:34.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0739600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734141400 con 0x7f07340cb920 2024-01-20T11:08:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0739600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07340cbe20 con 0x7f07140047c0 2024-01-20T11:08:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0733400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0734143660 0x7f07340ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0733400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0734143660 0x7f07340ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36352/0 (socket says 172.21.15.162:36352) 2024-01-20T11:08:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0733400640 1 -- 172.21.15.162:0/1467071533 learned_addr learned my addr 172.21.15.162:0/1467071533 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.321+0000 7f0732a00640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07140047c0 0x7f0734140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0733400640 1 -- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07140047c0 msgr2=0x7f0734140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0729e00640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07340cb920 0x7f07341419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0733400640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07140047c0 0x7f0734140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0733400640 1 -- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07340cb920 msgr2=0x7f07341419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0733400640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07340cb920 0x7f07341419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0733400640 1 -- 172.21.15.162:0/1467071533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07340cc100 con 0x7f0734143660 2024-01-20T11:08:34.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0729e00640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07340cb920 0x7f07341419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:34.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0733400640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0734143660 0x7f07340ccec0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07340743b0 tx=0x7f072c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:34.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f072b400640 1 -- 172.21.15.162:0/1467071533 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c00c620 con 0x7f0734143660 2024-01-20T11:08:34.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f072b400640 1 -- 172.21.15.162:0/1467071533 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c00c780 con 0x7f0734143660 2024-01-20T11:08:34.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07340cc3e0 con 0x7f0734143660 2024-01-20T11:08:34.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f072b400640 1 -- 172.21.15.162:0/1467071533 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c00cb30 con 0x7f0734143660 2024-01-20T11:08:34.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.322+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07340cc9a0 con 0x7f0734143660 2024-01-20T11:08:34.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.323+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0734067f20 con 0x7f0734143660 2024-01-20T11:08:34.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.324+0000 7f072b400640 1 -- 172.21.15.162:0/1467071533 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f072c00cc90 con 0x7f0734143660 2024-01-20T11:08:34.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.325+0000 7f072b400640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070c06aed0 0x7f070c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.325+0000 7f072b400640 1 -- 172.21.15.162:0/1467071533 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f072c088b20 con 0x7f0734143660 2024-01-20T11:08:34.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.325+0000 7f0732a00640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070c06aed0 0x7f070c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.326+0000 7f0732a00640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070c06aed0 0x7f070c06d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07340cb8b0 tx=0x7f0724009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:34.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.330+0000 7f072b400640 1 -- 172.21.15.162:0/1467071533 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f072c053d50 con 0x7f0734143660 2024-01-20T11:08:34.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.591+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f07340ccbc0 con 0x7f0734143660 2024-01-20T11:08:34.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.602+0000 7f072b400640 1 -- 172.21.15.162:0/1467071533 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f072c057370 con 0x7f0734143660 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070c06aed0 msgr2=0x7f070c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070c06aed0 0x7f070c06d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07340cb8b0 tx=0x7f0724009040 comp rx=0 tx=0).stop 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0734143660 msgr2=0x7f07340ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0734143660 0x7f07340ccec0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07340743b0 tx=0x7f072c00ec00 comp rx=0 tx=0).stop 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 shutdown_connections 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0734143660 0x7f07340ccec0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070c06aed0 0x7f070c06d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07340cb920 0x7f07341419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 --2- 172.21.15.162:0/1467071533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07140047c0 0x7f0734140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 >> 172.21.15.162:0/1467071533 conn(0x7f07340d1230 msgr2=0x7f07340afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 shutdown_connections 2024-01-20T11:08:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.605+0000 7f0739600640 1 -- 172.21.15.162:0/1467071533 wait complete. 2024-01-20T11:08:34.625 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-20T11:08:34.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.835+0000 7fd510c00640 1 Processor -- start 2024-01-20T11:08:34.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.836+0000 7fd510c00640 1 -- start start 2024-01-20T11:08:34.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.837+0000 7fd510c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd50c06dfe0 0x7fd50c071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.837+0000 7fd510c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c15ea60 con 0x7fd50c143bd0 2024-01-20T11:08:34.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.837+0000 7fd510c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c15de50 con 0x7fd50c071ac0 2024-01-20T11:08:34.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.837+0000 7fd510c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c071f50 con 0x7fd50c06dfe0 2024-01-20T11:08:34.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.837+0000 7fd50b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd50c143bd0 0x7fd50c15b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45814/0 (socket says 172.21.15.162:45814) 2024-01-20T11:08:34.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50b400640 1 -- 172.21.15.162:0/1859297046 learned_addr learned my addr 172.21.15.162:0/1859297046 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:34.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492917371 0 0) 0x7fd50c15ea60 con 0x7fd50c143bd0 2024-01-20T11:08:34.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd503e00640 1 --2- 172.21.15.162:0/1859297046 >> v2:172.21.15.179:3300/0 conn(0x7fd50c06dfe0 0x7fd50c071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4ec005730 con 0x7fd50c143bd0 2024-01-20T11:08:34.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139459430 0 0) 0x7fd4ec005730 con 0x7fd50c143bd0 2024-01-20T11:08:34.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 >> v2:172.21.15.179:3300/0 conn(0x7fd50c06dfe0 msgr2=0x7fd50c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50aa00640 1 --2- 172.21.15.162:0/1859297046 >> v2:172.21.15.179:3300/0 conn(0x7fd50c06dfe0 0x7fd50c071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 >> v1:172.21.15.179:6789/0 conn(0x7fd50c071ac0 legacy=0x7fd50c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.838+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c15e130 con 0x7fd50c143bd0 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fd4fc001670 con 0x7fd50c143bd0 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 >> v1:172.21.15.162:6789/0 conn(0x7fd50c143bd0 legacy=0x7fd50c15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec005b80 0x7fd4ec005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0069d0 0x7fd4ec006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec007390 0x7fd4ec00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c071f50 con 0x7fd4ec005b80 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec00e330 con 0x7fd4ec007390 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec00e4f0 con 0x7fd4ec0069d0 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50b400640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec005b80 0x7fd4ec005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd503e00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0069d0 0x7fd4ec006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50b400640 1 -- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0069d0 msgr2=0x7fd4ec006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:34.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50b400640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0069d0 0x7fd4ec006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50b400640 1 -- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec007390 msgr2=0x7fd4ec00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:34.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50be00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec007390 0x7fd4ec00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50b400640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec007390 0x7fd4ec00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50b400640 1 -- 172.21.15.162:0/1859297046 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec005730 con 0x7fd4ec005b80 2024-01-20T11:08:34.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd503e00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0069d0 0x7fd4ec006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:34.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.839+0000 7fd50be00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec007390 0x7fd4ec00db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:34.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.840+0000 7fd50be00640 1 -- 172.21.15.162:0/1859297046 reap_dead start 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd50b400640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec005b80 0x7fd4ec005fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c240 tx=0x7fd4ec007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37aaddd08710dc3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc005ad0 con 0x7fd4ec005b80 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc005c50 con 0x7fd4ec005b80 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd50aa00640 1 -- 172.21.15.162:0/1859297046 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc02c8b0 con 0x7fd4ec005b80 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd510c00640 1 -- 172.21.15.162:0/1859297046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec005b80 msgr2=0x7fd4ec005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd510c00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec005b80 0x7fd4ec005fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c240 tx=0x7fd4ec007a00 comp rx=0 tx=0).stop 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd510c00640 1 -- 172.21.15.162:0/1859297046 shutdown_connections 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd510c00640 1 --2- 172.21.15.162:0/1859297046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec005b80 0x7fd4ec005fa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd510c00640 1 -- 172.21.15.162:0/1859297046 >> 172.21.15.162:0/1859297046 conn(0x7fd50c0b0c40 msgr2=0x7fd50c0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:34.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd510c00640 1 -- 172.21.15.162:0/1859297046 shutdown_connections 2024-01-20T11:08:34.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.841+0000 7fd510c00640 1 -- 172.21.15.162:0/1859297046 wait complete. 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.843+0000 7fd510c00640 1 Processor -- start 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.843+0000 7fd510c00640 1 -- start start 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd510c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec005b80 0x7fd50c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd510c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c13aa00 0x7fd50c13ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd510c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd50c140b30 0x7fd50c140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd510c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c1597e0 con 0x7fd50c140b30 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd510c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c13b7a0 con 0x7fd50c13aa00 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd510c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c1406a0 con 0x7fd4ec005b80 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd50be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd50c140b30 0x7fd50c140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd50be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd50c140b30 0x7fd50c140fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36370/0 (socket says 172.21.15.162:36370) 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.844+0000 7fd50be00640 1 -- 172.21.15.162:0/4220818093 learned_addr learned my addr 172.21.15.162:0/4220818093 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd50be00640 1 -- 172.21.15.162:0/4220818093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec005b80 msgr2=0x7fd50c0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd50b400640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec005b80 0x7fd50c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd50be00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec005b80 0x7fd50c0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd50be00640 1 -- 172.21.15.162:0/4220818093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c13aa00 msgr2=0x7fd50c13ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd50be00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c13aa00 0x7fd50c13ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd50be00640 1 -- 172.21.15.162:0/4220818093 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0cd120 con 0x7fd50c140b30 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd50be00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd50c140b30 0x7fd50c140fb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd50c072600 tx=0x7fd50400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd503400640 1 -- 172.21.15.162:0/4220818093 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504003d80 con 0x7fd50c140b30 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd503400640 1 -- 172.21.15.162:0/4220818093 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504005070 con 0x7fd50c140b30 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c13b4c0 con 0x7fd50c140b30 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd503400640 1 -- 172.21.15.162:0/4220818093 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504005420 con 0x7fd50c140b30 2024-01-20T11:08:34.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.845+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c140330 con 0x7fd50c140b30 2024-01-20T11:08:34.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.846+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c074a30 con 0x7fd50c140b30 2024-01-20T11:08:34.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.847+0000 7fd503400640 1 -- 172.21.15.162:0/4220818093 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd504005580 con 0x7fd50c140b30 2024-01-20T11:08:34.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.848+0000 7fd503400640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4e406aed0 0x7fd4e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:34.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.848+0000 7fd503400640 1 -- 172.21.15.162:0/4220818093 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd504088c10 con 0x7fd50c140b30 2024-01-20T11:08:34.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.848+0000 7fd50b400640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4e406aed0 0x7fd4e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:34.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.849+0000 7fd50b400640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4e406aed0 0x7fd4e406d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc034000 tx=0x7fd4fc009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:34.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:34.853+0000 7fd503400640 1 -- 172.21.15.162:0/4220818093 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd504053e20 con 0x7fd50c140b30 2024-01-20T11:08:35.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.113+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd50c06cb50 con 0x7fd50c140b30 2024-01-20T11:08:35.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.118+0000 7fd503400640 1 -- 172.21.15.162:0/4220818093 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd504018020 con 0x7fd50c140b30 2024-01-20T11:08:35.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.120+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4e406aed0 msgr2=0x7fd4e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.120+0000 7fd510c00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4e406aed0 0x7fd4e406d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc034000 tx=0x7fd4fc009030 comp rx=0 tx=0).stop 2024-01-20T11:08:35.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.120+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd50c140b30 msgr2=0x7fd50c140fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.120+0000 7fd510c00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd50c140b30 0x7fd50c140fb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd50c072600 tx=0x7fd50400d9d0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 shutdown_connections 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd50c140b30 0x7fd50c140fb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd4e406aed0 0x7fd4e406d390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c13aa00 0x7fd50c13ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 --2- 172.21.15.162:0/4220818093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec005b80 0x7fd50c0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 >> 172.21.15.162:0/4220818093 conn(0x7fd50c0b0c40 msgr2=0x7fd50c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 shutdown_connections 2024-01-20T11:08:35.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.121+0000 7fd510c00640 1 -- 172.21.15.162:0/4220818093 wait complete. 2024-01-20T11:08:35.140 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-20T11:08:35.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.343+0000 7fcae3c00640 1 Processor -- start 2024-01-20T11:08:35.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.344+0000 7fcae3c00640 1 -- start start 2024-01-20T11:08:35.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.345+0000 7fcae3c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 0x7fcadc0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.345+0000 7fcae3c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc06c7f0 con 0x7fcadc15d5b0 2024-01-20T11:08:35.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.345+0000 7fcae3c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0ae130 con 0x7fcadc0b2580 2024-01-20T11:08:35.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.345+0000 7fcae3c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0ae410 con 0x7fcadc06c3b0 2024-01-20T11:08:35.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.345+0000 7fcae1200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcadc15d5b0 0x7fcadc1618e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45830/0 (socket says 172.21.15.162:45830) 2024-01-20T11:08:35.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.345+0000 7fcae1200640 1 -- 172.21.15.162:0/3444726357 learned_addr learned my addr 172.21.15.162:0/3444726357 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:35.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029420838 0 0) 0x7fcadc06c7f0 con 0x7fcadc15d5b0 2024-01-20T11:08:35.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcabc003520 con 0x7fcadc15d5b0 2024-01-20T11:08:35.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadbe00640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 0x7fcadc0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 401959163 0 0) 0x7fcabc003520 con 0x7fcadc15d5b0 2024-01-20T11:08:35.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 msgr2=0x7fcadc0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 0x7fcadc0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 >> v1:172.21.15.179:6789/0 conn(0x7fcadc0b2580 legacy=0x7fcadc0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0ae6f0 con 0x7fcadc15d5b0 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fcac4001670 con 0x7fcadc15d5b0 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 >> v1:172.21.15.162:6789/0 conn(0x7fcadc15d5b0 legacy=0x7fcadc1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcabc0039a0 0x7fcabc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcabc0047c0 0x7fcabc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 0x7fcabc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0ae410 con 0x7fcabc0047c0 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0054e0 con 0x7fcabc0039a0 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.346+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc00bec0 con 0x7fcadc06c3b0 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcadbe00640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcabc0047c0 0x7fcabc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcae1200640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcabc0039a0 0x7fcabc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcae1c00640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 0x7fcabc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcadbe00640 1 -- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 msgr2=0x7fcabc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:35.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcadbe00640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcadc06c3b0 0x7fcabc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcadbe00640 1 -- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcabc0039a0 msgr2=0x7fcabc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:35.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcadbe00640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcabc0039a0 0x7fcabc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcadbe00640 1 -- 172.21.15.162:0/3444726357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc003520 con 0x7fcabc0047c0 2024-01-20T11:08:35.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.347+0000 7fcae1200640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcabc0039a0 0x7fcabc003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:35.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.348+0000 7fcadbe00640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcabc0047c0 0x7fcabc004c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00ba30 tx=0x7fcabc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c137252011f371ee server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:35.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.348+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc032640 con 0x7fcabc0047c0 2024-01-20T11:08:35.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.348+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0327a0 con 0x7fcabc0047c0 2024-01-20T11:08:35.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.348+0000 7fcadb400640 1 -- 172.21.15.162:0/3444726357 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc032b30 con 0x7fcabc0047c0 2024-01-20T11:08:35.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.349+0000 7fcae3c00640 1 -- 172.21.15.162:0/3444726357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcabc0047c0 msgr2=0x7fcabc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.349+0000 7fcae3c00640 1 --2- 172.21.15.162:0/3444726357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcabc0047c0 0x7fcabc004c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00ba30 tx=0x7fcabc0057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.349+0000 7fcae1c00640 1 -- 172.21.15.162:0/3444726357 reap_dead start 2024-01-20T11:08:35.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.349+0000 7fcae3c00640 1 -- 172.21.15.162:0/3444726357 shutdown_connections 2024-01-20T11:08:35.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.349+0000 7fcae3c00640 1 -- 172.21.15.162:0/3444726357 >> 172.21.15.162:0/3444726357 conn(0x7fcadc06a600 msgr2=0x7fcadc06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:35.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.349+0000 7fcae3c00640 1 -- 172.21.15.162:0/3444726357 shutdown_connections 2024-01-20T11:08:35.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.349+0000 7fcae3c00640 1 -- 172.21.15.162:0/3444726357 wait complete. 2024-01-20T11:08:35.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.351+0000 7fcae3c00640 1 Processor -- start 2024-01-20T11:08:35.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.351+0000 7fcae3c00640 1 -- start start 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae3c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc0047c0 0x7fcadc160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae3c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcadc0b0a10 0x7fcadc13e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae3c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc0b0e90 0x7fcadc13eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae3c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc13f0d0 con 0x7fcadc0b0e90 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae3c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc15e240 con 0x7fcadc0b0a10 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae3c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc1e8ea0 con 0x7fcabc0047c0 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc0b0e90 0x7fcadc13eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc0b0e90 0x7fcadc13eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36388/0 (socket says 172.21.15.162:36388) 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.352+0000 7fcae1c00640 1 -- 172.21.15.162:0/1118040593 learned_addr learned my addr 172.21.15.162:0/1118040593 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae1200640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc0047c0 0x7fcadc160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcadbe00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcadc0b0a10 0x7fcadc13e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae1c00640 1 -- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc0047c0 msgr2=0x7fcadc160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae1c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc0047c0 0x7fcadc160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae1c00640 1 -- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcadc0b0a10 msgr2=0x7fcadc13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae1c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcadc0b0a10 0x7fcadc13e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae1c00640 1 -- 172.21.15.162:0/1118040593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc15db10 con 0x7fcadc0b0e90 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae1c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc0b0e90 0x7fcadc13eb90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0ad260 tx=0x7fcad400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcad8c00640 1 -- 172.21.15.162:0/1118040593 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4003b70 con 0x7fcadc0b0e90 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcad8c00640 1 -- 172.21.15.162:0/1118040593 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4003cd0 con 0x7fcadc0b0e90 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcad8c00640 1 -- 172.21.15.162:0/1118040593 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4005290 con 0x7fcadc0b0e90 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc1e88e0 con 0x7fcadc0b0e90 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.353+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc15ded0 con 0x7fcadc0b0e90 2024-01-20T11:08:35.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.355+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc04e970 con 0x7fcadc0b0e90 2024-01-20T11:08:35.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.355+0000 7fcad8c00640 1 -- 172.21.15.162:0/1118040593 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcad40053f0 con 0x7fcadc0b0e90 2024-01-20T11:08:35.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.357+0000 7fcad8c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcab406aed0 0x7fcab406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.357+0000 7fcad8c00640 1 -- 172.21.15.162:0/1118040593 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcad4088c30 con 0x7fcadc0b0e90 2024-01-20T11:08:35.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.357+0000 7fcae1200640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcab406aed0 0x7fcab406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.358+0000 7fcae1200640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcab406aed0 0x7fcab406d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000ff0 tx=0x7fcac4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:35.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.361+0000 7fcad8c00640 1 -- 172.21.15.162:0/1118040593 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcad4053db0 con 0x7fcadc0b0e90 2024-01-20T11:08:35.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.605+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fcadc15e380 con 0x7fcadc0b0e90 2024-01-20T11:08:35.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.608+0000 7fcad8c00640 1 -- 172.21.15.162:0/1118040593 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcad4018070 con 0x7fcadc0b0e90 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcab406aed0 msgr2=0x7fcab406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcab406aed0 0x7fcab406d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000ff0 tx=0x7fcac4009040 comp rx=0 tx=0).stop 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc0b0e90 msgr2=0x7fcadc13eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc0b0e90 0x7fcadc13eb90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0ad260 tx=0x7fcad400dc00 comp rx=0 tx=0).stop 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 shutdown_connections 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc0b0e90 0x7fcadc13eb90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcab406aed0 0x7fcab406d390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcadc0b0a10 0x7fcadc13e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 --2- 172.21.15.162:0/1118040593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc0047c0 0x7fcadc160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 >> 172.21.15.162:0/1118040593 conn(0x7fcadc06a600 msgr2=0x7fcadc072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 shutdown_connections 2024-01-20T11:08:35.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.611+0000 7fcae3c00640 1 -- 172.21.15.162:0/1118040593 wait complete. 2024-01-20T11:08:35.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-20T11:08:35.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.843+0000 7fb884000640 1 Processor -- start 2024-01-20T11:08:35.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.843+0000 7fb884000640 1 -- start start 2024-01-20T11:08:35.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.844+0000 7fb884000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb87c15d5b0 0x7fb87c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.844+0000 7fb884000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb87c1618e0 0x7fb87c161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.844+0000 7fb884000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c0ae130 con 0x7fb87c0b2040 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.844+0000 7fb884000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c0ae410 con 0x7fb87c1618e0 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.844+0000 7fb884000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c0ae6f0 con 0x7fb87c15d5b0 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.845+0000 7fb880c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb87c1618e0 0x7fb87c161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.845+0000 7fb880c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb87c1618e0 0x7fb87c161d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36402/0 (socket says 172.21.15.162:36402) 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.845+0000 7fb880c00640 1 -- 172.21.15.162:0/953227265 learned_addr learned my addr 172.21.15.162:0/953227265 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.845+0000 7fb880c00640 1 -- 172.21.15.162:0/953227265 >> v2:172.21.15.179:3300/0 conn(0x7fb87c15d5b0 msgr2=0x7fb87c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.845+0000 7fb880c00640 1 --2- 172.21.15.162:0/953227265 >> v2:172.21.15.179:3300/0 conn(0x7fb87c15d5b0 0x7fb87c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.845+0000 7fb880c00640 1 -- 172.21.15.162:0/953227265 >> v1:172.21.15.179:6789/0 conn(0x7fb87c0b2040 legacy=0x7fb87c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.845+0000 7fb880c00640 1 -- 172.21.15.162:0/953227265 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c1613c0 con 0x7fb87c1618e0 2024-01-20T11:08:35.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.846+0000 7fb880c00640 1 --2- 172.21.15.162:0/953227265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c1618e0 0x7fb87c161d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0672e0 tx=0x7fb86402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367d1e8e46ce7be2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:35.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb87be00640 1 -- 172.21.15.162:0/953227265 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640317e0 con 0x7fb87c1618e0 2024-01-20T11:08:35.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb87be00640 1 -- 172.21.15.162:0/953227265 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864031940 con 0x7fb87c1618e0 2024-01-20T11:08:35.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb87be00640 1 -- 172.21.15.162:0/953227265 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864031cd0 con 0x7fb87c1618e0 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 -- 172.21.15.162:0/953227265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c1618e0 msgr2=0x7fb87c161d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 --2- 172.21.15.162:0/953227265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c1618e0 0x7fb87c161d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0672e0 tx=0x7fb86402b880 comp rx=0 tx=0).stop 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 -- 172.21.15.162:0/953227265 shutdown_connections 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 --2- 172.21.15.162:0/953227265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c1618e0 0x7fb87c161d20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 --2- 172.21.15.162:0/953227265 >> v2:172.21.15.179:3300/0 conn(0x7fb87c15d5b0 0x7fb87c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 -- 172.21.15.162:0/953227265 >> 172.21.15.162:0/953227265 conn(0x7fb87c06a600 msgr2=0x7fb87c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 -- 172.21.15.162:0/953227265 shutdown_connections 2024-01-20T11:08:35.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.847+0000 7fb884000640 1 -- 172.21.15.162:0/953227265 wait complete. 2024-01-20T11:08:35.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.849+0000 7fb884000640 1 Processor -- start 2024-01-20T11:08:35.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.849+0000 7fb884000640 1 -- start start 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb884000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b2040 0x7fb87c147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb884000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c15d5b0 0x7fb87c157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb884000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c1618e0 0x7fb87c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb884000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0b1430 con 0x7fb87c15d5b0 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb884000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0b1660 con 0x7fb87c0b2040 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb884000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0b1940 con 0x7fb87c1618e0 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb880c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c15d5b0 0x7fb87c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb880c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c15d5b0 0x7fb87c157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36408/0 (socket says 172.21.15.162:36408) 2024-01-20T11:08:35.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.850+0000 7fb880c00640 1 -- 172.21.15.162:0/2446761475 learned_addr learned my addr 172.21.15.162:0/2446761475 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:35.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb882000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c1618e0 0x7fb87c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb880c00640 1 -- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c1618e0 msgr2=0x7fb87c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb880c00640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c1618e0 0x7fb87c0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb880c00640 1 -- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b2040 msgr2=0x7fb87c147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb881600640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b2040 0x7fb87c147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb880c00640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b2040 0x7fb87c147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb880c00640 1 -- 172.21.15.162:0/2446761475 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640094d0 con 0x7fb87c15d5b0 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb882000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c1618e0 0x7fb87c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb881600640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b2040 0x7fb87c147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb880c00640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c15d5b0 0x7fb87c157620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb86402b8c0 tx=0x7fb8640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb879600640 1 -- 172.21.15.162:0/2446761475 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640329c0 con 0x7fb87c15d5b0 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb879600640 1 -- 172.21.15.162:0/2446761475 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864032b40 con 0x7fb87c15d5b0 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb879600640 1 -- 172.21.15.162:0/2446761475 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640453f0 con 0x7fb87c15d5b0 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.851+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c0b1c20 con 0x7fb87c15d5b0 2024-01-20T11:08:35.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.852+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c153950 con 0x7fb87c15d5b0 2024-01-20T11:08:35.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.853+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c153b40 con 0x7fb87c15d5b0 2024-01-20T11:08:35.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.853+0000 7fb879600640 1 -- 172.21.15.162:0/2446761475 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb864045550 con 0x7fb87c15d5b0 2024-01-20T11:08:35.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.854+0000 7fb879600640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb85406aed0 0x7fb85406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:35.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.854+0000 7fb879600640 1 -- 172.21.15.162:0/2446761475 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8640ab840 con 0x7fb87c15d5b0 2024-01-20T11:08:35.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.855+0000 7fb881600640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb85406aed0 0x7fb85406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:35.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.855+0000 7fb881600640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb85406aed0 0x7fb85406d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00a8f0 tx=0x7fb86c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:35.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:35.858+0000 7fb879600640 1 -- 172.21.15.162:0/2446761475 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb8640769c0 con 0x7fb87c15d5b0 2024-01-20T11:08:36.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.118+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb87c04e970 con 0x7fb87c15d5b0 2024-01-20T11:08:36.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.127+0000 7fb879600640 1 -- 172.21.15.162:0/2446761475 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb864079fe0 con 0x7fb87c15d5b0 2024-01-20T11:08:36.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb85406aed0 msgr2=0x7fb85406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb85406aed0 0x7fb85406d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00a8f0 tx=0x7fb86c008040 comp rx=0 tx=0).stop 2024-01-20T11:08:36.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c15d5b0 msgr2=0x7fb87c157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c15d5b0 0x7fb87c157620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb86402b8c0 tx=0x7fb8640046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 shutdown_connections 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c1618e0 0x7fb87c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb87c15d5b0 0x7fb87c157620 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb85406aed0 0x7fb85406d390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.129+0000 7fb884000640 1 --2- 172.21.15.162:0/2446761475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b2040 0x7fb87c147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.130+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 >> 172.21.15.162:0/2446761475 conn(0x7fb87c06a600 msgr2=0x7fb87c0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.130+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 shutdown_connections 2024-01-20T11:08:36.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.130+0000 7fb884000640 1 -- 172.21.15.162:0/2446761475 wait complete. 2024-01-20T11:08:36.149 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-20T11:08:36.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.348+0000 7f23be800640 1 Processor -- start 2024-01-20T11:08:36.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.348+0000 7f23be800640 1 -- start start 2024-01-20T11:08:36.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23be800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f23b80ceaf0 0x7f23b80cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23be800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b80cf490 con 0x7f23b815d830 2024-01-20T11:08:36.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23be800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b815dc10 con 0x7f23b80d30d0 2024-01-20T11:08:36.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23be800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80d1f70 con 0x7f23b80ceaf0 2024-01-20T11:08:36.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23b7400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f23b815d830 0x7f23b806baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45840/0 (socket says 172.21.15.162:45840) 2024-01-20T11:08:36.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23b7400640 1 -- 172.21.15.162:0/1100427367 learned_addr learned my addr 172.21.15.162:0/1100427367 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:36.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23b6a00640 1 --2- 172.21.15.162:0/1100427367 >> v2:172.21.15.162:3300/0 conn(0x7f23b80ceaf0 0x7f23b80cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23b6000640 1 -- 172.21.15.162:0/1100427367 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124470314 0 0) 0x7f23b80cf490 con 0x7f23b815d830 2024-01-20T11:08:36.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23b6000640 1 -- 172.21.15.162:0/1100427367 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2398003520 con 0x7f23b815d830 2024-01-20T11:08:36.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.350+0000 7f23b6a00640 1 -- 172.21.15.162:0/1100427367 >> v1:172.21.15.179:6789/0 conn(0x7f23b80d30d0 legacy=0x7f23b80d3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:36.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.351+0000 7f23b6a00640 1 -- 172.21.15.162:0/1100427367 >> v1:172.21.15.162:6789/0 conn(0x7f23b815d830 legacy=0x7f23b806baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.351+0000 7f23b6a00640 1 -- 172.21.15.162:0/1100427367 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80d2250 con 0x7f23b80ceaf0 2024-01-20T11:08:36.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.352+0000 7f23b6a00640 1 --2- 172.21.15.162:0/1100427367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80ceaf0 0x7f23b80cef50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097a0 tx=0x7f23a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e773e0fb34ffba server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:36.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.352+0000 7f23b6000640 1 -- 172.21.15.162:0/1100427367 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0031830 con 0x7f23b80ceaf0 2024-01-20T11:08:36.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.352+0000 7f23b6000640 1 -- 172.21.15.162:0/1100427367 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a0031990 con 0x7f23b80ceaf0 2024-01-20T11:08:36.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.352+0000 7f23b6000640 1 -- 172.21.15.162:0/1100427367 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0031d20 con 0x7f23b80ceaf0 2024-01-20T11:08:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.353+0000 7f23be800640 1 -- 172.21.15.162:0/1100427367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80ceaf0 msgr2=0x7f23b80cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.353+0000 7f23be800640 1 --2- 172.21.15.162:0/1100427367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80ceaf0 0x7f23b80cef50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097a0 tx=0x7f23a002b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.353+0000 7f23be800640 1 -- 172.21.15.162:0/1100427367 shutdown_connections 2024-01-20T11:08:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.353+0000 7f23be800640 1 --2- 172.21.15.162:0/1100427367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80ceaf0 0x7f23b80cef50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.353+0000 7f23be800640 1 -- 172.21.15.162:0/1100427367 >> 172.21.15.162:0/1100427367 conn(0x7f23b808afe0 msgr2=0x7f23b809c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.353+0000 7f23be800640 1 -- 172.21.15.162:0/1100427367 shutdown_connections 2024-01-20T11:08:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.353+0000 7f23be800640 1 -- 172.21.15.162:0/1100427367 wait complete. 2024-01-20T11:08:36.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.355+0000 7f23be800640 1 Processor -- start 2024-01-20T11:08:36.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.355+0000 7f23be800640 1 -- start start 2024-01-20T11:08:36.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23be800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b80ceaf0 0x7f23b80b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23be800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80d30d0 0x7f23b81f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23be800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b815d830 0x7f23b81f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23be800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80b4650 con 0x7f23b80d30d0 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23be800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81f7650 con 0x7f23b815d830 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23be800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80b39d0 con 0x7f23b80ceaf0 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80d30d0 0x7f23b81f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80d30d0 0x7f23b81f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36424/0 (socket says 172.21.15.162:36424) 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 -- 172.21.15.162:0/3209268576 learned_addr learned my addr 172.21.15.162:0/3209268576 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b7400640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b80ceaf0 0x7f23b80b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 -- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b80ceaf0 msgr2=0x7f23b80b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b80ceaf0 0x7f23b80b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b7e00640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b815d830 0x7f23b81f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 -- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b815d830 msgr2=0x7f23b81f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b815d830 0x7f23b81f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b6a00640 1 -- 172.21.15.162:0/3209268576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0009400 con 0x7f23b80d30d0 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b7400640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b80ceaf0 0x7f23b80b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.356+0000 7f23b7e00640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b815d830 0x7f23b81f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.357+0000 7f23b6a00640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80d30d0 0x7f23b81f7110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23a00098c0 tx=0x7f23a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.357+0000 7f23af400640 1 -- 172.21.15.162:0/3209268576 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a003a6f0 con 0x7f23b80d30d0 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.357+0000 7f23af400640 1 -- 172.21.15.162:0/3209268576 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a003a870 con 0x7f23b80d30d0 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.357+0000 7f23af400640 1 -- 172.21.15.162:0/3209268576 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a003ac20 con 0x7f23b80d30d0 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.357+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b80b3cb0 con 0x7f23b80d30d0 2024-01-20T11:08:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.357+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b80b4270 con 0x7f23b80d30d0 2024-01-20T11:08:36.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.358+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b80b4790 con 0x7f23b80d30d0 2024-01-20T11:08:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.359+0000 7f23af400640 1 -- 172.21.15.162:0/3209268576 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f23a0030380 con 0x7f23b80d30d0 2024-01-20T11:08:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.360+0000 7f23af400640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f239006aed0 0x7f239006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.360+0000 7f23af400640 1 -- 172.21.15.162:0/3209268576 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23a00aad50 con 0x7f23b80d30d0 2024-01-20T11:08:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.360+0000 7f23b7400640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f239006aed0 0x7f239006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.361+0000 7f23b7400640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f239006aed0 0x7f239006d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f23a8005880 tx=0x7f23a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.364+0000 7f23af400640 1 -- 172.21.15.162:0/3209268576 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f23b80b4790 con 0x7f23b80d30d0 2024-01-20T11:08:36.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.632+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f23b80b4790 con 0x7f23b80d30d0 2024-01-20T11:08:36.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.636+0000 7f23af400640 1 -- 172.21.15.162:0/3209268576 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23b80b4790 con 0x7f23b80d30d0 2024-01-20T11:08:36.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.638+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f239006aed0 msgr2=0x7f239006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.638+0000 7f23be800640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f239006aed0 0x7f239006d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f23a8005880 tx=0x7f23a8009040 comp rx=0 tx=0).stop 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.638+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80d30d0 msgr2=0x7f23b81f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.638+0000 7f23be800640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80d30d0 0x7f23b81f7110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23a00098c0 tx=0x7f23a00046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 shutdown_connections 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f239006aed0 0x7f239006d390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b815d830 0x7f23b81f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b80d30d0 0x7f23b81f7110 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 --2- 172.21.15.162:0/3209268576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b80ceaf0 0x7f23b80b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 >> 172.21.15.162:0/3209268576 conn(0x7f23b808afe0 msgr2=0x7f23b80b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 shutdown_connections 2024-01-20T11:08:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.639+0000 7f23be800640 1 -- 172.21.15.162:0/3209268576 wait complete. 2024-01-20T11:08:36.658 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-20T11:08:36.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.870+0000 7fe177e00640 1 Processor -- start 2024-01-20T11:08:36.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.871+0000 7fe177e00640 1 -- start start 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe177e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe17815d610 0x7fe1780ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe177e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1780d3e90 0x7fe1780d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe177e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17815d9f0 con 0x7fe1780d1870 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe177e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1780cea90 con 0x7fe17815d610 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe177e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780ce0f0 con 0x7fe1780d3e90 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe176a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe17815d610 0x7fe1780ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe176a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe17815d610 0x7fe1780ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44030/0 (socket says 172.21.15.162:44030) 2024-01-20T11:08:36.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.872+0000 7fe176a00640 1 -- 172.21.15.162:0/3171380197 learned_addr learned my addr 172.21.15.162:0/3171380197 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:36.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.873+0000 7fe176a00640 1 -- 172.21.15.162:0/3171380197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1780d3e90 msgr2=0x7fe1780d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:36.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.873+0000 7fe176a00640 1 --2- 172.21.15.162:0/3171380197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1780d3e90 0x7fe1780d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.873+0000 7fe176a00640 1 -- 172.21.15.162:0/3171380197 >> v1:172.21.15.179:6789/0 conn(0x7fe1780d1870 legacy=0x7fe1780c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:36.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.873+0000 7fe176a00640 1 -- 172.21.15.162:0/3171380197 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780ce3d0 con 0x7fe17815d610 2024-01-20T11:08:36.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.874+0000 7fe176a00640 1 --2- 172.21.15.162:0/3171380197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17815d610 0x7fe1780ceeb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe168009870 tx=0x7fe16802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99e69fdb80b6f9b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:36.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.874+0000 7fe176000640 1 -- 172.21.15.162:0/3171380197 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168031740 con 0x7fe17815d610 2024-01-20T11:08:36.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.874+0000 7fe176000640 1 -- 172.21.15.162:0/3171380197 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1680318a0 con 0x7fe17815d610 2024-01-20T11:08:36.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.874+0000 7fe176000640 1 -- 172.21.15.162:0/3171380197 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168031c30 con 0x7fe17815d610 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 -- 172.21.15.162:0/3171380197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17815d610 msgr2=0x7fe1780ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 --2- 172.21.15.162:0/3171380197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17815d610 0x7fe1780ceeb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe168009870 tx=0x7fe16802b7e0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 -- 172.21.15.162:0/3171380197 shutdown_connections 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 --2- 172.21.15.162:0/3171380197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1780d3e90 0x7fe1780d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 --2- 172.21.15.162:0/3171380197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17815d610 0x7fe1780ceeb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 -- 172.21.15.162:0/3171380197 >> 172.21.15.162:0/3171380197 conn(0x7fe17809c5d0 msgr2=0x7fe1780d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 -- 172.21.15.162:0/3171380197 shutdown_connections 2024-01-20T11:08:36.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.875+0000 7fe177e00640 1 -- 172.21.15.162:0/3171380197 wait complete. 2024-01-20T11:08:36.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.877+0000 7fe177e00640 1 Processor -- start 2024-01-20T11:08:36.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.877+0000 7fe177e00640 1 -- start start 2024-01-20T11:08:36.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe177e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1780d1870 0x7fe1780c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe177e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1780d3e90 0x7fe1781535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe177e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17815d610 0x7fe1781585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe177e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178155110 con 0x7fe1780d3e90 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe177e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178154070 con 0x7fe1780d1870 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe177e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178154350 con 0x7fe17815d610 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe16de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1780d3e90 0x7fe1781535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe16de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1780d3e90 0x7fe1781535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44044/0 (socket says 172.21.15.162:44044) 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.878+0000 7fe16de00640 1 -- 172.21.15.162:0/1591391227 learned_addr learned my addr 172.21.15.162:0/1591391227 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe176a00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1780d1870 0x7fe1780c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe177400640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17815d610 0x7fe1781585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe16de00640 1 -- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17815d610 msgr2=0x7fe1781585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe16de00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17815d610 0x7fe1781585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe16de00640 1 -- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1780d1870 msgr2=0x7fe1780c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe16de00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1780d1870 0x7fe1780c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe16de00640 1 -- 172.21.15.162:0/1591391227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1680094d0 con 0x7fe1780d3e90 2024-01-20T11:08:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe176a00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1780d1870 0x7fe1780c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:08:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.879+0000 7fe16de00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1780d3e90 0x7fe1781535b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b410 tx=0x7fe16000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.880+0000 7fe16f400640 1 -- 172.21.15.162:0/1591391227 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160011830 con 0x7fe1780d3e90 2024-01-20T11:08:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.880+0000 7fe16f400640 1 -- 172.21.15.162:0/1591391227 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600119b0 con 0x7fe1780d3e90 2024-01-20T11:08:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.880+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe178154630 con 0x7fe1780d3e90 2024-01-20T11:08:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.880+0000 7fe16f400640 1 -- 172.21.15.162:0/1591391227 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160011d60 con 0x7fe1780d3e90 2024-01-20T11:08:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.880+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe178154bf0 con 0x7fe1780d3e90 2024-01-20T11:08:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.881+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe178074a30 con 0x7fe1780d3e90 2024-01-20T11:08:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.882+0000 7fe16f400640 1 -- 172.21.15.162:0/1591391227 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe16001a400 con 0x7fe1780d3e90 2024-01-20T11:08:36.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.883+0000 7fe16f400640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15006aed0 0x7fe15006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:36.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.883+0000 7fe16f400640 1 -- 172.21.15.162:0/1591391227 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe1600894f0 con 0x7fe1780d3e90 2024-01-20T11:08:36.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.883+0000 7fe176a00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15006aed0 0x7fe15006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:36.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.884+0000 7fe176a00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15006aed0 0x7fe15006d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe168035000 tx=0x7fe168008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:36.887+0000 7fe16f400640 1 -- 172.21.15.162:0/1591391227 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe160054670 con 0x7fe1780d3e90 2024-01-20T11:08:37.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.153+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe1780d0840 con 0x7fe1780d3e90 2024-01-20T11:08:37.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.157+0000 7fe16f400640 1 -- 172.21.15.162:0/1591391227 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe1600150a0 con 0x7fe1780d3e90 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15006aed0 msgr2=0x7fe15006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15006aed0 0x7fe15006d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe168035000 tx=0x7fe168008030 comp rx=0 tx=0).stop 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1780d3e90 msgr2=0x7fe1781535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1780d3e90 0x7fe1781535b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b410 tx=0x7fe16000b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 shutdown_connections 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17815d610 0x7fe1781585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1780d3e90 0x7fe1781535b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15006aed0 0x7fe15006d390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 --2- 172.21.15.162:0/1591391227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1780d1870 0x7fe1780c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 >> 172.21.15.162:0/1591391227 conn(0x7fe17809c5d0 msgr2=0x7fe17815bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:37.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.160+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 shutdown_connections 2024-01-20T11:08:37.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.161+0000 7fe177e00640 1 -- 172.21.15.162:0/1591391227 wait complete. 2024-01-20T11:08:37.179 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:37.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.387+0000 7f0af6400640 1 Processor -- start 2024-01-20T11:08:37.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.387+0000 7f0af6400640 1 -- start start 2024-01-20T11:08:37.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0af6400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0af0155a30 0x7f0af00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0af6400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af00ae6b0 0x7f0af006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0af6400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af0070b60 con 0x7f0af0070630 2024-01-20T11:08:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0af6400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af015ba10 con 0x7f0af0155a30 2024-01-20T11:08:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0af6400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af015bc00 con 0x7f0af00ae6b0 2024-01-20T11:08:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aef400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0af0155a30 0x7f0af00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aef400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0af0155a30 0x7f0af00ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44050/0 (socket says 172.21.15.162:44050) 2024-01-20T11:08:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aef400640 1 -- 172.21.15.162:0/4236362216 learned_addr learned my addr 172.21.15.162:0/4236362216 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aefe00640 1 --2- 172.21.15.162:0/4236362216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af00ae6b0 0x7f0af006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aef400640 1 -- 172.21.15.162:0/4236362216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af00ae6b0 msgr2=0x7f0af006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aef400640 1 --2- 172.21.15.162:0/4236362216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af00ae6b0 0x7f0af006c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aef400640 1 -- 172.21.15.162:0/4236362216 >> v1:172.21.15.179:6789/0 conn(0x7f0af0070630 legacy=0x7f0af00adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.389+0000 7f0aef400640 1 -- 172.21.15.162:0/4236362216 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af015bee0 con 0x7f0af0155a30 2024-01-20T11:08:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.391+0000 7f0aef400640 1 --2- 172.21.15.162:0/4236362216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0155a30 0x7f0af00ce800 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009870 tx=0x7f0ae002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33aa693c231cd7a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.391+0000 7f0aeea00640 1 -- 172.21.15.162:0/4236362216 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00317c0 con 0x7f0af0155a30 2024-01-20T11:08:37.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.391+0000 7f0aeea00640 1 -- 172.21.15.162:0/4236362216 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0031920 con 0x7f0af0155a30 2024-01-20T11:08:37.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.391+0000 7f0aeea00640 1 -- 172.21.15.162:0/4236362216 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0031cb0 con 0x7f0af0155a30 2024-01-20T11:08:37.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 -- 172.21.15.162:0/4236362216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0155a30 msgr2=0x7f0af00ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 --2- 172.21.15.162:0/4236362216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0155a30 0x7f0af00ce800 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009870 tx=0x7f0ae002b860 comp rx=0 tx=0).stop 2024-01-20T11:08:37.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 -- 172.21.15.162:0/4236362216 shutdown_connections 2024-01-20T11:08:37.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 --2- 172.21.15.162:0/4236362216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af00ae6b0 0x7f0af006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 --2- 172.21.15.162:0/4236362216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0155a30 0x7f0af00ce800 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 -- 172.21.15.162:0/4236362216 >> 172.21.15.162:0/4236362216 conn(0x7f0af00b0cd0 msgr2=0x7f0af00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:37.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 -- 172.21.15.162:0/4236362216 shutdown_connections 2024-01-20T11:08:37.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.392+0000 7f0af6400640 1 -- 172.21.15.162:0/4236362216 wait complete. 2024-01-20T11:08:37.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.393+0000 7f0af6400640 1 Processor -- start 2024-01-20T11:08:37.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.394+0000 7f0af6400640 1 -- start start 2024-01-20T11:08:37.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.394+0000 7f0af6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0070630 0x7f0af01f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.394+0000 7f0af6400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af00ae6b0 0x7f0af00cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.394+0000 7f0af6400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af0155a30 0x7f0af00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0af6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af01f4530 con 0x7f0af0070630 2024-01-20T11:08:37.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0af6400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00cb670 con 0x7f0af00ae6b0 2024-01-20T11:08:37.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0af6400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00ca4e0 con 0x7f0af0155a30 2024-01-20T11:08:37.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0070630 0x7f0af01f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0070630 0x7f0af01f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44056/0 (socket says 172.21.15.162:44056) 2024-01-20T11:08:37.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 -- 172.21.15.162:0/2385215188 learned_addr learned my addr 172.21.15.162:0/2385215188 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:37.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 -- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af0155a30 msgr2=0x7f0af00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af0155a30 0x7f0af00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 -- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af00ae6b0 msgr2=0x7f0af00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0ae7e00640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af00ae6b0 0x7f0af00cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af00ae6b0 0x7f0af00cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0aef400640 1 -- 172.21.15.162:0/2385215188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae00094d0 con 0x7f0af0070630 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.395+0000 7f0ae7e00640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af00ae6b0 0x7f0af00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.396+0000 7f0aef400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0070630 0x7f0af01f3ff0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000c00 tx=0x7f0ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.396+0000 7f0ae7400640 1 -- 172.21.15.162:0/2385215188 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00329a0 con 0x7f0af0070630 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.396+0000 7f0ae7400640 1 -- 172.21.15.162:0/2385215188 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0032b20 con 0x7f0af0070630 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.396+0000 7f0ae7400640 1 -- 172.21.15.162:0/2385215188 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00453f0 con 0x7f0af0070630 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.396+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af00c9960 con 0x7f0af0070630 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.396+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af00c9f20 con 0x7f0af0070630 2024-01-20T11:08:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.397+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af01f2f30 con 0x7f0af0070630 2024-01-20T11:08:37.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.398+0000 7f0ae7400640 1 -- 172.21.15.162:0/2385215188 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0ae004d3f0 con 0x7f0af0070630 2024-01-20T11:08:37.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.399+0000 7f0ae7400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ac806aed0 0x7f0ac806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.399+0000 7f0ae7400640 1 -- 172.21.15.162:0/2385215188 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ae00ab220 con 0x7f0af0070630 2024-01-20T11:08:37.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.399+0000 7f0ae7e00640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ac806aed0 0x7f0ac806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.400+0000 7f0ae7e00640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ac806aed0 0x7f0ac806d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0af009d300 tx=0x7f0ad8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.403+0000 7f0ae7400640 1 -- 172.21.15.162:0/2385215188 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0af01f2f30 con 0x7f0af0070630 2024-01-20T11:08:37.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.601+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af004e970 con 0x7f0af0070630 2024-01-20T11:08:37.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.603+0000 7f0ae7400640 1 -- 172.21.15.162:0/2385215188 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12882 (secure 0 0 0) 0x7f0ae00764d0 con 0x7f0af0070630 2024-01-20T11:08:37.604 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:37.604 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":32,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:33.586598+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:37.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ac806aed0 msgr2=0x7f0ac806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ac806aed0 0x7f0ac806d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0af009d300 tx=0x7f0ad8009040 comp rx=0 tx=0).stop 2024-01-20T11:08:37.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0070630 msgr2=0x7f0af01f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0070630 0x7f0af01f3ff0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000c00 tx=0x7f0ae00046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 shutdown_connections 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af0155a30 0x7f0af00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ac806aed0 0x7f0ac806d390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af00ae6b0 0x7f0af00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 --2- 172.21.15.162:0/2385215188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af0070630 0x7f0af01f3ff0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 >> 172.21.15.162:0/2385215188 conn(0x7f0af00b0cd0 msgr2=0x7f0af006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 shutdown_connections 2024-01-20T11:08:37.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.606+0000 7f0af6400640 1 -- 172.21.15.162:0/2385215188 wait complete. 2024-01-20T11:08:37.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:08:37.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:08:37.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.833+0000 7fe181200640 1 Processor -- start 2024-01-20T11:08:37.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.834+0000 7fe181200640 1 -- start start 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.835+0000 7fe181200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe17c0b2040 0x7fe17c15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.835+0000 7fe181200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0b2ec0 con 0x7fe17c0cf060 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.835+0000 7fe181200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0ce700 con 0x7fe17c15a380 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.835+0000 7fe181200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c070eb0 con 0x7fe17c0b2040 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.835+0000 7fe179400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe17c0b2040 0x7fe17c15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.835+0000 7fe17a800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe17c0cf060 0x7fe17c06c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49216/0 (socket says 172.21.15.162:49216) 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.835+0000 7fe17a800640 1 -- 172.21.15.162:0/2418937737 learned_addr learned my addr 172.21.15.162:0/2418937737 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:37.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.836+0000 7fe179400640 1 -- 172.21.15.162:0/2418937737 >> v1:172.21.15.179:6789/0 conn(0x7fe17c15a380 legacy=0x7fe17c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.836+0000 7fe179400640 1 -- 172.21.15.162:0/2418937737 >> v1:172.21.15.162:6789/0 conn(0x7fe17c0cf060 legacy=0x7fe17c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.836+0000 7fe179400640 1 -- 172.21.15.162:0/2418937737 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0b2590 con 0x7fe17c0b2040 2024-01-20T11:08:37.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.837+0000 7fe179400640 1 --2- 172.21.15.162:0/2418937737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c15e8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097a0 tx=0x7fe16402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a8a8f5a737c47d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:37.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe178a00640 1 -- 172.21.15.162:0/2418937737 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164031830 con 0x7fe17c0b2040 2024-01-20T11:08:37.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe178a00640 1 -- 172.21.15.162:0/2418937737 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164031990 con 0x7fe17c0b2040 2024-01-20T11:08:37.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe178a00640 1 -- 172.21.15.162:0/2418937737 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164031d20 con 0x7fe17c0b2040 2024-01-20T11:08:37.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe181200640 1 -- 172.21.15.162:0/2418937737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 msgr2=0x7fe17c15e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe181200640 1 --2- 172.21.15.162:0/2418937737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c15e8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097a0 tx=0x7fe16402b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe181200640 1 -- 172.21.15.162:0/2418937737 shutdown_connections 2024-01-20T11:08:37.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe181200640 1 --2- 172.21.15.162:0/2418937737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c15e8f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe181200640 1 -- 172.21.15.162:0/2418937737 >> 172.21.15.162:0/2418937737 conn(0x7fe17c06a600 msgr2=0x7fe17c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:37.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe181200640 1 -- 172.21.15.162:0/2418937737 shutdown_connections 2024-01-20T11:08:37.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.838+0000 7fe181200640 1 -- 172.21.15.162:0/2418937737 wait complete. 2024-01-20T11:08:37.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.840+0000 7fe181200640 1 Processor -- start 2024-01-20T11:08:37.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.840+0000 7fe181200640 1 -- start start 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe181200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c14db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe181200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17c0cf060 0x7fe17c156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe181200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17c15a380 0x7fe17c0a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe181200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0a8e90 con 0x7fe17c0b2040 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe181200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c157230 con 0x7fe17c15a380 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe181200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0a9110 con 0x7fe17c0cf060 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe179e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c14db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe179e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c14db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44082/0 (socket says 172.21.15.162:44082) 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.841+0000 7fe179e00640 1 -- 172.21.15.162:0/3916904960 learned_addr learned my addr 172.21.15.162:0/3916904960 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe17a800640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17c15a380 0x7fe17c0a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe179400640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17c0cf060 0x7fe17c156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe179e00640 1 -- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17c0cf060 msgr2=0x7fe17c156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe179e00640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17c0cf060 0x7fe17c156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe179e00640 1 -- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17c15a380 msgr2=0x7fe17c0a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe179e00640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17c15a380 0x7fe17c0a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe179e00640 1 -- 172.21.15.162:0/3916904960 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009400 con 0x7fe17c0b2040 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe179e00640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c14db70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c730 tx=0x7fe16c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe172000640 1 -- 172.21.15.162:0/3916904960 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c003b70 con 0x7fe17c0b2040 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe172000640 1 -- 172.21.15.162:0/3916904960 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c003cf0 con 0x7fe17c0b2040 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe172000640 1 -- 172.21.15.162:0/3916904960 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c003ea0 con 0x7fe17c0b2040 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c0a93f0 con 0x7fe17c0b2040 2024-01-20T11:08:37.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.842+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c0a99b0 con 0x7fe17c0b2040 2024-01-20T11:08:37.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.844+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c04e970 con 0x7fe17c0b2040 2024-01-20T11:08:37.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.845+0000 7fe172000640 1 -- 172.21.15.162:0/3916904960 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe16c00aa90 con 0x7fe17c0b2040 2024-01-20T11:08:37.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.845+0000 7fe172000640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15406aed0 0x7fe15406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:37.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.845+0000 7fe172000640 1 -- 172.21.15.162:0/3916904960 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe16c089120 con 0x7fe17c0b2040 2024-01-20T11:08:37.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.846+0000 7fe179400640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15406aed0 0x7fe15406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:37.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.846+0000 7fe179400640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15406aed0 0x7fe15406d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe164036000 tx=0x7fe164008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:37.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:37.850+0000 7fe172000640 1 -- 172.21.15.162:0/3916904960 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe16c054330 con 0x7fe17c0b2040 2024-01-20T11:08:38.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.044+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe17c06d550 con 0x7fe17c0b2040 2024-01-20T11:08:38.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.045+0000 7fe172000640 1 -- 172.21.15.162:0/3916904960 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe16c057950 con 0x7fe17c0b2040 2024-01-20T11:08:38.045 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:08:38.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15406aed0 msgr2=0x7fe15406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15406aed0 0x7fe15406d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe164036000 tx=0x7fe164008030 comp rx=0 tx=0).stop 2024-01-20T11:08:38.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 msgr2=0x7fe17c14db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c14db70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c730 tx=0x7fe16c00cbf0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 shutdown_connections 2024-01-20T11:08:38.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe15406aed0 0x7fe15406d390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17c15a380 0x7fe17c0a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17c0cf060 0x7fe17c156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 --2- 172.21.15.162:0/3916904960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0b2040 0x7fe17c14db70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.047+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 >> 172.21.15.162:0/3916904960 conn(0x7fe17c06a600 msgr2=0x7fe17c157970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:38.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.048+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 shutdown_connections 2024-01-20T11:08:38.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.048+0000 7fe181200640 1 -- 172.21.15.162:0/3916904960 wait complete. 2024-01-20T11:08:38.067 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T11:08:38.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.263+0000 7f80b1800640 1 Processor -- start 2024-01-20T11:08:38.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.263+0000 7f80b1800640 1 -- start start 2024-01-20T11:08:38.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.265+0000 7f80b1800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac13e380 0x7f80ac15efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.265+0000 7f80b1800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80ac06cce0 0x7f80ac140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.265+0000 7f80b1800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac15f960 con 0x7f80ac15f520 2024-01-20T11:08:38.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.265+0000 7f80b1800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac06d3a0 con 0x7f80ac06cce0 2024-01-20T11:08:38.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.265+0000 7f80b1800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0ccc70 con 0x7f80ac13e380 2024-01-20T11:08:38.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.266+0000 7f80a3e00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f80ac15f520 0x7f80ac06c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:41908/0 (socket says 172.21.15.162:41908) 2024-01-20T11:08:38.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.266+0000 7f80a3e00640 1 -- 172.21.15.162:0/2088822463 learned_addr learned my addr 172.21.15.162:0/2088822463 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:38.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.266+0000 7f80aaa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac13e380 0x7f80ac15efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.266+0000 7f80ab400640 1 --2- 172.21.15.162:0/2088822463 >> v2:172.21.15.179:3300/0 conn(0x7f80ac06cce0 0x7f80ac140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.266+0000 7f80aa000640 1 -- 172.21.15.162:0/2088822463 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354527819 0 0) 0x7f80ac15f960 con 0x7f80ac15f520 2024-01-20T11:08:38.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.266+0000 7f80aa000640 1 -- 172.21.15.162:0/2088822463 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f808c003520 con 0x7f80ac15f520 2024-01-20T11:08:38.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.267+0000 7f80aaa00640 1 -- 172.21.15.162:0/2088822463 >> v2:172.21.15.179:3300/0 conn(0x7f80ac06cce0 msgr2=0x7f80ac140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:38.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.267+0000 7f80aaa00640 1 --2- 172.21.15.162:0/2088822463 >> v2:172.21.15.179:3300/0 conn(0x7f80ac06cce0 0x7f80ac140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.267+0000 7f80aaa00640 1 -- 172.21.15.162:0/2088822463 >> v1:172.21.15.179:6789/0 conn(0x7f80ac15f520 legacy=0x7f80ac06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.267+0000 7f80aaa00640 1 -- 172.21.15.162:0/2088822463 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac06d150 con 0x7f80ac13e380 2024-01-20T11:08:38.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.267+0000 7f80ab400640 1 --2- 172.21.15.162:0/2088822463 >> v2:172.21.15.179:3300/0 conn(0x7f80ac06cce0 0x7f80ac140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:08:38.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.268+0000 7f80aaa00640 1 --2- 172.21.15.162:0/2088822463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac13e380 0x7f80ac15efe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f809c0097a0 tx=0x7f809c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fdb85e64afa6cee server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:38.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.268+0000 7f80aa000640 1 -- 172.21.15.162:0/2088822463 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c02d040 con 0x7f80ac13e380 2024-01-20T11:08:38.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.268+0000 7f80aa000640 1 -- 172.21.15.162:0/2088822463 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c031810 con 0x7f80ac13e380 2024-01-20T11:08:38.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.268+0000 7f80aa000640 1 -- 172.21.15.162:0/2088822463 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c031ba0 con 0x7f80ac13e380 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 -- 172.21.15.162:0/2088822463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac13e380 msgr2=0x7f80ac15efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 --2- 172.21.15.162:0/2088822463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac13e380 0x7f80ac15efe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f809c0097a0 tx=0x7f809c02b8b0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 -- 172.21.15.162:0/2088822463 shutdown_connections 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 --2- 172.21.15.162:0/2088822463 >> v2:172.21.15.179:3300/0 conn(0x7f80ac06cce0 0x7f80ac140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 --2- 172.21.15.162:0/2088822463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac13e380 0x7f80ac15efe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 -- 172.21.15.162:0/2088822463 >> 172.21.15.162:0/2088822463 conn(0x7f80ac06a600 msgr2=0x7f80ac06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 -- 172.21.15.162:0/2088822463 shutdown_connections 2024-01-20T11:08:38.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.269+0000 7f80b1800640 1 -- 172.21.15.162:0/2088822463 wait complete. 2024-01-20T11:08:38.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.271+0000 7f80b1800640 1 Processor -- start 2024-01-20T11:08:38.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.272+0000 7f80b1800640 1 -- start start 2024-01-20T11:08:38.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80b1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80ac06cce0 0x7f80ac139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80b1800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80ac13e380 0x7f80ac13a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80b1800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac15f520 0x7f80ac0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80b1800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac138a00 con 0x7f80ac06cce0 2024-01-20T11:08:38.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80b1800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0708f0 con 0x7f80ac13e380 2024-01-20T11:08:38.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80b1800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0705a0 con 0x7f80ac15f520 2024-01-20T11:08:38.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80ac06cce0 0x7f80ac139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80ac06cce0 0x7f80ac139dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44090/0 (socket says 172.21.15.162:44090) 2024-01-20T11:08:38.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 -- 172.21.15.162:0/1566204244 learned_addr learned my addr 172.21.15.162:0/1566204244 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 -- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac15f520 msgr2=0x7f80ac0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80ab400640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac15f520 0x7f80ac0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac15f520 0x7f80ac0ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80a3e00640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80ac13e380 0x7f80ac13a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 -- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80ac13e380 msgr2=0x7f80ac13a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80ac13e380 0x7f80ac13a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.273+0000 7f80aaa00640 1 -- 172.21.15.162:0/1566204244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4009a70 con 0x7f80ac06cce0 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.274+0000 7f80aaa00640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80ac06cce0 0x7f80ac139dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098c0 tx=0x7f809c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:38.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.274+0000 7f80a2a00640 1 -- 172.21.15.162:0/1566204244 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c03ad60 con 0x7f80ac06cce0 2024-01-20T11:08:38.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.274+0000 7f80a2a00640 1 -- 172.21.15.162:0/1566204244 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c044400 con 0x7f80ac06cce0 2024-01-20T11:08:38.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.274+0000 7f80a2a00640 1 -- 172.21.15.162:0/1566204244 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0445b0 con 0x7f80ac06cce0 2024-01-20T11:08:38.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.274+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c009400 con 0x7f80ac06cce0 2024-01-20T11:08:38.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.274+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac13aed0 con 0x7f80ac06cce0 2024-01-20T11:08:38.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.275+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac0b2f70 con 0x7f80ac06cce0 2024-01-20T11:08:38.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.276+0000 7f80a2a00640 1 -- 172.21.15.162:0/1566204244 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f809c04d440 con 0x7f80ac06cce0 2024-01-20T11:08:38.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.277+0000 7f80a2a00640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f808406af00 0x7f808406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.277+0000 7f80a2a00640 1 -- 172.21.15.162:0/1566204244 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f809c0ab650 con 0x7f80ac06cce0 2024-01-20T11:08:38.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.277+0000 7f80a3e00640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f808406af00 0x7f808406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.277+0000 7f80a3e00640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f808406af00 0x7f808406d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80ac072780 tx=0x7f8094009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:38.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.281+0000 7f80a2a00640 1 -- 172.21.15.162:0/1566204244 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f809c076740 con 0x7f80ac06cce0 2024-01-20T11:08:38.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.460+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f80ac04e970 con 0x7f80ac06cce0 2024-01-20T11:08:38.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.461+0000 7f80a2a00640 1 -- 172.21.15.162:0/1566204244 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+65 (secure 0 0 0) 0x7f809c035090 con 0x7f80ac06cce0 2024-01-20T11:08:38.461 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:38.462 INFO:teuthology.orchestra.run.smithi162.stdout:[ 2024-01-20T11:08:38.462 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:08:38.462 INFO:teuthology.orchestra.run.smithi162.stdout: "poolnum": 1, 2024-01-20T11:08:38.462 INFO:teuthology.orchestra.run.smithi162.stdout: "poolname": ".mgr" 2024-01-20T11:08:38.462 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:08:38.462 INFO:teuthology.orchestra.run.smithi162.stdout:] 2024-01-20T11:08:38.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.463+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f808406af00 msgr2=0x7f808406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.463+0000 7f80b1800640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f808406af00 0x7f808406d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80ac072780 tx=0x7f8094009040 comp rx=0 tx=0).stop 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.463+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80ac06cce0 msgr2=0x7f80ac139dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.463+0000 7f80b1800640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80ac06cce0 0x7f80ac139dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098c0 tx=0x7f809c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 shutdown_connections 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ac15f520 0x7f80ac0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f808406af00 0x7f808406d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80ac13e380 0x7f80ac13a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 --2- 172.21.15.162:0/1566204244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80ac06cce0 0x7f80ac139dc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 >> 172.21.15.162:0/1566204244 conn(0x7f80ac06a600 msgr2=0x7f80ac0cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 shutdown_connections 2024-01-20T11:08:38.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.464+0000 7f80b1800640 1 -- 172.21.15.162:0/1566204244 wait complete. 2024-01-20T11:08:38.480 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-20T11:08:38.480 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-20T11:08:38.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.683+0000 7f58ad600640 1 Processor -- start 2024-01-20T11:08:38.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.683+0000 7f58ad600640 1 -- start start 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58ad600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f58a8152290 0x7f58a80cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58ad600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58a806dc50 0x7f58a815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58ad600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a80d0070 con 0x7f58a80ca490 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58ad600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a815c910 con 0x7f58a8152290 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58ad600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a80b27d0 con 0x7f58a806dc50 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58a6a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f58a8152290 0x7f58a80cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58a6a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f58a8152290 0x7f58a80cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44096/0 (socket says 172.21.15.162:44096) 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58a6a00640 1 -- 172.21.15.162:0/2035480947 learned_addr learned my addr 172.21.15.162:0/2035480947 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58a6a00640 1 -- 172.21.15.162:0/2035480947 >> v2:172.21.15.179:3300/0 conn(0x7f58a806dc50 msgr2=0x7f58a815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58a6a00640 1 --2- 172.21.15.162:0/2035480947 >> v2:172.21.15.179:3300/0 conn(0x7f58a806dc50 0x7f58a815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58a6a00640 1 -- 172.21.15.162:0/2035480947 >> v1:172.21.15.179:6789/0 conn(0x7f58a80ca490 legacy=0x7f58a806d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:38.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.685+0000 7f58a6a00640 1 -- 172.21.15.162:0/2035480947 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80cf7d0 con 0x7f58a8152290 2024-01-20T11:08:38.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.686+0000 7f58a6a00640 1 --2- 172.21.15.162:0/2035480947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a8152290 0x7f58a80cf110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f58a806e560 tx=0x7f589802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66c20c6100a9a23 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:38.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58a6000640 1 -- 172.21.15.162:0/2035480947 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980317e0 con 0x7f58a8152290 2024-01-20T11:08:38.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58a6000640 1 -- 172.21.15.162:0/2035480947 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898031940 con 0x7f58a8152290 2024-01-20T11:08:38.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58a6000640 1 -- 172.21.15.162:0/2035480947 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898031cd0 con 0x7f58a8152290 2024-01-20T11:08:38.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 -- 172.21.15.162:0/2035480947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a8152290 msgr2=0x7f58a80cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 --2- 172.21.15.162:0/2035480947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a8152290 0x7f58a80cf110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f58a806e560 tx=0x7f589802b880 comp rx=0 tx=0).stop 2024-01-20T11:08:38.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 -- 172.21.15.162:0/2035480947 shutdown_connections 2024-01-20T11:08:38.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 --2- 172.21.15.162:0/2035480947 >> v2:172.21.15.179:3300/0 conn(0x7f58a806dc50 0x7f58a815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 --2- 172.21.15.162:0/2035480947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a8152290 0x7f58a80cf110 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 -- 172.21.15.162:0/2035480947 >> 172.21.15.162:0/2035480947 conn(0x7f58a806a600 msgr2=0x7f58a806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:38.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 -- 172.21.15.162:0/2035480947 shutdown_connections 2024-01-20T11:08:38.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.687+0000 7f58ad600640 1 -- 172.21.15.162:0/2035480947 wait complete. 2024-01-20T11:08:38.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.689+0000 7f58ad600640 1 Processor -- start 2024-01-20T11:08:38.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.689+0000 7f58ad600640 1 -- start start 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58ad600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a806dc50 0x7f58a814d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58ad600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58a80ca490 0x7f58a814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58ad600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58a8152290 0x7f58a80c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58ad600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a814ece0 con 0x7f58a806dc50 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58ad600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a814efc0 con 0x7f58a80ca490 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58ad600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a814f2a0 con 0x7f58a8152290 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58a6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a806dc50 0x7f58a814d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58a6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a806dc50 0x7f58a814d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44108/0 (socket says 172.21.15.162:44108) 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.690+0000 7f58a6a00640 1 -- 172.21.15.162:0/3740256413 learned_addr learned my addr 172.21.15.162:0/3740256413 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58a6a00640 1 -- 172.21.15.162:0/3740256413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58a8152290 msgr2=0x7f58a80c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58a6a00640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58a8152290 0x7f58a80c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58a6a00640 1 -- 172.21.15.162:0/3740256413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58a80ca490 msgr2=0x7f58a814e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58a6a00640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58a80ca490 0x7f58a814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58a6a00640 1 -- 172.21.15.162:0/3740256413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980094d0 con 0x7f58a806dc50 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58a6a00640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a806dc50 0x7f58a814d7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5898000c00 tx=0x7f58980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f589f400640 1 -- 172.21.15.162:0/3740256413 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898032880 con 0x7f58a806dc50 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f589f400640 1 -- 172.21.15.162:0/3740256413 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58980329e0 con 0x7f58a806dc50 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f589f400640 1 -- 172.21.15.162:0/3740256413 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898032d90 con 0x7f58a806dc50 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a814f580 con 0x7f58a806dc50 2024-01-20T11:08:38.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.691+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a814dd20 con 0x7f58a806dc50 2024-01-20T11:08:38.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.692+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a80cd1b0 con 0x7f58a806dc50 2024-01-20T11:08:38.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.693+0000 7f589f400640 1 -- 172.21.15.162:0/3740256413 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f589804d3f0 con 0x7f58a806dc50 2024-01-20T11:08:38.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.694+0000 7f589f400640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f588006af00 0x7f588006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:38.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.694+0000 7f589f400640 1 -- 172.21.15.162:0/3740256413 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f58980ab1c0 con 0x7f58a806dc50 2024-01-20T11:08:38.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.695+0000 7f589de00640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f588006af00 0x7f588006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:38.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.695+0000 7f589de00640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f588006af00 0x7f588006d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5890007fd0 tx=0x7f5890007980 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:38.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.699+0000 7f589f400640 1 -- 172.21.15.162:0/3740256413 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f58a80cd1b0 con 0x7f58a806dc50 2024-01-20T11:08:38.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:38.878+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f58a80cd1b0 con 0x7f58a806dc50 2024-01-20T11:08:39.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.561+0000 7f589f400640 1 -- 172.21.15.162:0/3740256413 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f58a80cd1b0 con 0x7f58a806dc50 2024-01-20T11:08:39.562 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' created 2024-01-20T11:08:39.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f588006af00 msgr2=0x7f588006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:39.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f588006af00 0x7f588006d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5890007fd0 tx=0x7f5890007980 comp rx=0 tx=0).stop 2024-01-20T11:08:39.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a806dc50 msgr2=0x7f58a814d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:39.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a806dc50 0x7f58a814d7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5898000c00 tx=0x7f58980046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 shutdown_connections 2024-01-20T11:08:39.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58a8152290 0x7f58a80c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f588006af00 0x7f588006d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58a80ca490 0x7f58a814e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 --2- 172.21.15.162:0/3740256413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58a806dc50 0x7f58a814d7e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.565+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 >> 172.21.15.162:0/3740256413 conn(0x7f58a806a600 msgr2=0x7f58a806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:39.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.566+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 shutdown_connections 2024-01-20T11:08:39.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.566+0000 7f58ad600640 1 -- 172.21.15.162:0/3740256413 wait complete. 2024-01-20T11:08:39.589 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T11:08:39.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.783+0000 7f2021800640 1 Processor -- start 2024-01-20T11:08:39.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.783+0000 7f2021800640 1 -- start start 2024-01-20T11:08:39.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f2021800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 0x7f201c0cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f2021800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c0cf990 con 0x7f201c15d5b0 2024-01-20T11:08:39.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f2021800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c06c7f0 con 0x7f201c06c3b0 2024-01-20T11:08:39.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f2021800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0ae130 con 0x7f201c0cefe0 2024-01-20T11:08:39.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f201aa00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f201c15d5b0 0x7f201c1618e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49226/0 (socket says 172.21.15.162:49226) 2024-01-20T11:08:39.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f201aa00640 1 -- 172.21.15.162:0/1904056963 learned_addr learned my addr 172.21.15.162:0/1904056963 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f201b400640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 0x7f201c0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.785+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686811180 0 0) 0x7f201c0cf990 con 0x7f201c15d5b0 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ffc003520 con 0x7f201c15d5b0 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3391176252 0 0) 0x7f1ffc003520 con 0x7f201c15d5b0 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 msgr2=0x7f201c0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 0x7f201c0cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 >> v1:172.21.15.179:6789/0 conn(0x7f201c06c3b0 legacy=0x7f201c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0ae410 con 0x7f201c15d5b0 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f200c001670 con 0x7f201c15d5b0 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 >> v1:172.21.15.162:6789/0 conn(0x7f201c15d5b0 legacy=0x7f201c1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0039a0 0x7f1ffc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc0047c0 0x7f1ffc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 0x7f1ffc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0ae130 con 0x7f1ffc0047c0 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc00ba60 con 0x7f1ffc0039a0 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc00bc20 con 0x7f201c0cefe0 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.786+0000 7f201a000640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc0047c0 0x7f1ffc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201aa00640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0039a0 0x7f1ffc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201b400640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 0x7f1ffc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201a000640 1 -- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 msgr2=0x7f1ffc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201a000640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 0x7f1ffc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201a000640 1 -- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0039a0 msgr2=0x7f1ffc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201a000640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0039a0 0x7f1ffc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201a000640 1 -- 172.21.15.162:0/1904056963 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc003520 con 0x7f1ffc0047c0 2024-01-20T11:08:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.787+0000 7f201b400640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c0cefe0 0x7f1ffc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.788+0000 7f201a000640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc0047c0 0x7f1ffc004c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2004001720 tx=0x7f1ffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d25f2665802e4ae server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.788+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040052d0 con 0x7f1ffc0047c0 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.788+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200402e050 con 0x7f1ffc0047c0 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.788+0000 7f2019600640 1 -- 172.21.15.162:0/1904056963 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040035f0 con 0x7f1ffc0047c0 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.789+0000 7f2021800640 1 -- 172.21.15.162:0/1904056963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc0047c0 msgr2=0x7f1ffc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.789+0000 7f2021800640 1 --2- 172.21.15.162:0/1904056963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ffc0047c0 0x7f1ffc004c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2004001720 tx=0x7f1ffc0057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.789+0000 7f201b400640 1 -- 172.21.15.162:0/1904056963 reap_dead start 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.789+0000 7f2021800640 1 -- 172.21.15.162:0/1904056963 shutdown_connections 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.789+0000 7f2021800640 1 -- 172.21.15.162:0/1904056963 >> 172.21.15.162:0/1904056963 conn(0x7f201c06a600 msgr2=0x7f201c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.789+0000 7f2021800640 1 -- 172.21.15.162:0/1904056963 shutdown_connections 2024-01-20T11:08:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.789+0000 7f2021800640 1 -- 172.21.15.162:0/1904056963 wait complete. 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.791+0000 7f2021800640 1 Processor -- start 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.791+0000 7f2021800640 1 -- start start 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.792+0000 7f2021800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0047c0 0x7f201c1f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.792+0000 7f2021800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c15dca0 0x7f201c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.792+0000 7f2021800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c15c3f0 0x7f201c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.792+0000 7f2021800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15b390 con 0x7f201c15c3f0 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.792+0000 7f2021800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15cdb0 con 0x7f1ffc0047c0 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.792+0000 7f2021800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15b630 con 0x7f201c15dca0 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c15c3f0 0x7f201c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c15c3f0 0x7f201c15c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44136/0 (socket says 172.21.15.162:44136) 2024-01-20T11:08:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 -- 172.21.15.162:0/1537757660 learned_addr learned my addr 172.21.15.162:0/1537757660 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201a000640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c15dca0 0x7f201c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201aa00640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0047c0 0x7f201c1f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 -- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c15dca0 msgr2=0x7f201c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c15dca0 0x7f201c0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 -- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0047c0 msgr2=0x7f201c1f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0047c0 0x7f201c1f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 -- 172.21.15.162:0/1537757660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c15db10 con 0x7f201c15c3f0 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201a000640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c15dca0 0x7f201c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.793+0000 7f201b400640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c15c3f0 0x7f201c15c870 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f201c06d280 tx=0x7f201400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.794+0000 7f2012a00640 1 -- 172.21.15.162:0/1537757660 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014017400 con 0x7f201c15c3f0 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.794+0000 7f2012a00640 1 -- 172.21.15.162:0/1537757660 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014011040 con 0x7f201c15c3f0 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.794+0000 7f2012a00640 1 -- 172.21.15.162:0/1537757660 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014017780 con 0x7f201c15c3f0 2024-01-20T11:08:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.794+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c15b910 con 0x7f201c15c3f0 2024-01-20T11:08:39.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.794+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c15bed0 con 0x7f201c15c3f0 2024-01-20T11:08:39.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.795+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c15c0c0 con 0x7f201c15c3f0 2024-01-20T11:08:39.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.796+0000 7f2012a00640 1 -- 172.21.15.162:0/1537757660 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f20140203b0 con 0x7f201c15c3f0 2024-01-20T11:08:39.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.797+0000 7f2012a00640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ff406aed0 0x7f1ff406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:39.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.797+0000 7f2012a00640 1 -- 172.21.15.162:0/1537757660 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f20140897a0 con 0x7f201c15c3f0 2024-01-20T11:08:39.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.797+0000 7f201aa00640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ff406aed0 0x7f1ff406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:39.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.798+0000 7f201aa00640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ff406aed0 0x7f1ff406d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f200c001eb0 tx=0x7f200c000f40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:39.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.802+0000 7f2012a00640 1 -- 172.21.15.162:0/1537757660 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f20140547b0 con 0x7f201c15c3f0 2024-01-20T11:08:39.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:39.991+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f201c04e970 con 0x7f201c15c3f0 2024-01-20T11:08:40.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.575+0000 7f2012a00640 1 -- 172.21.15.162:0/1537757660 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2014057dd0 con 0x7f201c15c3f0 2024-01-20T11:08:40.577 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' created 2024-01-20T11:08:40.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.578+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ff406aed0 msgr2=0x7f1ff406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:40.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.578+0000 7f2021800640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ff406aed0 0x7f1ff406d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f200c001eb0 tx=0x7f200c000f40 comp rx=0 tx=0).stop 2024-01-20T11:08:40.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.578+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c15c3f0 msgr2=0x7f201c15c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.578+0000 7f2021800640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c15c3f0 0x7f201c15c870 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f201c06d280 tx=0x7f201400f4a0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.579+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 shutdown_connections 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.579+0000 7f2021800640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c15c3f0 0x7f201c15c870 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.579+0000 7f2021800640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f201c15dca0 0x7f201c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.579+0000 7f2021800640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1ff406aed0 0x7f1ff406d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.579+0000 7f2021800640 1 --2- 172.21.15.162:0/1537757660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc0047c0 0x7f201c1f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.579+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 >> 172.21.15.162:0/1537757660 conn(0x7f201c06a600 msgr2=0x7f201c0707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:40.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.580+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 shutdown_connections 2024-01-20T11:08:40.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.580+0000 7f2021800640 1 -- 172.21.15.162:0/1537757660 wait complete. 2024-01-20T11:08:40.613 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-20T11:08:40.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.790+0000 7f744c800640 1 Processor -- start 2024-01-20T11:08:40.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.790+0000 7f744c800640 1 -- start start 2024-01-20T11:08:40.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.791+0000 7f744c800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f744415d5b0 0x7f744406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:40.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f744c800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74441618e0 0x7f7444161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:40.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f744c800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74440ae130 con 0x7f74440b2040 2024-01-20T11:08:40.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f744c800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74440ae410 con 0x7f744415d5b0 2024-01-20T11:08:40.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f744c800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74440ae6f0 con 0x7f74441618e0 2024-01-20T11:08:40.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f744415d5b0 0x7f744406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:40.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f744415d5b0 0x7f744406c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44142/0 (socket says 172.21.15.162:44142) 2024-01-20T11:08:40.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449e00640 1 -- 172.21.15.162:0/759978939 learned_addr learned my addr 172.21.15.162:0/759978939 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449400640 1 --2- 172.21.15.162:0/759978939 >> v2:172.21.15.179:3300/0 conn(0x7f74441618e0 0x7f7444161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449e00640 1 -- 172.21.15.162:0/759978939 >> v2:172.21.15.179:3300/0 conn(0x7f74441618e0 msgr2=0x7f7444161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449e00640 1 --2- 172.21.15.162:0/759978939 >> v2:172.21.15.179:3300/0 conn(0x7f74441618e0 0x7f7444161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449e00640 1 -- 172.21.15.162:0/759978939 >> v1:172.21.15.162:6789/0 conn(0x7f74440b2040 legacy=0x7f74440cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449e00640 1 -- 172.21.15.162:0/759978939 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74441613c0 con 0x7f744415d5b0 2024-01-20T11:08:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.792+0000 7f7449400640 1 --2- 172.21.15.162:0/759978939 >> v2:172.21.15.179:3300/0 conn(0x7f74441618e0 0x7f7444161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f7449e00640 1 --2- 172.21.15.162:0/759978939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f744415d5b0 0x7f744406c3b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7444162340 tx=0x7f743c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a499993dadd37a4e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:40.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f7448a00640 1 -- 172.21.15.162:0/759978939 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c02ca80 con 0x7f744415d5b0 2024-01-20T11:08:40.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f7448a00640 1 -- 172.21.15.162:0/759978939 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c02cbe0 con 0x7f744415d5b0 2024-01-20T11:08:40.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f7448a00640 1 -- 172.21.15.162:0/759978939 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0343f0 con 0x7f744415d5b0 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f744c800640 1 -- 172.21.15.162:0/759978939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f744415d5b0 msgr2=0x7f744406c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f744c800640 1 --2- 172.21.15.162:0/759978939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f744415d5b0 0x7f744406c3b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7444162340 tx=0x7f743c02bee0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f744c800640 1 -- 172.21.15.162:0/759978939 shutdown_connections 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f744c800640 1 --2- 172.21.15.162:0/759978939 >> v2:172.21.15.179:3300/0 conn(0x7f74441618e0 0x7f7444161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f744c800640 1 --2- 172.21.15.162:0/759978939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f744415d5b0 0x7f744406c3b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.794+0000 7f744c800640 1 -- 172.21.15.162:0/759978939 >> 172.21.15.162:0/759978939 conn(0x7f744406a600 msgr2=0x7f744406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.795+0000 7f744c800640 1 -- 172.21.15.162:0/759978939 shutdown_connections 2024-01-20T11:08:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.795+0000 7f744c800640 1 -- 172.21.15.162:0/759978939 wait complete. 2024-01-20T11:08:40.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.796+0000 7f744c800640 1 Processor -- start 2024-01-20T11:08:40.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.796+0000 7f744c800640 1 -- start start 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744c800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74440b2040 0x7f7444152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744c800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744415d5b0 0x7f7444157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74441618e0 0x7f7444158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440b1a60 con 0x7f74441618e0 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744c800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7444159e30 con 0x7f744415d5b0 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744c800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74440b14a0 con 0x7f74440b2040 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74441618e0 0x7f7444158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74441618e0 0x7f7444158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44146/0 (socket says 172.21.15.162:44146) 2024-01-20T11:08:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.797+0000 7f744a800640 1 -- 172.21.15.162:0/1043805898 learned_addr learned my addr 172.21.15.162:0/1043805898 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f7449e00640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74440b2040 0x7f7444152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f7449400640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744415d5b0 0x7f7444157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f744a800640 1 -- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74440b2040 msgr2=0x7f7444152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f744a800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74440b2040 0x7f7444152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f744a800640 1 -- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744415d5b0 msgr2=0x7f7444157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f744a800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744415d5b0 0x7f7444157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f744a800640 1 -- 172.21.15.162:0/1043805898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c009b30 con 0x7f74441618e0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f7449e00640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74440b2040 0x7f7444152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f7449400640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744415d5b0 0x7f7444157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f744a800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74441618e0 0x7f7444158490 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f743400c400 tx=0x7f743400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f7442000640 1 -- 172.21.15.162:0/1043805898 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74340052d0 con 0x7f74441618e0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f7442000640 1 -- 172.21.15.162:0/1043805898 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7434005430 con 0x7f74441618e0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f7442000640 1 -- 172.21.15.162:0/1043805898 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434003810 con 0x7f74441618e0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.798+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74440b1780 con 0x7f74441618e0 2024-01-20T11:08:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.799+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7444153100 con 0x7f74441618e0 2024-01-20T11:08:40.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.800+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744404e970 con 0x7f74441618e0 2024-01-20T11:08:40.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.801+0000 7f7442000640 1 -- 172.21.15.162:0/1043805898 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7434003970 con 0x7f74441618e0 2024-01-20T11:08:40.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.802+0000 7f7442000640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f741c06af00 0x7f741c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:40.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.802+0000 7f7442000640 1 -- 172.21.15.162:0/1043805898 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7434088b60 con 0x7f74441618e0 2024-01-20T11:08:40.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.802+0000 7f7449e00640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f741c06af00 0x7f741c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:40.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.803+0000 7f7449e00640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f741c06af00 0x7f741c06d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f743c035000 tx=0x7f743c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:40.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:40.807+0000 7f7442000640 1 -- 172.21.15.162:0/1043805898 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7434053a80 con 0x7f74441618e0 2024-01-20T11:08:41.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.040+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7444159f70 con 0x7f74441618e0 2024-01-20T11:08:41.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.971+0000 7f7442000640 1 -- 172.21.15.162:0/1043805898 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f74340170c0 con 0x7f74441618e0 2024-01-20T11:08:41.972 INFO:teuthology.orchestra.run.smithi162.stderr:new fs with metadata pool 4 and data pool 5 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f741c06af00 msgr2=0x7f741c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f741c06af00 0x7f741c06d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f743c035000 tx=0x7f743c030000 comp rx=0 tx=0).stop 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74441618e0 msgr2=0x7f7444158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74441618e0 0x7f7444158490 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f743400c400 tx=0x7f743400c8c0 comp rx=0 tx=0).stop 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 shutdown_connections 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74441618e0 0x7f7444158490 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f741c06af00 0x7f741c06d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f744415d5b0 0x7f7444157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:41.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 --2- 172.21.15.162:0/1043805898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74440b2040 0x7f7444152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:41.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.982+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 >> 172.21.15.162:0/1043805898 conn(0x7f744406a600 msgr2=0x7f74441601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:41.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.983+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 shutdown_connections 2024-01-20T11:08:41.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:41.983+0000 7f744c800640 1 -- 172.21.15.162:0/1043805898 wait complete. 2024-01-20T11:08:42.018 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:42.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.195+0000 7f069e400640 1 Processor -- start 2024-01-20T11:08:42.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.195+0000 7f069e400640 1 -- start start 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f069e400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f06980c9630 0x7f0698162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f069e400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069806d1d0 0x7f0698070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f069e400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069806c730 con 0x7f06980c9a10 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f069e400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980cc1a0 con 0x7f06980c9630 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f069e400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069806c9d0 con 0x7f069806d1d0 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f0697400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f06980c9630 0x7f0698162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f0697400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f06980c9630 0x7f0698162c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44160/0 (socket says 172.21.15.162:44160) 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.197+0000 7f0697400640 1 -- 172.21.15.162:0/2681293054 learned_addr learned my addr 172.21.15.162:0/2681293054 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:42.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.198+0000 7f0697400640 1 -- 172.21.15.162:0/2681293054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069806d1d0 msgr2=0x7f0698070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:42.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.198+0000 7f0697e00640 1 --2- 172.21.15.162:0/2681293054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069806d1d0 0x7f0698070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.198+0000 7f0697400640 1 --2- 172.21.15.162:0/2681293054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069806d1d0 0x7f0698070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.198+0000 7f0697400640 1 -- 172.21.15.162:0/2681293054 >> v1:172.21.15.179:6789/0 conn(0x7f06980c9a10 legacy=0x7f06980cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:42.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.198+0000 7f0697400640 1 -- 172.21.15.162:0/2681293054 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069806ccb0 con 0x7f06980c9630 2024-01-20T11:08:42.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.198+0000 7f0697e00640 1 --2- 172.21.15.162:0/2681293054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069806d1d0 0x7f0698070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:42.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.199+0000 7f0697400640 1 --2- 172.21.15.162:0/2681293054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f0698162c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0680009870 tx=0x7f068002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc84cd4fb388af4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:42.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.199+0000 7f0696a00640 1 -- 172.21.15.162:0/2681293054 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680031640 con 0x7f06980c9630 2024-01-20T11:08:42.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.199+0000 7f0696a00640 1 -- 172.21.15.162:0/2681293054 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06800317a0 con 0x7f06980c9630 2024-01-20T11:08:42.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.199+0000 7f0696a00640 1 -- 172.21.15.162:0/2681293054 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680031b30 con 0x7f06980c9630 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 -- 172.21.15.162:0/2681293054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 msgr2=0x7f0698162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 --2- 172.21.15.162:0/2681293054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f0698162c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0680009870 tx=0x7f068002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 -- 172.21.15.162:0/2681293054 shutdown_connections 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 --2- 172.21.15.162:0/2681293054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069806d1d0 0x7f0698070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 --2- 172.21.15.162:0/2681293054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f0698162c20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 -- 172.21.15.162:0/2681293054 >> 172.21.15.162:0/2681293054 conn(0x7f06980b0cd0 msgr2=0x7f06980b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 -- 172.21.15.162:0/2681293054 shutdown_connections 2024-01-20T11:08:42.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.200+0000 7f069e400640 1 -- 172.21.15.162:0/2681293054 wait complete. 2024-01-20T11:08:42.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.202+0000 7f069e400640 1 Processor -- start 2024-01-20T11:08:42.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.202+0000 7f069e400640 1 -- start start 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f069e400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069806d1d0 0x7f0698147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f069e400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f06980affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f069e400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06980c9a10 0x7f06980b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f069e400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980cfe40 con 0x7f06980c9630 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f069e400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06981eb430 con 0x7f069806d1d0 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f069e400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06981eb710 con 0x7f06980c9a10 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f068fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f06980affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f068fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f06980affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44174/0 (socket says 172.21.15.162:44174) 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f068fe00640 1 -- 172.21.15.162:0/1503579285 learned_addr learned my addr 172.21.15.162:0/1503579285 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f0697e00640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06980c9a10 0x7f06980b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.203+0000 7f0697400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069806d1d0 0x7f0698147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068fe00640 1 -- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06980c9a10 msgr2=0x7f06980b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068fe00640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06980c9a10 0x7f06980b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068fe00640 1 -- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069806d1d0 msgr2=0x7f0698147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068fe00640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069806d1d0 0x7f0698147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068fe00640 1 -- 172.21.15.162:0/1503579285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800094d0 con 0x7f06980c9630 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f0697e00640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06980c9a10 0x7f06980b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068fe00640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f06980affd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f068800b3f0 tx=0x7f068800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068f400640 1 -- 172.21.15.162:0/1503579285 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688011830 con 0x7f06980c9630 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068f400640 1 -- 172.21.15.162:0/1503579285 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688011990 con 0x7f06980c9630 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f068f400640 1 -- 172.21.15.162:0/1503579285 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688011d40 con 0x7f06980c9630 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06981eb9f0 con 0x7f06980c9630 2024-01-20T11:08:42.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.204+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06981ebfb0 con 0x7f06980c9630 2024-01-20T11:08:42.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.205+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0698163110 con 0x7f06980c9630 2024-01-20T11:08:42.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.206+0000 7f068f400640 1 -- 172.21.15.162:0/1503579285 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f068801a400 con 0x7f06980c9630 2024-01-20T11:08:42.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.207+0000 7f068f400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f067006aed0 0x7f067006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.207+0000 7f068f400640 1 -- 172.21.15.162:0/1503579285 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06880894a0 con 0x7f06980c9630 2024-01-20T11:08:42.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.207+0000 7f0697400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f067006aed0 0x7f067006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.208+0000 7f0697400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f067006aed0 0x7f067006d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0680036000 tx=0x7f068003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:42.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.212+0000 7f068f400640 1 -- 172.21.15.162:0/1503579285 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0688054360 con 0x7f06980c9630 2024-01-20T11:08:42.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.403+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f069804e970 con 0x7f06980c9630 2024-01-20T11:08:42.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.407+0000 7f068f400640 1 -- 172.21.15.162:0/1503579285 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16607 (secure 0 0 0) 0x7f0688057980 con 0x7f06980c9630 2024-01-20T11:08:42.408 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:42.408 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":35,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:41.041915+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:08:38.930132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T11:08:40.039032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f067006aed0 msgr2=0x7f067006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f067006aed0 0x7f067006d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0680036000 tx=0x7f068003c040 comp rx=0 tx=0).stop 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 msgr2=0x7f06980affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f06980affd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f068800b3f0 tx=0x7f068800b8b0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 shutdown_connections 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06980c9a10 0x7f06980b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980c9630 0x7f06980affd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f067006aed0 0x7f067006d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 --2- 172.21.15.162:0/1503579285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069806d1d0 0x7f0698147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 >> 172.21.15.162:0/1503579285 conn(0x7f06980b0cd0 msgr2=0x7f06981624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:42.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.409+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 shutdown_connections 2024-01-20T11:08:42.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.410+0000 7f069e400640 1 -- 172.21.15.162:0/1503579285 wait complete. 2024-01-20T11:08:42.428 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:42.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.630+0000 7f0ef4a00640 1 Processor -- start 2024-01-20T11:08:42.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.631+0000 7f0ef4a00640 1 -- start start 2024-01-20T11:08:42.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.632+0000 7f0ef4a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ef0070d20 0x7f0ef00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.632+0000 7f0ef4a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ef00cf960 0x7f0ef00cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.632+0000 7f0ef4a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00cd300 con 0x7f0ef0143c70 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.632+0000 7f0ef4a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef00711b0 con 0x7f0ef0070d20 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.632+0000 7f0ef4a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef00cfd40 con 0x7f0ef00cf960 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.633+0000 7f0ee7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ef0070d20 0x7f0ef00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.633+0000 7f0ee7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ef0070d20 0x7f0ef00cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44188/0 (socket says 172.21.15.162:44188) 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.633+0000 7f0ee7e00640 1 -- 172.21.15.162:0/4287474544 learned_addr learned my addr 172.21.15.162:0/4287474544 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.633+0000 7f0ee7e00640 1 -- 172.21.15.162:0/4287474544 >> v2:172.21.15.179:3300/0 conn(0x7f0ef00cf960 msgr2=0x7f0ef00cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.633+0000 7f0ee7e00640 1 --2- 172.21.15.162:0/4287474544 >> v2:172.21.15.179:3300/0 conn(0x7f0ef00cf960 0x7f0ef00cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.633+0000 7f0ee7e00640 1 -- 172.21.15.162:0/4287474544 >> v1:172.21.15.179:6789/0 conn(0x7f0ef0143c70 legacy=0x7f0ef00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:42.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.633+0000 7f0ee7e00640 1 -- 172.21.15.162:0/4287474544 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00cc9d0 con 0x7f0ef0070d20 2024-01-20T11:08:42.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.634+0000 7f0ee7e00640 1 --2- 172.21.15.162:0/4287474544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0070d20 0x7f0ef00cf420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0072790 tx=0x7f0ed802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90885e458fe7322 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:42.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.634+0000 7f0eede00640 1 -- 172.21.15.162:0/4287474544 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8031870 con 0x7f0ef0070d20 2024-01-20T11:08:42.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.634+0000 7f0eede00640 1 -- 172.21.15.162:0/4287474544 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80319d0 con 0x7f0ef0070d20 2024-01-20T11:08:42.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.634+0000 7f0eede00640 1 -- 172.21.15.162:0/4287474544 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8031d60 con 0x7f0ef0070d20 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 -- 172.21.15.162:0/4287474544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0070d20 msgr2=0x7f0ef00cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/4287474544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0070d20 0x7f0ef00cf420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0072790 tx=0x7f0ed802b910 comp rx=0 tx=0).stop 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 -- 172.21.15.162:0/4287474544 shutdown_connections 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/4287474544 >> v2:172.21.15.179:3300/0 conn(0x7f0ef00cf960 0x7f0ef00cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/4287474544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0070d20 0x7f0ef00cf420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 -- 172.21.15.162:0/4287474544 >> 172.21.15.162:0/4287474544 conn(0x7f0ef006aa20 msgr2=0x7f0ef006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 -- 172.21.15.162:0/4287474544 shutdown_connections 2024-01-20T11:08:42.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.635+0000 7f0ef4a00640 1 -- 172.21.15.162:0/4287474544 wait complete. 2024-01-20T11:08:42.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.637+0000 7f0ef4a00640 1 Processor -- start 2024-01-20T11:08:42.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.637+0000 7f0ef4a00640 1 -- start start 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0ef4a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef0070d20 0x7f0ef0166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0ef4a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef00cf960 0x7f0ef0164b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0ef4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0143c70 0x7f0ef0167510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0ef4a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0165e40 con 0x7f0ef0143c70 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0ef4a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef01651c0 con 0x7f0ef0070d20 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0ef4a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef01654a0 con 0x7f0ef00cf960 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0eef200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0143c70 0x7f0ef0167510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0eef200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0143c70 0x7f0ef0167510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44194/0 (socket says 172.21.15.162:44194) 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0eef200640 1 -- 172.21.15.162:0/2003357250 learned_addr learned my addr 172.21.15.162:0/2003357250 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.638+0000 7f0eee800640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef0070d20 0x7f0ef0166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0ee7e00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef00cf960 0x7f0ef0164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0eef200640 1 -- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef00cf960 msgr2=0x7f0ef0164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0eef200640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef00cf960 0x7f0ef0164b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0eef200640 1 -- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef0070d20 msgr2=0x7f0ef0166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0eef200640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef0070d20 0x7f0ef0166260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0eef200640 1 -- 172.21.15.162:0/2003357250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80094d0 con 0x7f0ef0143c70 2024-01-20T11:08:42.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0eef200640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0143c70 0x7f0ef0167510 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800b970 tx=0x7f0ee800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:42.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2003357250 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800cb40 con 0x7f0ef0143c70 2024-01-20T11:08:42.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2003357250 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800ccc0 con 0x7f0ef0143c70 2024-01-20T11:08:42.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0165780 con 0x7f0ef0143c70 2024-01-20T11:08:42.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2003357250 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8014680 con 0x7f0ef0143c70 2024-01-20T11:08:42.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.639+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef012d740 con 0x7f0ef0143c70 2024-01-20T11:08:42.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.640+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef0074a30 con 0x7f0ef0143c70 2024-01-20T11:08:42.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.641+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2003357250 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0ee801d3b0 con 0x7f0ef0143c70 2024-01-20T11:08:42.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.642+0000 7f0ee6a00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:42.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.642+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2003357250 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee8089670 con 0x7f0ef0143c70 2024-01-20T11:08:42.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.643+0000 7f0eee800640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:42.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.643+0000 7f0eee800640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006fd0 tx=0x7f0ee0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:42.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.647+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2003357250 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0ee80544a0 con 0x7f0ef0143c70 2024-01-20T11:08:42.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.842+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef0165f80 con 0x7f0ef0143c70 2024-01-20T11:08:42.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.845+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2003357250 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16607 (secure 0 0 0) 0x7f0ef0165f80 con 0x7f0ef0143c70 2024-01-20T11:08:42.846 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:42.846 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":35,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:41.041915+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:08:38.930132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T11:08:40.039032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:42.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 msgr2=0x7f0ec806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006fd0 tx=0x7f0ee0008040 comp rx=0 tx=0).stop 2024-01-20T11:08:42.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0143c70 msgr2=0x7f0ef0167510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:42.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0143c70 0x7f0ef0167510 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800b970 tx=0x7f0ee800be30 comp rx=0 tx=0).stop 2024-01-20T11:08:42.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 shutdown_connections 2024-01-20T11:08:42.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef0143c70 0x7f0ef0167510 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef00cf960 0x7f0ef0164b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 --2- 172.21.15.162:0/2003357250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef0070d20 0x7f0ef0166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:42.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.848+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 >> 172.21.15.162:0/2003357250 conn(0x7f0ef006aa20 msgr2=0x7f0ef00aee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:42.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.849+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 shutdown_connections 2024-01-20T11:08:42.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:42.849+0000 7f0ef4a00640 1 -- 172.21.15.162:0/2003357250 wait complete. 2024-01-20T11:08:42.867 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-20T11:08:42.894 INFO:tasks.ceph.mds.c.smithi162.stderr:2024-01-20T11:08:42.894+0000 7f2604600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T11:08:43.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.067+0000 7fab15800640 1 Processor -- start 2024-01-20T11:08:43.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.068+0000 7fab15800640 1 -- start start 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab15800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d3200 0x7fab100cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab15800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab1015d720 0x7fab100d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab15800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100d22f0 con 0x7fab100d1000 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab15800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab100d3b20 con 0x7fab1015d720 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab15800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab100d1d30 con 0x7fab100d3200 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab0f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab1015d720 0x7fab100d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab0f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab1015d720 0x7fab100d35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44200/0 (socket says 172.21.15.162:44200) 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab0f400640 1 -- 172.21.15.162:0/2151475579 learned_addr learned my addr 172.21.15.162:0/2151475579 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab0fe00640 1 --2- 172.21.15.162:0/2151475579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d3200 0x7fab100cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:43.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab0f400640 1 -- 172.21.15.162:0/2151475579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d3200 msgr2=0x7fab100cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:43.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.069+0000 7fab0f400640 1 --2- 172.21.15.162:0/2151475579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d3200 0x7fab100cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.070+0000 7fab0f400640 1 -- 172.21.15.162:0/2151475579 >> v1:172.21.15.179:6789/0 conn(0x7fab100d1000 legacy=0x7fab100d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:43.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.070+0000 7fab0f400640 1 -- 172.21.15.162:0/2151475579 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100d2010 con 0x7fab1015d720 2024-01-20T11:08:43.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.071+0000 7fab0f400640 1 --2- 172.21.15.162:0/2151475579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab100d35e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faaf80098a0 tx=0x7faaf802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faebcfa0336cf96a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:43.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.071+0000 7fab0ea00640 1 -- 172.21.15.162:0/2151475579 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8031640 con 0x7fab1015d720 2024-01-20T11:08:43.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.071+0000 7fab0ea00640 1 -- 172.21.15.162:0/2151475579 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf80317a0 con 0x7fab1015d720 2024-01-20T11:08:43.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.071+0000 7fab0ea00640 1 -- 172.21.15.162:0/2151475579 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8031b30 con 0x7fab1015d720 2024-01-20T11:08:43.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.071+0000 7fab15800640 1 -- 172.21.15.162:0/2151475579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 msgr2=0x7fab100d35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:43.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.071+0000 7fab15800640 1 --2- 172.21.15.162:0/2151475579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab100d35e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faaf80098a0 tx=0x7faaf802b8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.072+0000 7fab15800640 1 -- 172.21.15.162:0/2151475579 shutdown_connections 2024-01-20T11:08:43.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.072+0000 7fab15800640 1 --2- 172.21.15.162:0/2151475579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab100d35e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.072+0000 7fab15800640 1 --2- 172.21.15.162:0/2151475579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d3200 0x7fab100cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.072+0000 7fab15800640 1 -- 172.21.15.162:0/2151475579 >> 172.21.15.162:0/2151475579 conn(0x7fab1008cc80 msgr2=0x7fab1009c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:43.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.072+0000 7fab15800640 1 -- 172.21.15.162:0/2151475579 shutdown_connections 2024-01-20T11:08:43.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.072+0000 7fab15800640 1 -- 172.21.15.162:0/2151475579 wait complete. 2024-01-20T11:08:43.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.073+0000 7fab15800640 1 Processor -- start 2024-01-20T11:08:43.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.073+0000 7fab15800640 1 -- start start 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.074+0000 7fab15800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d1000 0x7fab1015e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.074+0000 7fab15800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab100d3200 0x7fab100cff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.074+0000 7fab15800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab101f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.074+0000 7fab15800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100ceea0 con 0x7fab1015d720 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.074+0000 7fab15800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100cf180 con 0x7fab100d3200 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.074+0000 7fab15800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab100cf460 con 0x7fab100d1000 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab101f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab101f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44212/0 (socket says 172.21.15.162:44212) 2024-01-20T11:08:43.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 -- 172.21.15.162:0/3717210080 learned_addr learned my addr 172.21.15.162:0/3717210080 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:43.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab0fe00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d1000 0x7fab1015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:43.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab0f400640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab100d3200 0x7fab100cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:43.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 -- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d1000 msgr2=0x7fab1015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:43.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d1000 0x7fab1015e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 -- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab100d3200 msgr2=0x7fab100cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:43.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab100d3200 0x7fab100cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 -- 172.21.15.162:0/3717210080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80094d0 con 0x7fab1015d720 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab0fe00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d1000 0x7fab1015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab0f400640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab100d3200 0x7fab100cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.075+0000 7fab14e00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab101f40e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fab0800c780 tx=0x7fab0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.076+0000 7fab07e00640 1 -- 172.21.15.162:0/3717210080 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08003d80 con 0x7fab1015d720 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.076+0000 7fab07e00640 1 -- 172.21.15.162:0/3717210080 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0800ce90 con 0x7fab1015d720 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.076+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab100cf740 con 0x7fab1015d720 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.076+0000 7fab07e00640 1 -- 172.21.15.162:0/3717210080 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080052b0 con 0x7fab1015d720 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.076+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1015ea70 con 0x7fab1015d720 2024-01-20T11:08:43.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.077+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab100cfc60 con 0x7fab1015d720 2024-01-20T11:08:43.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.078+0000 7fab07e00640 1 -- 172.21.15.162:0/3717210080 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fab08005410 con 0x7fab1015d720 2024-01-20T11:08:43.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.079+0000 7fab07e00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7faae806aed0 0x7faae806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:43.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.079+0000 7fab07e00640 1 -- 172.21.15.162:0/3717210080 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab08088dd0 con 0x7fab1015d720 2024-01-20T11:08:43.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.079+0000 7fab0fe00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7faae806aed0 0x7faae806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:43.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.080+0000 7fab0fe00640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7faae806aed0 0x7faae806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fab00008890 tx=0x7fab00008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:43.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.083+0000 7fab07e00640 1 -- 172.21.15.162:0/3717210080 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fab100cfc60 con 0x7fab1015d720 2024-01-20T11:08:43.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.297+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fab100cfc60 con 0x7fab1015d720 2024-01-20T11:08:43.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.979+0000 7fab07e00640 1 -- 172.21.15.162:0/3717210080 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fab100cfc60 con 0x7fab1015d720 2024-01-20T11:08:43.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7faae806aed0 msgr2=0x7faae806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7faae806aed0 0x7faae806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fab00008890 tx=0x7fab00008040 comp rx=0 tx=0).stop 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 msgr2=0x7fab101f40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab101f40e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fab0800c780 tx=0x7fab0800cc40 comp rx=0 tx=0).stop 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 shutdown_connections 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab1015d720 0x7fab101f40e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7faae806aed0 0x7faae806d390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab100d3200 0x7fab100cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 --2- 172.21.15.162:0/3717210080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab100d1000 0x7fab1015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:43.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 >> 172.21.15.162:0/3717210080 conn(0x7fab1008cc80 msgr2=0x7fab1015b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:43.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 shutdown_connections 2024-01-20T11:08:43.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:43.983+0000 7fab15800640 1 -- 172.21.15.162:0/3717210080 wait complete. 2024-01-20T11:08:44.005 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T11:08:44.005 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-20T11:08:44.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.265+0000 7fb800a00640 1 Processor -- start 2024-01-20T11:08:44.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.266+0000 7fb800a00640 1 -- start start 2024-01-20T11:08:44.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.267+0000 7fb800a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7fc0d3200 0x7fb7fc0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:44.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.267+0000 7fb800a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7fc15d720 0x7fb7fc0d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.267+0000 7fb800a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d1000 0x7fb7fc0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.267+0000 7fb800a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc0d22f0 con 0x7fb7fc15d720 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.267+0000 7fb800a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc0d3b20 con 0x7fb7fc0d3200 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.267+0000 7fb800a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0d1d30 con 0x7fb7fc0d1000 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.267+0000 7fb7f3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7fc15d720 0x7fb7fc0d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.268+0000 7fb7f3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7fc15d720 0x7fb7fc0d35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44216/0 (socket says 172.21.15.162:44216) 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.268+0000 7fb7f3e00640 1 -- 172.21.15.162:0/1352887225 learned_addr learned my addr 172.21.15.162:0/1352887225 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.268+0000 7fb7f3e00640 1 -- 172.21.15.162:0/1352887225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d1000 msgr2=0x7fb7fc0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.268+0000 7fb7f3e00640 1 --2- 172.21.15.162:0/1352887225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d1000 0x7fb7fc0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.268+0000 7fb7f3e00640 1 -- 172.21.15.162:0/1352887225 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc0d3200 msgr2=0x7fb7fc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.268+0000 7fb7f3e00640 1 --2- 172.21.15.162:0/1352887225 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc0d3200 0x7fb7fc0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.268+0000 7fb7f3e00640 1 -- 172.21.15.162:0/1352887225 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0d2010 con 0x7fb7fc15d720 2024-01-20T11:08:44.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.269+0000 7fb7f3e00640 1 --2- 172.21.15.162:0/1352887225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc15d720 0x7fb7fc0d35e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0d3ec0 tx=0x7fb7e402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a333d81bb4953f0b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:44.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.269+0000 7fb7f9e00640 1 -- 172.21.15.162:0/1352887225 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4031860 con 0x7fb7fc15d720 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.269+0000 7fb7f9e00640 1 -- 172.21.15.162:0/1352887225 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e40319c0 con 0x7fb7fc15d720 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.269+0000 7fb7f9e00640 1 -- 172.21.15.162:0/1352887225 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4031d50 con 0x7fb7fc15d720 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 -- 172.21.15.162:0/1352887225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc15d720 msgr2=0x7fb7fc0d35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 --2- 172.21.15.162:0/1352887225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc15d720 0x7fb7fc0d35e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0d3ec0 tx=0x7fb7e402b900 comp rx=0 tx=0).stop 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 -- 172.21.15.162:0/1352887225 shutdown_connections 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 --2- 172.21.15.162:0/1352887225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d1000 0x7fb7fc0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 --2- 172.21.15.162:0/1352887225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc15d720 0x7fb7fc0d35e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 --2- 172.21.15.162:0/1352887225 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc0d3200 0x7fb7fc0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 -- 172.21.15.162:0/1352887225 >> 172.21.15.162:0/1352887225 conn(0x7fb7fc08cc80 msgr2=0x7fb7fc09c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 -- 172.21.15.162:0/1352887225 shutdown_connections 2024-01-20T11:08:44.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.270+0000 7fb800a00640 1 -- 172.21.15.162:0/1352887225 wait complete. 2024-01-20T11:08:44.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.272+0000 7fb800a00640 1 Processor -- start 2024-01-20T11:08:44.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.272+0000 7fb800a00640 1 -- start start 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb800a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc0d1000 0x7fb7fc0b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb800a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d3200 0x7fb7fc15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb800a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc154700 0x7fb7fc15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb800a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc160a60 con 0x7fb7fc0d1000 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb800a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc15f0e0 con 0x7fb7fc154700 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb800a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b6da0 con 0x7fb7fc0d3200 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc0d1000 0x7fb7fc0b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc0d1000 0x7fb7fc0b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44220/0 (socket says 172.21.15.162:44220) 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 -- 172.21.15.162:0/537798969 learned_addr learned my addr 172.21.15.162:0/537798969 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:44.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 -- 172.21.15.162:0/537798969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d3200 msgr2=0x7fb7fc15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:44.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7f3e00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d3200 0x7fb7fc15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:44.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d3200 0x7fb7fc15eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 -- 172.21.15.162:0/537798969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc154700 msgr2=0x7fb7fc15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:44.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc154700 0x7fb7fc15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.273+0000 7fb7fa800640 1 -- 172.21.15.162:0/537798969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e40094d0 con 0x7fb7fc0d1000 2024-01-20T11:08:44.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.274+0000 7fb7fa800640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc0d1000 0x7fb7fc0b67b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00b410 tx=0x7fb7ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:44.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.274+0000 7fb7f2a00640 1 -- 172.21.15.162:0/537798969 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec011830 con 0x7fb7fc0d1000 2024-01-20T11:08:44.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.274+0000 7fb7f2a00640 1 -- 172.21.15.162:0/537798969 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0119b0 con 0x7fb7fc0d1000 2024-01-20T11:08:44.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.274+0000 7fb7f2a00640 1 -- 172.21.15.162:0/537798969 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec011d60 con 0x7fb7fc0d1000 2024-01-20T11:08:44.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.274+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc0b7080 con 0x7fb7fc0d1000 2024-01-20T11:08:44.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.274+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc0b7640 con 0x7fb7fc0d1000 2024-01-20T11:08:44.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.275+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc074a30 con 0x7fb7fc0d1000 2024-01-20T11:08:44.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.276+0000 7fb7f2a00640 1 -- 172.21.15.162:0/537798969 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb7ec01a400 con 0x7fb7fc0d1000 2024-01-20T11:08:44.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.277+0000 7fb7f2a00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb7d406aed0 0x7fb7d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:44.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.277+0000 7fb7f2a00640 1 -- 172.21.15.162:0/537798969 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7ec089820 con 0x7fb7fc0d1000 2024-01-20T11:08:44.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.277+0000 7fb7f3e00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb7d406aed0 0x7fb7d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:44.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.278+0000 7fb7f3e00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb7d406aed0 0x7fb7d406d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4036000 tx=0x7fb7e403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:44.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.282+0000 7fb7f2a00640 1 -- 172.21.15.162:0/537798969 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb7ec054650 con 0x7fb7fc0d1000 2024-01-20T11:08:44.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.513+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7fc0d4180 con 0x7fb7fc0d1000 2024-01-20T11:08:44.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.990+0000 7fb7f2a00640 1 -- 172.21.15.162:0/537798969 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb7ec0150c0 con 0x7fb7fc0d1000 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb7d406aed0 msgr2=0x7fb7d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb7d406aed0 0x7fb7d406d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4036000 tx=0x7fb7e403c040 comp rx=0 tx=0).stop 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc0d1000 msgr2=0x7fb7fc0b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc0d1000 0x7fb7fc0b67b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00b410 tx=0x7fb7ec00b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 shutdown_connections 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb7d406aed0 0x7fb7d406d390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc154700 0x7fb7fc15fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0d3200 0x7fb7fc15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 --2- 172.21.15.162:0/537798969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7fc0d1000 0x7fb7fc0b67b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:44.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.994+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 >> 172.21.15.162:0/537798969 conn(0x7fb7fc08cc80 msgr2=0x7fb7fc06c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:44.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.995+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 shutdown_connections 2024-01-20T11:08:44.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:44.995+0000 7fb800a00640 1 -- 172.21.15.162:0/537798969 wait complete. 2024-01-20T11:08:45.017 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-20T11:08:45.017 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:45.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.227+0000 7fc083600640 1 Processor -- start 2024-01-20T11:08:45.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.227+0000 7fc083600640 1 -- start start 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.229+0000 7fc083600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc07c15a530 0x7fc07c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.229+0000 7fc083600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.229+0000 7fc083600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c15a910 con 0x7fc07c071260 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.229+0000 7fc083600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c0ca390 con 0x7fc07c15a530 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.229+0000 7fc083600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c072960 con 0x7fc07c06deb0 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc080c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc07c15a530 0x7fc07c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc080c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc07c15a530 0x7fc07c0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44236/0 (socket says 172.21.15.162:44236) 2024-01-20T11:08:45.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc080c00640 1 -- 172.21.15.162:0/3044202967 learned_addr learned my addr 172.21.15.162:0/3044202967 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:45.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc080c00640 1 -- 172.21.15.162:0/3044202967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 msgr2=0x7fc07c0716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:45.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc081600640 1 --2- 172.21.15.162:0/3044202967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc080c00640 1 --2- 172.21.15.162:0/3044202967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c0716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc080c00640 1 -- 172.21.15.162:0/3044202967 >> v1:172.21.15.179:6789/0 conn(0x7fc07c071260 legacy=0x7fc07c06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:45.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.230+0000 7fc080c00640 1 -- 172.21.15.162:0/3044202967 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0ce730 con 0x7fc07c15a530 2024-01-20T11:08:45.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.231+0000 7fc080c00640 1 --2- 172.21.15.162:0/3044202967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c0cddb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0098a0 tx=0x7fc06c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb94de4966f80f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:45.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.231+0000 7fc07be00640 1 -- 172.21.15.162:0/3044202967 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0317c0 con 0x7fc07c15a530 2024-01-20T11:08:45.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.231+0000 7fc07be00640 1 -- 172.21.15.162:0/3044202967 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c031920 con 0x7fc07c15a530 2024-01-20T11:08:45.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.231+0000 7fc07be00640 1 -- 172.21.15.162:0/3044202967 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c031cb0 con 0x7fc07c15a530 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 -- 172.21.15.162:0/3044202967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 msgr2=0x7fc07c0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 --2- 172.21.15.162:0/3044202967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c0cddb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0098a0 tx=0x7fc06c02b860 comp rx=0 tx=0).stop 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 -- 172.21.15.162:0/3044202967 shutdown_connections 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 --2- 172.21.15.162:0/3044202967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c0716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 --2- 172.21.15.162:0/3044202967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c0cddb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 -- 172.21.15.162:0/3044202967 >> 172.21.15.162:0/3044202967 conn(0x7fc07c0b0cd0 msgr2=0x7fc07c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 -- 172.21.15.162:0/3044202967 shutdown_connections 2024-01-20T11:08:45.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.232+0000 7fc083600640 1 -- 172.21.15.162:0/3044202967 wait complete. 2024-01-20T11:08:45.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.234+0000 7fc083600640 1 Processor -- start 2024-01-20T11:08:45.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.234+0000 7fc083600640 1 -- start start 2024-01-20T11:08:45.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc083600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c14ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc083600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc07c071260 0x7fc07c09be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc083600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc083600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c14b060 con 0x7fc07c15a530 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc083600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c15af80 con 0x7fc07c071260 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc083600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c15b260 con 0x7fc07c06deb0 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc081600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc081600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44248/0 (socket says 172.21.15.162:44248) 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.235+0000 7fc081600640 1 -- 172.21.15.162:0/3521545128 learned_addr learned my addr 172.21.15.162:0/3521545128 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc080c00640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c14ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc073e00640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc07c071260 0x7fc07c09be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc081600640 1 -- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 msgr2=0x7fc07c14ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc081600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c14ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc081600640 1 -- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc07c071260 msgr2=0x7fc07c09be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc081600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc07c071260 0x7fc07c09be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc081600640 1 -- 172.21.15.162:0/3521545128 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0094d0 con 0x7fc07c15a530 2024-01-20T11:08:45.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc081600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c15c020 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc07400cd20 tx=0x7fc07400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:45.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.236+0000 7fc079600640 1 -- 172.21.15.162:0/3521545128 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074003b90 con 0x7fc07c15a530 2024-01-20T11:08:45.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.237+0000 7fc079600640 1 -- 172.21.15.162:0/3521545128 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074003cf0 con 0x7fc07c15a530 2024-01-20T11:08:45.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.237+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c15b540 con 0x7fc07c15a530 2024-01-20T11:08:45.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.237+0000 7fc079600640 1 -- 172.21.15.162:0/3521545128 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074004240 con 0x7fc07c15a530 2024-01-20T11:08:45.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.237+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c15bb00 con 0x7fc07c15a530 2024-01-20T11:08:45.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.238+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c15bd20 con 0x7fc07c15a530 2024-01-20T11:08:45.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.239+0000 7fc079600640 1 -- 172.21.15.162:0/3521545128 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc0740043a0 con 0x7fc07c15a530 2024-01-20T11:08:45.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.239+0000 7fc079600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05406af00 0x7fc05406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.240+0000 7fc079600640 1 -- 172.21.15.162:0/3521545128 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc074012070 con 0x7fc07c15a530 2024-01-20T11:08:45.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.240+0000 7fc080c00640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05406af00 0x7fc05406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.241+0000 7fc080c00640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05406af00 0x7fc05406d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc06c036000 tx=0x7fc06c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:45.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.244+0000 7fc079600640 1 -- 172.21.15.162:0/3521545128 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc074054eb0 con 0x7fc07c15a530 2024-01-20T11:08:45.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.470+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc07c04e970 con 0x7fc07c15a530 2024-01-20T11:08:45.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.471+0000 7fc079600640 1 -- 172.21.15.162:0/3521545128 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fc0740584d0 con 0x7fc07c15a530 2024-01-20T11:08:45.472 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:45.472 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:08:45.472 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:08:45.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05406af00 msgr2=0x7fc05406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05406af00 0x7fc05406d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc06c036000 tx=0x7fc06c03d040 comp rx=0 tx=0).stop 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 msgr2=0x7fc07c15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c15c020 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc07400cd20 tx=0x7fc07400a660 comp rx=0 tx=0).stop 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 shutdown_connections 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc07c15a530 0x7fc07c15c020 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05406af00 0x7fc05406d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc07c071260 0x7fc07c09be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 --2- 172.21.15.162:0/3521545128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc07c06deb0 0x7fc07c14ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 >> 172.21.15.162:0/3521545128 conn(0x7fc07c0b0cd0 msgr2=0x7fc07c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 shutdown_connections 2024-01-20T11:08:45.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.474+0000 7fc083600640 1 -- 172.21.15.162:0/3521545128 wait complete. 2024-01-20T11:08:45.492 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:08:45.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.687+0000 7f4d83200640 1 Processor -- start 2024-01-20T11:08:45.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.687+0000 7f4d83200640 1 -- start start 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.688+0000 7f4d83200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d7c13e040 0x7f4d7c0cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.688+0000 7f4d83200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c0cd9c0 0x7f4d7c0cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.688+0000 7f4d83200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0cc570 con 0x7f4d7c0cb9d0 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.688+0000 7f4d83200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c15fe00 con 0x7f4d7c13e040 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.688+0000 7f4d83200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c15b910 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d7c13e040 0x7f4d7c0cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d7c13e040 0x7f4d7c0cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44260/0 (socket says 172.21.15.162:44260) 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81e00640 1 -- 172.21.15.162:0/3916740476 learned_addr learned my addr 172.21.15.162:0/3916740476 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81400640 1 --2- 172.21.15.162:0/3916740476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c0cd9c0 0x7f4d7c0cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81e00640 1 -- 172.21.15.162:0/3916740476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c0cd9c0 msgr2=0x7f4d7c0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81e00640 1 --2- 172.21.15.162:0/3916740476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c0cd9c0 0x7f4d7c0cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81e00640 1 -- 172.21.15.162:0/3916740476 >> v1:172.21.15.179:6789/0 conn(0x7f4d7c0cb9d0 legacy=0x7f4d7c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:45.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81e00640 1 -- 172.21.15.162:0/3916740476 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c15bbf0 con 0x7f4d7c13e040 2024-01-20T11:08:45.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.689+0000 7f4d81400640 1 --2- 172.21.15.162:0/3916740476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c0cd9c0 0x7f4d7c0cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:45.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.691+0000 7f4d81e00640 1 --2- 172.21.15.162:0/3916740476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c13e040 0x7f4d7c0cf370 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009870 tx=0x7f4d6c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341a5e398dd761dd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:45.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.691+0000 7f4d80a00640 1 -- 172.21.15.162:0/3916740476 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0317c0 con 0x7f4d7c13e040 2024-01-20T11:08:45.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.691+0000 7f4d80a00640 1 -- 172.21.15.162:0/3916740476 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c031920 con 0x7f4d7c13e040 2024-01-20T11:08:45.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.691+0000 7f4d80a00640 1 -- 172.21.15.162:0/3916740476 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c031cb0 con 0x7f4d7c13e040 2024-01-20T11:08:45.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 -- 172.21.15.162:0/3916740476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c13e040 msgr2=0x7f4d7c0cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 --2- 172.21.15.162:0/3916740476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c13e040 0x7f4d7c0cf370 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009870 tx=0x7f4d6c02b860 comp rx=0 tx=0).stop 2024-01-20T11:08:45.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 -- 172.21.15.162:0/3916740476 shutdown_connections 2024-01-20T11:08:45.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 --2- 172.21.15.162:0/3916740476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c0cd9c0 0x7f4d7c0cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 --2- 172.21.15.162:0/3916740476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c13e040 0x7f4d7c0cf370 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 -- 172.21.15.162:0/3916740476 >> 172.21.15.162:0/3916740476 conn(0x7f4d7c06aa20 msgr2=0x7f4d7c06ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:45.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 -- 172.21.15.162:0/3916740476 shutdown_connections 2024-01-20T11:08:45.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.692+0000 7f4d83200640 1 -- 172.21.15.162:0/3916740476 wait complete. 2024-01-20T11:08:45.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.694+0000 7f4d83200640 1 Processor -- start 2024-01-20T11:08:45.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.694+0000 7f4d83200640 1 -- start start 2024-01-20T11:08:45.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d83200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d7c0cb9d0 0x7f4d7c0adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d83200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c0cd9c0 0x7f4d7c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d83200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c13e040 0x7f4d7c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d83200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0adfe0 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d83200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c141400 con 0x7f4d7c0cb9d0 2024-01-20T11:08:45.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d83200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0703b0 con 0x7f4d7c13e040 2024-01-20T11:08:45.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d81400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c0cd9c0 0x7f4d7c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d81400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c0cd9c0 0x7f4d7c15a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44276/0 (socket says 172.21.15.162:44276) 2024-01-20T11:08:45.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.695+0000 7f4d81400640 1 -- 172.21.15.162:0/2647036999 learned_addr learned my addr 172.21.15.162:0/2647036999 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:45.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d81e00640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d7c0cb9d0 0x7f4d7c0adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d82800640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c13e040 0x7f4d7c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d81400640 1 -- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c13e040 msgr2=0x7f4d7c15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d81400640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c13e040 0x7f4d7c15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d81400640 1 -- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d7c0cb9d0 msgr2=0x7f4d7c0adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d81400640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d7c0cb9d0 0x7f4d7c0adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d81400640 1 -- 172.21.15.162:0/2647036999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0094d0 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d81400640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c0cd9c0 0x7f4d7c15a2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c7f0 tx=0x7f4d6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.696+0000 7f4d7a000640 1 -- 172.21.15.162:0/2647036999 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007820 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.697+0000 7f4d7a000640 1 -- 172.21.15.162:0/2647036999 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64007980 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.697+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c070690 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.697+0000 7f4d7a000640 1 -- 172.21.15.162:0/2647036999 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007cf0 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.697+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c1416e0 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.698+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c074a30 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.699+0000 7f4d7a000640 1 -- 172.21.15.162:0/2647036999 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4d64024480 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.700+0000 7f4d7a000640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d5406aed0 0x7f4d5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:45.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.700+0000 7f4d7a000640 1 -- 172.21.15.162:0/2647036999 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d64089e90 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.700+0000 7f4d81e00640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d5406aed0 0x7f4d5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:45.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.701+0000 7f4d81e00640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d5406aed0 0x7f4d5406d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c036000 tx=0x7f4d6c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:45.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.704+0000 7f4d7a000640 1 -- 172.21.15.162:0/2647036999 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4d64054d40 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.889+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d7c0ccab0 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.892+0000 7f4d7a000640 1 -- 172.21.15.162:0/2647036999 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f4d6401f090 con 0x7f4d7c0cd9c0 2024-01-20T11:08:45.893 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:45.894 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":36,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:42.965160+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:08:38.930132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T11:08:40.039032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:08:45.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d5406aed0 msgr2=0x7f4d5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d5406aed0 0x7f4d5406d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c036000 tx=0x7f4d6c03d040 comp rx=0 tx=0).stop 2024-01-20T11:08:45.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c0cd9c0 msgr2=0x7f4d7c15a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:45.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c0cd9c0 0x7f4d7c15a2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c7f0 tx=0x7f4d6400ccb0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 shutdown_connections 2024-01-20T11:08:45.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d7c13e040 0x7f4d7c15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d7c0cd9c0 0x7f4d7c15a2d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4d5406aed0 0x7f4d5406d390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 --2- 172.21.15.162:0/2647036999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d7c0cb9d0 0x7f4d7c0adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:45.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 >> 172.21.15.162:0/2647036999 conn(0x7f4d7c06aa20 msgr2=0x7f4d7c0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:45.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 shutdown_connections 2024-01-20T11:08:45.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:45.895+0000 7f4d83200640 1 -- 172.21.15.162:0/2647036999 wait complete. 2024-01-20T11:08:45.913 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T11:08:45.913 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:08:46.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.116+0000 7f33c9200640 1 Processor -- start 2024-01-20T11:08:46.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.116+0000 7f33c9200640 1 -- start start 2024-01-20T11:08:46.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33c9200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f33c4070630 0x7f33c40adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33c9200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f33c415c6e0 0x7f33c40ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33c9200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c4070b60 con 0x7f33c4155a30 2024-01-20T11:08:46.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33c9200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c415ba10 con 0x7f33c4070630 2024-01-20T11:08:46.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33c9200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c415bc00 con 0x7f33c415c6e0 2024-01-20T11:08:46.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33c1e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f33c4155a30 0x7f33c40ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49252/0 (socket says 172.21.15.162:49252) 2024-01-20T11:08:46.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33c1e00640 1 -- 172.21.15.162:0/3289441393 learned_addr learned my addr 172.21.15.162:0/3289441393 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:46.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.118+0000 7f33bbe00640 1 --2- 172.21.15.162:0/3289441393 >> v2:172.21.15.162:3300/0 conn(0x7f33c4070630 0x7f33c40adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.119+0000 7f33bbe00640 1 -- 172.21.15.162:0/3289441393 >> v2:172.21.15.179:3300/0 conn(0x7f33c415c6e0 msgr2=0x7f33c40ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:46.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.119+0000 7f33bbe00640 1 --2- 172.21.15.162:0/3289441393 >> v2:172.21.15.179:3300/0 conn(0x7f33c415c6e0 0x7f33c40ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.119+0000 7f33bbe00640 1 -- 172.21.15.162:0/3289441393 >> v1:172.21.15.162:6789/0 conn(0x7f33c4155a30 legacy=0x7f33c40ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.119+0000 7f33bbe00640 1 -- 172.21.15.162:0/3289441393 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c415bee0 con 0x7f33c4070630 2024-01-20T11:08:46.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.120+0000 7f33bbe00640 1 --2- 172.21.15.162:0/3289441393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4070630 0x7f33c40adfa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f33c4071ba0 tx=0x7f33ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cb056a7875be74 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:46.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.120+0000 7f33c1400640 1 -- 172.21.15.162:0/3289441393 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac031830 con 0x7f33c4070630 2024-01-20T11:08:46.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.120+0000 7f33c1400640 1 -- 172.21.15.162:0/3289441393 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac031990 con 0x7f33c4070630 2024-01-20T11:08:46.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.120+0000 7f33c1400640 1 -- 172.21.15.162:0/3289441393 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac031d20 con 0x7f33c4070630 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.120+0000 7f33c9200640 1 -- 172.21.15.162:0/3289441393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4070630 msgr2=0x7f33c40adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.120+0000 7f33c9200640 1 --2- 172.21.15.162:0/3289441393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4070630 0x7f33c40adfa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f33c4071ba0 tx=0x7f33ac02b8d0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.121+0000 7f33c9200640 1 -- 172.21.15.162:0/3289441393 shutdown_connections 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.121+0000 7f33c9200640 1 --2- 172.21.15.162:0/3289441393 >> v2:172.21.15.179:3300/0 conn(0x7f33c415c6e0 0x7f33c40ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.121+0000 7f33c9200640 1 --2- 172.21.15.162:0/3289441393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4070630 0x7f33c40adfa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.121+0000 7f33c9200640 1 -- 172.21.15.162:0/3289441393 >> 172.21.15.162:0/3289441393 conn(0x7f33c40b0cd0 msgr2=0x7f33c40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.121+0000 7f33c9200640 1 -- 172.21.15.162:0/3289441393 shutdown_connections 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.121+0000 7f33c9200640 1 -- 172.21.15.162:0/3289441393 wait complete. 2024-01-20T11:08:46.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.122+0000 7f33c9200640 1 Processor -- start 2024-01-20T11:08:46.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.122+0000 7f33c9200640 1 -- start start 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.123+0000 7f33c9200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33c4070630 0x7f33c41f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.123+0000 7f33c9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4155a30 0x7f33c4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.123+0000 7f33c9200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33c415c6e0 0x7f33c409c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.123+0000 7f33c9200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c41f3180 con 0x7f33c4155a30 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.123+0000 7f33c9200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4152160 con 0x7f33c415c6e0 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.123+0000 7f33c9200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c41f2570 con 0x7f33c4070630 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.123+0000 7f33bbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4155a30 0x7f33c4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4155a30 0x7f33c4151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44306/0 (socket says 172.21.15.162:44306) 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 -- 172.21.15.162:0/618014391 learned_addr learned my addr 172.21.15.162:0/618014391 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 -- 172.21.15.162:0/618014391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33c4070630 msgr2=0x7f33c41f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33c4070630 0x7f33c41f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 -- 172.21.15.162:0/618014391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33c415c6e0 msgr2=0x7f33c409c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33c415c6e0 0x7f33c409c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 -- 172.21.15.162:0/618014391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac009400 con 0x7f33c4155a30 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33bbe00640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4155a30 0x7f33c4151c20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009890 tx=0x7f33ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33ba000640 1 -- 172.21.15.162:0/618014391 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac03ba70 con 0x7f33c4155a30 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33ba000640 1 -- 172.21.15.162:0/618014391 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac03bbd0 con 0x7f33c4155a30 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.124+0000 7f33ba000640 1 -- 172.21.15.162:0/618014391 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0453f0 con 0x7f33c4155a30 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.125+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c4155f90 con 0x7f33c4155a30 2024-01-20T11:08:46.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.125+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c41f2b30 con 0x7f33c4155a30 2024-01-20T11:08:46.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.126+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c404e970 con 0x7f33c4155a30 2024-01-20T11:08:46.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.126+0000 7f33ba000640 1 -- 172.21.15.162:0/618014391 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f33ac045550 con 0x7f33c4155a30 2024-01-20T11:08:46.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.128+0000 7f33ba000640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f339c06af00 0x7f339c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.128+0000 7f33ba000640 1 -- 172.21.15.162:0/618014391 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33ac0ab950 con 0x7f33c4155a30 2024-01-20T11:08:46.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.128+0000 7f33c1e00640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f339c06af00 0x7f339c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.128+0000 7f33c1e00640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f339c06af00 0x7f339c06d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33b4000f60 tx=0x7f33b4007a80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:46.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.132+0000 7f33ba000640 1 -- 172.21.15.162:0/618014391 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f33ac076780 con 0x7f33c4155a30 2024-01-20T11:08:46.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.305+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33c4070e40 con 0x7f339c06af00 2024-01-20T11:08:46.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.316+0000 7f33ba000640 1 -- 172.21.15.162:0/618014391 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286713 (secure 0 0 0) 0x7f33b40058b0 con 0x7f339c06af00 2024-01-20T11:08:46.320 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:46.322 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f339c06af00 msgr2=0x7f339c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f339c06af00 0x7f339c06d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33b4000f60 tx=0x7f33b4007a80 comp rx=0 tx=0).stop 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4155a30 msgr2=0x7f33c4151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4155a30 0x7f33c4151c20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009890 tx=0x7f33ac0046c0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 shutdown_connections 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f339c06af00 0x7f339c06d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33c415c6e0 0x7f33c409c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c4155a30 0x7f33c4151c20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 --2- 172.21.15.162:0/618014391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33c4070630 0x7f33c41f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 >> 172.21.15.162:0/618014391 conn(0x7f33c40b0cd0 msgr2=0x7f33c40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 shutdown_connections 2024-01-20T11:08:46.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.323+0000 7f33c9200640 1 -- 172.21.15.162:0/618014391 wait complete. 2024-01-20T11:08:46.340 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-01-20T11:08:45.603109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220588,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754132,"statfs":{"total":773094113280,"available":772868231168,"internally_reserved":0,"allocated":4497408,"data_stored":2463356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001567"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583265+0000","last_change":"2024-01-20T11:08:41.989816+0000","last_active":"2024-01-20T11:08:43.583265+0000","last_peered":"2024-01-20T11:08:43.583265+0000","last_clean":"2024-01-20T11:08:43.583265+0000","last_became_active":"2024-01-20T11:08:41.989587+0000","last_became_peered":"2024-01-20T11:08:41.989587+0000","last_unstale":"2024-01-20T11:08:43.583265+0000","last_undegraded":"2024-01-20T11:08:43.583265+0000","last_fullsized":"2024-01-20T11:08:43.583265+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:06:05.559719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583135+0000","last_change":"2024-01-20T11:08:41.992696+0000","last_active":"2024-01-20T11:08:43.583135+0000","last_peered":"2024-01-20T11:08:43.583135+0000","last_clean":"2024-01-20T11:08:43.583135+0000","last_became_active":"2024-01-20T11:08:41.991982+0000","last_became_peered":"2024-01-20T11:08:41.991982+0000","last_unstale":"2024-01-20T11:08:43.583135+0000","last_undegraded":"2024-01-20T11:08:43.583135+0000","last_fullsized":"2024-01-20T11:08:43.583135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:10:47.923238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978295+0000","last_change":"2024-01-20T11:08:41.995812+0000","last_active":"2024-01-20T11:08:42.978295+0000","last_peered":"2024-01-20T11:08:42.978295+0000","last_clean":"2024-01-20T11:08:42.978295+0000","last_became_active":"2024-01-20T11:08:41.995593+0000","last_became_peered":"2024-01-20T11:08:41.995593+0000","last_unstale":"2024-01-20T11:08:42.978295+0000","last_undegraded":"2024-01-20T11:08:42.978295+0000","last_fullsized":"2024-01-20T11:08:42.978295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:50.537772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.586293+0000","last_change":"2024-01-20T11:08:41.981781+0000","last_active":"2024-01-20T11:08:43.586293+0000","last_peered":"2024-01-20T11:08:43.586293+0000","last_clean":"2024-01-20T11:08:43.586293+0000","last_became_active":"2024-01-20T11:08:41.981494+0000","last_became_peered":"2024-01-20T11:08:41.981494+0000","last_unstale":"2024-01-20T11:08:43.586293+0000","last_undegraded":"2024-01-20T11:08:43.586293+0000","last_fullsized":"2024-01-20T11:08:43.586293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:50:32.248265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583612+0000","last_change":"2024-01-20T11:08:41.999595+0000","last_active":"2024-01-20T11:08:43.583612+0000","last_peered":"2024-01-20T11:08:43.583612+0000","last_clean":"2024-01-20T11:08:43.583612+0000","last_became_active":"2024-01-20T11:08:41.999353+0000","last_became_peered":"2024-01-20T11:08:41.999353+0000","last_unstale":"2024-01-20T11:08:43.583612+0000","last_undegraded":"2024-01-20T11:08:43.583612+0000","last_fullsized":"2024-01-20T11:08:43.583612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:22.038815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582587+0000","last_change":"2024-01-20T11:08:41.993444+0000","last_active":"2024-01-20T11:08:43.582587+0000","last_peered":"2024-01-20T11:08:43.582587+0000","last_clean":"2024-01-20T11:08:43.582587+0000","last_became_active":"2024-01-20T11:08:41.991639+0000","last_became_peered":"2024-01-20T11:08:41.991639+0000","last_unstale":"2024-01-20T11:08:43.582587+0000","last_undegraded":"2024-01-20T11:08:43.582587+0000","last_fullsized":"2024-01-20T11:08:43.582587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:56:45.487833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976661+0000","last_change":"2024-01-20T11:08:41.982135+0000","last_active":"2024-01-20T11:08:42.976661+0000","last_peered":"2024-01-20T11:08:42.976661+0000","last_clean":"2024-01-20T11:08:42.976661+0000","last_became_active":"2024-01-20T11:08:41.981842+0000","last_became_peered":"2024-01-20T11:08:41.981842+0000","last_unstale":"2024-01-20T11:08:42.976661+0000","last_undegraded":"2024-01-20T11:08:42.976661+0000","last_fullsized":"2024-01-20T11:08:42.976661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:56:45.487833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976141+0000","last_change":"2024-01-20T11:08:41.983061+0000","last_active":"2024-01-20T11:08:42.976141+0000","last_peered":"2024-01-20T11:08:42.976141+0000","last_clean":"2024-01-20T11:08:42.976141+0000","last_became_active":"2024-01-20T11:08:41.982770+0000","last_became_peered":"2024-01-20T11:08:41.982770+0000","last_unstale":"2024-01-20T11:08:42.976141+0000","last_undegraded":"2024-01-20T11:08:42.976141+0000","last_fullsized":"2024-01-20T11:08:42.976141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:30:45.424657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582904+0000","last_change":"2024-01-20T11:08:41.991154+0000","last_active":"2024-01-20T11:08:43.582904+0000","last_peered":"2024-01-20T11:08:43.582904+0000","last_clean":"2024-01-20T11:08:43.582904+0000","last_became_active":"2024-01-20T11:08:41.990859+0000","last_became_peered":"2024-01-20T11:08:41.990859+0000","last_unstale":"2024-01-20T11:08:43.582904+0000","last_undegraded":"2024-01-20T11:08:43.582904+0000","last_fullsized":"2024-01-20T11:08:43.582904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:46:23.271209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.585169+0000","last_change":"2024-01-20T11:08:42.001509+0000","last_active":"2024-01-20T11:08:43.585169+0000","last_peered":"2024-01-20T11:08:43.585169+0000","last_clean":"2024-01-20T11:08:43.585169+0000","last_became_active":"2024-01-20T11:08:42.000647+0000","last_became_peered":"2024-01-20T11:08:42.000647+0000","last_unstale":"2024-01-20T11:08:43.585169+0000","last_undegraded":"2024-01-20T11:08:43.585169+0000","last_fullsized":"2024-01-20T11:08:43.585169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:46:23.271209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977079+0000","last_change":"2024-01-20T11:08:41.996624+0000","last_active":"2024-01-20T11:08:42.977079+0000","last_peered":"2024-01-20T11:08:42.977079+0000","last_clean":"2024-01-20T11:08:42.977079+0000","last_became_active":"2024-01-20T11:08:41.996312+0000","last_became_peered":"2024-01-20T11:08:41.996312+0000","last_unstale":"2024-01-20T11:08:42.977079+0000","last_undegraded":"2024-01-20T11:08:42.977079+0000","last_fullsized":"2024-01-20T11:08:42.977079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:10:47.923238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978062+0000","last_change":"2024-01-20T11:08:42.000132+0000","last_active":"2024-01-20T11:08:42.978062+0000","last_peered":"2024-01-20T11:08:42.978062+0000","last_clean":"2024-01-20T11:08:42.978062+0000","last_became_active":"2024-01-20T11:08:41.999824+0000","last_became_peered":"2024-01-20T11:08:41.999824+0000","last_unstale":"2024-01-20T11:08:42.978062+0000","last_undegraded":"2024-01-20T11:08:42.978062+0000","last_fullsized":"2024-01-20T11:08:42.978062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:10:47.923238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583515+0000","last_change":"2024-01-20T11:08:41.990047+0000","last_active":"2024-01-20T11:08:43.583515+0000","last_peered":"2024-01-20T11:08:43.583515+0000","last_clean":"2024-01-20T11:08:43.583515+0000","last_became_active":"2024-01-20T11:08:41.989757+0000","last_became_peered":"2024-01-20T11:08:41.989757+0000","last_unstale":"2024-01-20T11:08:43.583515+0000","last_undegraded":"2024-01-20T11:08:43.583515+0000","last_fullsized":"2024-01-20T11:08:43.583515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:28.624552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582897+0000","last_change":"2024-01-20T11:08:41.992963+0000","last_active":"2024-01-20T11:08:43.582897+0000","last_peered":"2024-01-20T11:08:43.582897+0000","last_clean":"2024-01-20T11:08:43.582897+0000","last_became_active":"2024-01-20T11:08:41.992222+0000","last_became_peered":"2024-01-20T11:08:41.992222+0000","last_unstale":"2024-01-20T11:08:43.582897+0000","last_undegraded":"2024-01-20T11:08:43.582897+0000","last_fullsized":"2024-01-20T11:08:43.582897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:00:58.308363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977010+0000","last_change":"2024-01-20T11:08:41.979476+0000","last_active":"2024-01-20T11:08:42.977010+0000","last_peered":"2024-01-20T11:08:42.977010+0000","last_clean":"2024-01-20T11:08:42.977010+0000","last_became_active":"2024-01-20T11:08:41.977977+0000","last_became_peered":"2024-01-20T11:08:41.977977+0000","last_unstale":"2024-01-20T11:08:42.977010+0000","last_undegraded":"2024-01-20T11:08:42.977010+0000","last_fullsized":"2024-01-20T11:08:42.977010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:15.815638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977004+0000","last_change":"2024-01-20T11:08:41.992387+0000","last_active":"2024-01-20T11:08:42.977004+0000","last_peered":"2024-01-20T11:08:42.977004+0000","last_clean":"2024-01-20T11:08:42.977004+0000","last_became_active":"2024-01-20T11:08:41.992123+0000","last_became_peered":"2024-01-20T11:08:41.992123+0000","last_unstale":"2024-01-20T11:08:42.977004+0000","last_undegraded":"2024-01-20T11:08:42.977004+0000","last_fullsized":"2024-01-20T11:08:42.977004+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:00:58.308363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977697+0000","last_change":"2024-01-20T11:08:41.985018+0000","last_active":"2024-01-20T11:08:42.977697+0000","last_peered":"2024-01-20T11:08:42.977697+0000","last_clean":"2024-01-20T11:08:42.977697+0000","last_became_active":"2024-01-20T11:08:41.984691+0000","last_became_peered":"2024-01-20T11:08:41.984691+0000","last_unstale":"2024-01-20T11:08:42.977697+0000","last_undegraded":"2024-01-20T11:08:42.977697+0000","last_fullsized":"2024-01-20T11:08:42.977697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:33:01.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583480+0000","last_change":"2024-01-20T11:08:41.986114+0000","last_active":"2024-01-20T11:08:43.583480+0000","last_peered":"2024-01-20T11:08:43.583480+0000","last_clean":"2024-01-20T11:08:43.583480+0000","last_became_active":"2024-01-20T11:08:41.985808+0000","last_became_peered":"2024-01-20T11:08:41.985808+0000","last_unstale":"2024-01-20T11:08:43.583480+0000","last_undegraded":"2024-01-20T11:08:43.583480+0000","last_fullsized":"2024-01-20T11:08:43.583480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:17:54.363561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582350+0000","last_change":"2024-01-20T11:08:42.005062+0000","last_active":"2024-01-20T11:08:43.582350+0000","last_peered":"2024-01-20T11:08:43.582350+0000","last_clean":"2024-01-20T11:08:43.582350+0000","last_became_active":"2024-01-20T11:08:42.004155+0000","last_became_peered":"2024-01-20T11:08:42.004155+0000","last_unstale":"2024-01-20T11:08:43.582350+0000","last_undegraded":"2024-01-20T11:08:43.582350+0000","last_fullsized":"2024-01-20T11:08:43.582350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:15.815638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584902+0000","last_change":"2024-01-20T11:08:41.968261+0000","last_active":"2024-01-20T11:08:43.584902+0000","last_peered":"2024-01-20T11:08:43.584902+0000","last_clean":"2024-01-20T11:08:43.584902+0000","last_became_active":"2024-01-20T11:08:41.967546+0000","last_became_peered":"2024-01-20T11:08:41.967546+0000","last_unstale":"2024-01-20T11:08:43.584902+0000","last_undegraded":"2024-01-20T11:08:43.584902+0000","last_fullsized":"2024-01-20T11:08:43.584902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:12:45.642500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582536+0000","last_change":"2024-01-20T11:08:41.977075+0000","last_active":"2024-01-20T11:08:43.582536+0000","last_peered":"2024-01-20T11:08:43.582536+0000","last_clean":"2024-01-20T11:08:43.582536+0000","last_became_active":"2024-01-20T11:08:41.976397+0000","last_became_peered":"2024-01-20T11:08:41.976397+0000","last_unstale":"2024-01-20T11:08:43.582536+0000","last_undegraded":"2024-01-20T11:08:43.582536+0000","last_fullsized":"2024-01-20T11:08:43.582536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:01:44.129587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582690+0000","last_change":"2024-01-20T11:08:42.000200+0000","last_active":"2024-01-20T11:08:43.582690+0000","last_peered":"2024-01-20T11:08:43.582690+0000","last_clean":"2024-01-20T11:08:43.582690+0000","last_became_active":"2024-01-20T11:08:41.999250+0000","last_became_peered":"2024-01-20T11:08:41.999250+0000","last_unstale":"2024-01-20T11:08:43.582690+0000","last_undegraded":"2024-01-20T11:08:43.582690+0000","last_fullsized":"2024-01-20T11:08:43.582690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:21:58.762316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.973257+0000","last_change":"2024-01-20T11:08:41.966346+0000","last_active":"2024-01-20T11:08:42.973257+0000","last_peered":"2024-01-20T11:08:42.973257+0000","last_clean":"2024-01-20T11:08:42.973257+0000","last_became_active":"2024-01-20T11:08:41.965557+0000","last_became_peered":"2024-01-20T11:08:41.965557+0000","last_unstale":"2024-01-20T11:08:42.973257+0000","last_undegraded":"2024-01-20T11:08:42.973257+0000","last_fullsized":"2024-01-20T11:08:42.973257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:04:43.396527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976166+0000","last_change":"2024-01-20T11:08:41.967767+0000","last_active":"2024-01-20T11:08:42.976166+0000","last_peered":"2024-01-20T11:08:42.976166+0000","last_clean":"2024-01-20T11:08:42.976166+0000","last_became_active":"2024-01-20T11:08:41.967034+0000","last_became_peered":"2024-01-20T11:08:41.967034+0000","last_unstale":"2024-01-20T11:08:42.976166+0000","last_undegraded":"2024-01-20T11:08:42.976166+0000","last_fullsized":"2024-01-20T11:08:42.976166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:27:46.531326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.585658+0000","last_change":"2024-01-20T11:08:41.985863+0000","last_active":"2024-01-20T11:08:43.585658+0000","last_peered":"2024-01-20T11:08:43.585658+0000","last_clean":"2024-01-20T11:08:43.585658+0000","last_became_active":"2024-01-20T11:08:41.985590+0000","last_became_peered":"2024-01-20T11:08:41.985590+0000","last_unstale":"2024-01-20T11:08:43.585658+0000","last_undegraded":"2024-01-20T11:08:43.585658+0000","last_fullsized":"2024-01-20T11:08:43.585658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:08.878331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583800+0000","last_change":"2024-01-20T11:08:41.992698+0000","last_active":"2024-01-20T11:08:43.583800+0000","last_peered":"2024-01-20T11:08:43.583800+0000","last_clean":"2024-01-20T11:08:43.583800+0000","last_became_active":"2024-01-20T11:08:41.992421+0000","last_became_peered":"2024-01-20T11:08:41.992421+0000","last_unstale":"2024-01-20T11:08:43.583800+0000","last_undegraded":"2024-01-20T11:08:43.583800+0000","last_fullsized":"2024-01-20T11:08:43.583800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:33:01.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583996+0000","last_change":"2024-01-20T11:08:41.986563+0000","last_active":"2024-01-20T11:08:43.583996+0000","last_peered":"2024-01-20T11:08:43.583996+0000","last_clean":"2024-01-20T11:08:43.583996+0000","last_became_active":"2024-01-20T11:08:41.986320+0000","last_became_peered":"2024-01-20T11:08:41.986320+0000","last_unstale":"2024-01-20T11:08:43.583996+0000","last_undegraded":"2024-01-20T11:08:43.583996+0000","last_fullsized":"2024-01-20T11:08:43.583996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:06:06.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978417+0000","last_change":"2024-01-20T11:08:41.978748+0000","last_active":"2024-01-20T11:08:42.978417+0000","last_peered":"2024-01-20T11:08:42.978417+0000","last_clean":"2024-01-20T11:08:42.978417+0000","last_became_active":"2024-01-20T11:08:41.978442+0000","last_became_peered":"2024-01-20T11:08:41.978442+0000","last_unstale":"2024-01-20T11:08:42.978417+0000","last_undegraded":"2024-01-20T11:08:42.978417+0000","last_fullsized":"2024-01-20T11:08:42.978417+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:17:54.363561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582329+0000","last_change":"2024-01-20T11:08:42.002922+0000","last_active":"2024-01-20T11:08:43.582329+0000","last_peered":"2024-01-20T11:08:43.582329+0000","last_clean":"2024-01-20T11:08:43.582329+0000","last_became_active":"2024-01-20T11:08:42.002082+0000","last_became_peered":"2024-01-20T11:08:42.002082+0000","last_unstale":"2024-01-20T11:08:43.582329+0000","last_undegraded":"2024-01-20T11:08:43.582329+0000","last_fullsized":"2024-01-20T11:08:43.582329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:06:06.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976597+0000","last_change":"2024-01-20T11:08:41.978599+0000","last_active":"2024-01-20T11:08:42.976597+0000","last_peered":"2024-01-20T11:08:42.976597+0000","last_clean":"2024-01-20T11:08:42.976597+0000","last_became_active":"2024-01-20T11:08:41.978282+0000","last_became_peered":"2024-01-20T11:08:41.978282+0000","last_unstale":"2024-01-20T11:08:42.976597+0000","last_undegraded":"2024-01-20T11:08:42.976597+0000","last_fullsized":"2024-01-20T11:08:42.976597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:15.815638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581243+0000","last_change":"2024-01-20T11:08:41.984359+0000","last_active":"2024-01-20T11:08:43.581243+0000","last_peered":"2024-01-20T11:08:43.581243+0000","last_clean":"2024-01-20T11:08:43.581243+0000","last_became_active":"2024-01-20T11:08:41.984038+0000","last_became_peered":"2024-01-20T11:08:41.984038+0000","last_unstale":"2024-01-20T11:08:43.581243+0000","last_undegraded":"2024-01-20T11:08:43.581243+0000","last_fullsized":"2024-01-20T11:08:43.581243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:10:15.246709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976348+0000","last_change":"2024-01-20T11:08:41.974016+0000","last_active":"2024-01-20T11:08:42.976348+0000","last_peered":"2024-01-20T11:08:42.976348+0000","last_clean":"2024-01-20T11:08:42.976348+0000","last_became_active":"2024-01-20T11:08:41.973615+0000","last_became_peered":"2024-01-20T11:08:41.973615+0000","last_unstale":"2024-01-20T11:08:42.976348+0000","last_undegraded":"2024-01-20T11:08:42.976348+0000","last_fullsized":"2024-01-20T11:08:42.976348+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:01:01.041378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974336+0000","last_change":"2024-01-20T11:08:41.976140+0000","last_active":"2024-01-20T11:08:42.974336+0000","last_peered":"2024-01-20T11:08:42.974336+0000","last_clean":"2024-01-20T11:08:42.974336+0000","last_became_active":"2024-01-20T11:08:41.975849+0000","last_became_peered":"2024-01-20T11:08:41.975849+0000","last_unstale":"2024-01-20T11:08:42.974336+0000","last_undegraded":"2024-01-20T11:08:42.974336+0000","last_fullsized":"2024-01-20T11:08:42.974336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:37:52.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.003673+0000","last_change":"2024-01-20T11:08:40.617984+0000","last_active":"2024-01-20T11:08:42.003673+0000","last_peered":"2024-01-20T11:08:42.003673+0000","last_clean":"2024-01-20T11:08:42.003673+0000","last_became_active":"2024-01-20T11:08:40.617702+0000","last_became_peered":"2024-01-20T11:08:40.617702+0000","last_unstale":"2024-01-20T11:08:42.003673+0000","last_undegraded":"2024-01-20T11:08:42.003673+0000","last_fullsized":"2024-01-20T11:08:42.003673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:50:37.063034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583507+0000","last_change":"2024-01-20T11:08:41.986129+0000","last_active":"2024-01-20T11:08:43.583507+0000","last_peered":"2024-01-20T11:08:43.583507+0000","last_clean":"2024-01-20T11:08:43.583507+0000","last_became_active":"2024-01-20T11:08:41.985704+0000","last_became_peered":"2024-01-20T11:08:41.985704+0000","last_unstale":"2024-01-20T11:08:43.583507+0000","last_undegraded":"2024-01-20T11:08:43.583507+0000","last_fullsized":"2024-01-20T11:08:43.583507+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:18:34.682622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974427+0000","last_change":"2024-01-20T11:08:40.613149+0000","last_active":"2024-01-20T11:08:42.974427+0000","last_peered":"2024-01-20T11:08:42.974427+0000","last_clean":"2024-01-20T11:08:42.974427+0000","last_became_active":"2024-01-20T11:08:40.612848+0000","last_became_peered":"2024-01-20T11:08:40.612848+0000","last_unstale":"2024-01-20T11:08:42.974427+0000","last_undegraded":"2024-01-20T11:08:42.974427+0000","last_fullsized":"2024-01-20T11:08:42.974427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:08.632328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583489+0000","last_change":"2024-01-20T11:08:41.999568+0000","last_active":"2024-01-20T11:08:43.583489+0000","last_peered":"2024-01-20T11:08:43.583489+0000","last_clean":"2024-01-20T11:08:43.583489+0000","last_became_active":"2024-01-20T11:08:41.999218+0000","last_became_peered":"2024-01-20T11:08:41.999218+0000","last_unstale":"2024-01-20T11:08:43.583489+0000","last_undegraded":"2024-01-20T11:08:43.583489+0000","last_fullsized":"2024-01-20T11:08:43.583489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:08.878331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.010731+0000","last_change":"2024-01-20T11:08:40.600676+0000","last_active":"2024-01-20T11:08:42.010731+0000","last_peered":"2024-01-20T11:08:42.010731+0000","last_clean":"2024-01-20T11:08:42.010731+0000","last_became_active":"2024-01-20T11:08:40.600167+0000","last_became_peered":"2024-01-20T11:08:40.600167+0000","last_unstale":"2024-01-20T11:08:42.010731+0000","last_undegraded":"2024-01-20T11:08:42.010731+0000","last_fullsized":"2024-01-20T11:08:42.010731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:59:31.263057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584215+0000","last_change":"2024-01-20T11:08:41.986520+0000","last_active":"2024-01-20T11:08:43.584215+0000","last_peered":"2024-01-20T11:08:43.584215+0000","last_clean":"2024-01-20T11:08:43.584215+0000","last_became_active":"2024-01-20T11:08:41.986024+0000","last_became_peered":"2024-01-20T11:08:41.986024+0000","last_unstale":"2024-01-20T11:08:43.584215+0000","last_undegraded":"2024-01-20T11:08:43.584215+0000","last_fullsized":"2024-01-20T11:08:43.584215+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:21:58.762316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.004799+0000","last_change":"2024-01-20T11:08:40.598561+0000","last_active":"2024-01-20T11:08:42.004799+0000","last_peered":"2024-01-20T11:08:42.004799+0000","last_clean":"2024-01-20T11:08:42.004799+0000","last_became_active":"2024-01-20T11:08:40.598283+0000","last_became_peered":"2024-01-20T11:08:40.598283+0000","last_unstale":"2024-01-20T11:08:42.004799+0000","last_undegraded":"2024-01-20T11:08:42.004799+0000","last_fullsized":"2024-01-20T11:08:42.004799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:30:42.327348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978272+0000","last_change":"2024-01-20T11:08:41.973464+0000","last_active":"2024-01-20T11:08:42.978272+0000","last_peered":"2024-01-20T11:08:42.978272+0000","last_clean":"2024-01-20T11:08:42.978272+0000","last_became_active":"2024-01-20T11:08:41.972835+0000","last_became_peered":"2024-01-20T11:08:41.972835+0000","last_unstale":"2024-01-20T11:08:42.978272+0000","last_undegraded":"2024-01-20T11:08:42.978272+0000","last_fullsized":"2024-01-20T11:08:42.978272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:28:37.409334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.009415+0000","last_change":"2024-01-20T11:08:40.614625+0000","last_active":"2024-01-20T11:08:42.009415+0000","last_peered":"2024-01-20T11:08:42.009415+0000","last_clean":"2024-01-20T11:08:42.009415+0000","last_became_active":"2024-01-20T11:08:40.613996+0000","last_became_peered":"2024-01-20T11:08:40.613996+0000","last_unstale":"2024-01-20T11:08:42.009415+0000","last_undegraded":"2024-01-20T11:08:42.009415+0000","last_fullsized":"2024-01-20T11:08:42.009415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:16.378799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977766+0000","last_change":"2024-01-20T11:08:41.979523+0000","last_active":"2024-01-20T11:08:42.977766+0000","last_peered":"2024-01-20T11:08:42.977766+0000","last_clean":"2024-01-20T11:08:42.977766+0000","last_became_active":"2024-01-20T11:08:41.979202+0000","last_became_peered":"2024-01-20T11:08:41.979202+0000","last_unstale":"2024-01-20T11:08:42.977766+0000","last_undegraded":"2024-01-20T11:08:42.977766+0000","last_fullsized":"2024-01-20T11:08:42.977766+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:56:45.487833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.002589+0000","last_change":"2024-01-20T11:08:40.613223+0000","last_active":"2024-01-20T11:08:42.002589+0000","last_peered":"2024-01-20T11:08:42.002589+0000","last_clean":"2024-01-20T11:08:42.002589+0000","last_became_active":"2024-01-20T11:08:40.612939+0000","last_became_peered":"2024-01-20T11:08:40.612939+0000","last_unstale":"2024-01-20T11:08:42.002589+0000","last_undegraded":"2024-01-20T11:08:42.002589+0000","last_fullsized":"2024-01-20T11:08:42.002589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:50:07.883678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581817+0000","last_change":"2024-01-20T11:08:41.985123+0000","last_active":"2024-01-20T11:08:43.581817+0000","last_peered":"2024-01-20T11:08:43.581817+0000","last_clean":"2024-01-20T11:08:43.581817+0000","last_became_active":"2024-01-20T11:08:41.984850+0000","last_became_peered":"2024-01-20T11:08:41.984850+0000","last_unstale":"2024-01-20T11:08:43.581817+0000","last_undegraded":"2024-01-20T11:08:43.581817+0000","last_fullsized":"2024-01-20T11:08:43.581817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:08.780431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.984010+0000","last_change":"2024-01-20T11:08:40.601786+0000","last_active":"2024-01-20T11:08:41.984010+0000","last_peered":"2024-01-20T11:08:41.984010+0000","last_clean":"2024-01-20T11:08:41.984010+0000","last_became_active":"2024-01-20T11:08:40.601568+0000","last_became_peered":"2024-01-20T11:08:40.601568+0000","last_unstale":"2024-01-20T11:08:41.984010+0000","last_undegraded":"2024-01-20T11:08:41.984010+0000","last_fullsized":"2024-01-20T11:08:41.984010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:04:42.390537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581504+0000","last_change":"2024-01-20T11:08:41.990172+0000","last_active":"2024-01-20T11:08:43.581504+0000","last_peered":"2024-01-20T11:08:43.581504+0000","last_clean":"2024-01-20T11:08:43.581504+0000","last_became_active":"2024-01-20T11:08:41.988192+0000","last_became_peered":"2024-01-20T11:08:41.988192+0000","last_unstale":"2024-01-20T11:08:43.581504+0000","last_undegraded":"2024-01-20T11:08:43.581504+0000","last_fullsized":"2024-01-20T11:08:43.581504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:56:01.876027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.973346+0000","last_change":"2024-01-20T11:08:40.607493+0000","last_active":"2024-01-20T11:08:41.973346+0000","last_peered":"2024-01-20T11:08:41.973346+0000","last_clean":"2024-01-20T11:08:41.973346+0000","last_became_active":"2024-01-20T11:08:40.607100+0000","last_became_peered":"2024-01-20T11:08:40.607100+0000","last_unstale":"2024-01-20T11:08:41.973346+0000","last_undegraded":"2024-01-20T11:08:41.973346+0000","last_fullsized":"2024-01-20T11:08:41.973346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:02:11.948279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978440+0000","last_change":"2024-01-20T11:08:41.998783+0000","last_active":"2024-01-20T11:08:42.978440+0000","last_peered":"2024-01-20T11:08:42.978440+0000","last_clean":"2024-01-20T11:08:42.978440+0000","last_became_active":"2024-01-20T11:08:41.998511+0000","last_became_peered":"2024-01-20T11:08:41.998511+0000","last_unstale":"2024-01-20T11:08:42.978440+0000","last_undegraded":"2024-01-20T11:08:42.978440+0000","last_fullsized":"2024-01-20T11:08:42.978440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:59:51.869423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.001664+0000","last_change":"2024-01-20T11:08:40.619833+0000","last_active":"2024-01-20T11:08:42.001664+0000","last_peered":"2024-01-20T11:08:42.001664+0000","last_clean":"2024-01-20T11:08:42.001664+0000","last_became_active":"2024-01-20T11:08:40.619634+0000","last_became_peered":"2024-01-20T11:08:40.619634+0000","last_unstale":"2024-01-20T11:08:42.001664+0000","last_undegraded":"2024-01-20T11:08:42.001664+0000","last_fullsized":"2024-01-20T11:08:42.001664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:01:00.035388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584560+0000","last_change":"2024-01-20T11:08:42.001299+0000","last_active":"2024-01-20T11:08:43.584560+0000","last_peered":"2024-01-20T11:08:43.584560+0000","last_clean":"2024-01-20T11:08:43.584560+0000","last_became_active":"2024-01-20T11:08:41.999155+0000","last_became_peered":"2024-01-20T11:08:41.999155+0000","last_unstale":"2024-01-20T11:08:43.584560+0000","last_undegraded":"2024-01-20T11:08:43.584560+0000","last_fullsized":"2024-01-20T11:08:43.584560+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:42:11.154049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974618+0000","last_change":"2024-01-20T11:08:40.604664+0000","last_active":"2024-01-20T11:08:42.974618+0000","last_peered":"2024-01-20T11:08:42.974618+0000","last_clean":"2024-01-20T11:08:42.974618+0000","last_became_active":"2024-01-20T11:08:40.604346+0000","last_became_peered":"2024-01-20T11:08:40.604346+0000","last_unstale":"2024-01-20T11:08:42.974618+0000","last_undegraded":"2024-01-20T11:08:42.974618+0000","last_fullsized":"2024-01-20T11:08:42.974618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:06.341358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584279+0000","last_change":"2024-01-20T11:08:41.997680+0000","last_active":"2024-01-20T11:08:43.584279+0000","last_peered":"2024-01-20T11:08:43.584279+0000","last_clean":"2024-01-20T11:08:43.584279+0000","last_became_active":"2024-01-20T11:08:41.997336+0000","last_became_peered":"2024-01-20T11:08:41.997336+0000","last_unstale":"2024-01-20T11:08:43.584279+0000","last_undegraded":"2024-01-20T11:08:43.584279+0000","last_fullsized":"2024-01-20T11:08:43.584279+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:59:51.869423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.001719+0000","last_change":"2024-01-20T11:08:40.620003+0000","last_active":"2024-01-20T11:08:42.001719+0000","last_peered":"2024-01-20T11:08:42.001719+0000","last_clean":"2024-01-20T11:08:42.001719+0000","last_became_active":"2024-01-20T11:08:40.619634+0000","last_became_peered":"2024-01-20T11:08:40.619634+0000","last_unstale":"2024-01-20T11:08:42.001719+0000","last_undegraded":"2024-01-20T11:08:42.001719+0000","last_fullsized":"2024-01-20T11:08:42.001719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:18:33.676633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977921+0000","last_change":"2024-01-20T11:08:42.001875+0000","last_active":"2024-01-20T11:08:42.977921+0000","last_peered":"2024-01-20T11:08:42.977921+0000","last_clean":"2024-01-20T11:08:42.977921+0000","last_became_active":"2024-01-20T11:08:42.001486+0000","last_became_peered":"2024-01-20T11:08:42.001486+0000","last_unstale":"2024-01-20T11:08:42.977921+0000","last_undegraded":"2024-01-20T11:08:42.977921+0000","last_fullsized":"2024-01-20T11:08:42.977921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:00:58.308363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.014765+0000","last_change":"2024-01-20T11:08:40.602465+0000","last_active":"2024-01-20T11:08:42.014765+0000","last_peered":"2024-01-20T11:08:42.014765+0000","last_clean":"2024-01-20T11:08:42.014765+0000","last_became_active":"2024-01-20T11:08:40.602167+0000","last_became_peered":"2024-01-20T11:08:40.602167+0000","last_unstale":"2024-01-20T11:08:42.014765+0000","last_undegraded":"2024-01-20T11:08:42.014765+0000","last_fullsized":"2024-01-20T11:08:42.014765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:35:02.616750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581640+0000","last_change":"2024-01-20T11:08:41.982473+0000","last_active":"2024-01-20T11:08:43.581640+0000","last_peered":"2024-01-20T11:08:43.581640+0000","last_clean":"2024-01-20T11:08:43.581640+0000","last_became_active":"2024-01-20T11:08:41.982087+0000","last_became_peered":"2024-01-20T11:08:41.982087+0000","last_unstale":"2024-01-20T11:08:43.581640+0000","last_undegraded":"2024-01-20T11:08:43.581640+0000","last_fullsized":"2024-01-20T11:08:43.581640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:01:44.129587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.003762+0000","last_change":"2024-01-20T11:08:40.606370+0000","last_active":"2024-01-20T11:08:42.003762+0000","last_peered":"2024-01-20T11:08:42.003762+0000","last_clean":"2024-01-20T11:08:42.003762+0000","last_became_active":"2024-01-20T11:08:40.606012+0000","last_became_peered":"2024-01-20T11:08:40.606012+0000","last_unstale":"2024-01-20T11:08:42.003762+0000","last_undegraded":"2024-01-20T11:08:42.003762+0000","last_fullsized":"2024-01-20T11:08:42.003762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:27:51.880438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583206+0000","last_change":"2024-01-20T11:08:41.993660+0000","last_active":"2024-01-20T11:08:43.583206+0000","last_peered":"2024-01-20T11:08:43.583206+0000","last_clean":"2024-01-20T11:08:43.583206+0000","last_became_active":"2024-01-20T11:08:41.993166+0000","last_became_peered":"2024-01-20T11:08:41.993166+0000","last_unstale":"2024-01-20T11:08:43.583206+0000","last_undegraded":"2024-01-20T11:08:43.583206+0000","last_fullsized":"2024-01-20T11:08:43.583206+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:50.537772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.971886+0000","last_change":"2024-01-20T11:08:40.603518+0000","last_active":"2024-01-20T11:08:41.971886+0000","last_peered":"2024-01-20T11:08:41.971886+0000","last_clean":"2024-01-20T11:08:41.971886+0000","last_became_active":"2024-01-20T11:08:40.603213+0000","last_became_peered":"2024-01-20T11:08:40.603213+0000","last_unstale":"2024-01-20T11:08:41.971886+0000","last_undegraded":"2024-01-20T11:08:41.971886+0000","last_fullsized":"2024-01-20T11:08:41.971886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:27.618562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976577+0000","last_change":"2024-01-20T11:08:41.972835+0000","last_active":"2024-01-20T11:08:42.976577+0000","last_peered":"2024-01-20T11:08:42.976577+0000","last_clean":"2024-01-20T11:08:42.976577+0000","last_became_active":"2024-01-20T11:08:41.972255+0000","last_became_peered":"2024-01-20T11:08:41.972255+0000","last_unstale":"2024-01-20T11:08:42.976577+0000","last_undegraded":"2024-01-20T11:08:42.976577+0000","last_fullsized":"2024-01-20T11:08:42.976577+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:27:46.531326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.983859+0000","last_change":"2024-01-20T11:08:40.615415+0000","last_active":"2024-01-20T11:08:41.983859+0000","last_peered":"2024-01-20T11:08:41.983859+0000","last_clean":"2024-01-20T11:08:41.983859+0000","last_became_active":"2024-01-20T11:08:40.615100+0000","last_became_peered":"2024-01-20T11:08:40.615100+0000","last_unstale":"2024-01-20T11:08:41.983859+0000","last_undegraded":"2024-01-20T11:08:41.983859+0000","last_fullsized":"2024-01-20T11:08:41.983859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:56:54.358889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582489+0000","last_change":"2024-01-20T11:08:41.982183+0000","last_active":"2024-01-20T11:08:43.582489+0000","last_peered":"2024-01-20T11:08:43.582489+0000","last_clean":"2024-01-20T11:08:43.582489+0000","last_became_active":"2024-01-20T11:08:41.981807+0000","last_became_peered":"2024-01-20T11:08:41.981807+0000","last_unstale":"2024-01-20T11:08:43.582489+0000","last_undegraded":"2024-01-20T11:08:43.582489+0000","last_fullsized":"2024-01-20T11:08:43.582489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:04:43.396527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.012730+0000","last_change":"2024-01-20T11:08:40.599936+0000","last_active":"2024-01-20T11:08:42.012730+0000","last_peered":"2024-01-20T11:08:42.012730+0000","last_clean":"2024-01-20T11:08:42.012730+0000","last_became_active":"2024-01-20T11:08:40.599652+0000","last_became_peered":"2024-01-20T11:08:40.599652+0000","last_unstale":"2024-01-20T11:08:42.012730+0000","last_undegraded":"2024-01-20T11:08:42.012730+0000","last_fullsized":"2024-01-20T11:08:42.012730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:10:14.240719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582211+0000","last_change":"2024-01-20T11:08:41.978266+0000","last_active":"2024-01-20T11:08:43.582211+0000","last_peered":"2024-01-20T11:08:43.582211+0000","last_clean":"2024-01-20T11:08:43.582211+0000","last_became_active":"2024-01-20T11:08:41.977955+0000","last_became_peered":"2024-01-20T11:08:41.977955+0000","last_unstale":"2024-01-20T11:08:43.582211+0000","last_undegraded":"2024-01-20T11:08:43.582211+0000","last_fullsized":"2024-01-20T11:08:43.582211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:56:01.876027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.012164+0000","last_change":"2024-01-20T11:08:40.601755+0000","last_active":"2024-01-20T11:08:42.012164+0000","last_peered":"2024-01-20T11:08:42.012164+0000","last_clean":"2024-01-20T11:08:42.012164+0000","last_became_active":"2024-01-20T11:08:40.601250+0000","last_became_peered":"2024-01-20T11:08:40.601250+0000","last_unstale":"2024-01-20T11:08:42.012164+0000","last_undegraded":"2024-01-20T11:08:42.012164+0000","last_fullsized":"2024-01-20T11:08:42.012164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:12:44.636510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978432+0000","last_change":"2024-01-20T11:08:41.983205+0000","last_active":"2024-01-20T11:08:42.978432+0000","last_peered":"2024-01-20T11:08:42.978432+0000","last_clean":"2024-01-20T11:08:42.978432+0000","last_became_active":"2024-01-20T11:08:41.981622+0000","last_became_peered":"2024-01-20T11:08:41.981622+0000","last_unstale":"2024-01-20T11:08:42.978432+0000","last_undegraded":"2024-01-20T11:08:42.978432+0000","last_fullsized":"2024-01-20T11:08:42.978432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:33:01.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.000915+0000","last_change":"2024-01-20T11:08:40.610360+0000","last_active":"2024-01-20T11:08:42.000915+0000","last_peered":"2024-01-20T11:08:42.000915+0000","last_clean":"2024-01-20T11:08:42.000915+0000","last_became_active":"2024-01-20T11:08:40.609811+0000","last_became_peered":"2024-01-20T11:08:40.609811+0000","last_unstale":"2024-01-20T11:08:42.000915+0000","last_undegraded":"2024-01-20T11:08:42.000915+0000","last_fullsized":"2024-01-20T11:08:42.000915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:12.505823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.586293+0000","last_change":"2024-01-20T11:08:41.981683+0000","last_active":"2024-01-20T11:08:43.586293+0000","last_peered":"2024-01-20T11:08:43.586293+0000","last_clean":"2024-01-20T11:08:43.586293+0000","last_became_active":"2024-01-20T11:08:41.981414+0000","last_became_peered":"2024-01-20T11:08:41.981414+0000","last_unstale":"2024-01-20T11:08:43.586293+0000","last_undegraded":"2024-01-20T11:08:43.586293+0000","last_fullsized":"2024-01-20T11:08:43.586293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:49:01.607165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.008260+0000","last_change":"2024-01-20T11:08:40.608291+0000","last_active":"2024-01-20T11:08:42.008260+0000","last_peered":"2024-01-20T11:08:42.008260+0000","last_clean":"2024-01-20T11:08:42.008260+0000","last_became_active":"2024-01-20T11:08:40.607985+0000","last_became_peered":"2024-01-20T11:08:40.607985+0000","last_unstale":"2024-01-20T11:08:42.008260+0000","last_undegraded":"2024-01-20T11:08:42.008260+0000","last_fullsized":"2024-01-20T11:08:42.008260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:21.032826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582183+0000","last_change":"2024-01-20T11:08:41.981136+0000","last_active":"2024-01-20T11:08:43.582183+0000","last_peered":"2024-01-20T11:08:43.582183+0000","last_clean":"2024-01-20T11:08:43.582183+0000","last_became_active":"2024-01-20T11:08:41.980825+0000","last_became_peered":"2024-01-20T11:08:41.980825+0000","last_unstale":"2024-01-20T11:08:43.582183+0000","last_undegraded":"2024-01-20T11:08:43.582183+0000","last_fullsized":"2024-01-20T11:08:43.582183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:27:52.886428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.976748+0000","last_change":"2024-01-20T11:08:40.613383+0000","last_active":"2024-01-20T11:08:41.976748+0000","last_peered":"2024-01-20T11:08:41.976748+0000","last_clean":"2024-01-20T11:08:41.976748+0000","last_became_active":"2024-01-20T11:08:40.613064+0000","last_became_peered":"2024-01-20T11:08:40.613064+0000","last_unstale":"2024-01-20T11:08:41.976748+0000","last_undegraded":"2024-01-20T11:08:41.976748+0000","last_fullsized":"2024-01-20T11:08:41.976748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:35.936256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581914+0000","last_change":"2024-01-20T11:08:41.977554+0000","last_active":"2024-01-20T11:08:43.581914+0000","last_peered":"2024-01-20T11:08:43.581914+0000","last_clean":"2024-01-20T11:08:43.581914+0000","last_became_active":"2024-01-20T11:08:41.976728+0000","last_became_peered":"2024-01-20T11:08:41.976728+0000","last_unstale":"2024-01-20T11:08:43.581914+0000","last_undegraded":"2024-01-20T11:08:43.581914+0000","last_fullsized":"2024-01-20T11:08:43.581914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:36.942246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974101+0000","last_change":"2024-01-20T11:08:40.605704+0000","last_active":"2024-01-20T11:08:42.974101+0000","last_peered":"2024-01-20T11:08:42.974101+0000","last_clean":"2024-01-20T11:08:42.974101+0000","last_became_active":"2024-01-20T11:08:40.605320+0000","last_became_peered":"2024-01-20T11:08:40.605320+0000","last_unstale":"2024-01-20T11:08:42.974101+0000","last_undegraded":"2024-01-20T11:08:42.974101+0000","last_fullsized":"2024-01-20T11:08:42.974101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:50:37.063034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583690+0000","last_change":"2024-01-20T11:08:41.966584+0000","last_active":"2024-01-20T11:08:43.583690+0000","last_peered":"2024-01-20T11:08:43.583690+0000","last_clean":"2024-01-20T11:08:43.583690+0000","last_became_active":"2024-01-20T11:08:41.965856+0000","last_became_peered":"2024-01-20T11:08:41.965856+0000","last_unstale":"2024-01-20T11:08:43.583690+0000","last_undegraded":"2024-01-20T11:08:43.583690+0000","last_fullsized":"2024-01-20T11:08:43.583690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:13.511813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.974841+0000","last_change":"2024-01-20T11:08:40.613167+0000","last_active":"2024-01-20T11:08:41.974841+0000","last_peered":"2024-01-20T11:08:41.974841+0000","last_clean":"2024-01-20T11:08:41.974841+0000","last_became_active":"2024-01-20T11:08:40.612711+0000","last_became_peered":"2024-01-20T11:08:40.612711+0000","last_unstale":"2024-01-20T11:08:41.974841+0000","last_undegraded":"2024-01-20T11:08:41.974841+0000","last_fullsized":"2024-01-20T11:08:41.974841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:26.428713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581570+0000","last_change":"2024-01-20T11:08:41.977691+0000","last_active":"2024-01-20T11:08:43.581570+0000","last_peered":"2024-01-20T11:08:43.581570+0000","last_clean":"2024-01-20T11:08:43.581570+0000","last_became_active":"2024-01-20T11:08:41.976750+0000","last_became_peered":"2024-01-20T11:08:41.976750+0000","last_unstale":"2024-01-20T11:08:43.581570+0000","last_undegraded":"2024-01-20T11:08:43.581570+0000","last_fullsized":"2024-01-20T11:08:43.581570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:25:02.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.976551+0000","last_change":"2024-01-20T11:08:40.605328+0000","last_active":"2024-01-20T11:08:41.976551+0000","last_peered":"2024-01-20T11:08:41.976551+0000","last_clean":"2024-01-20T11:08:41.976551+0000","last_became_active":"2024-01-20T11:08:40.603861+0000","last_became_peered":"2024-01-20T11:08:40.603861+0000","last_unstale":"2024-01-20T11:08:41.976551+0000","last_undegraded":"2024-01-20T11:08:41.976551+0000","last_fullsized":"2024-01-20T11:08:41.976551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:34.522031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977930+0000","last_change":"2024-01-20T11:08:41.978444+0000","last_active":"2024-01-20T11:08:42.977930+0000","last_peered":"2024-01-20T11:08:42.977930+0000","last_clean":"2024-01-20T11:08:42.977930+0000","last_became_active":"2024-01-20T11:08:41.978100+0000","last_became_peered":"2024-01-20T11:08:41.978100+0000","last_unstale":"2024-01-20T11:08:42.977930+0000","last_undegraded":"2024-01-20T11:08:42.977930+0000","last_fullsized":"2024-01-20T11:08:42.977930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:17:54.363561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.955838+0000","last_change":"2024-01-20T11:08:40.618140+0000","last_active":"2024-01-20T11:08:41.955838+0000","last_peered":"2024-01-20T11:08:41.955838+0000","last_clean":"2024-01-20T11:08:41.955838+0000","last_became_active":"2024-01-20T11:08:40.617681+0000","last_became_peered":"2024-01-20T11:08:40.617681+0000","last_unstale":"2024-01-20T11:08:41.955838+0000","last_undegraded":"2024-01-20T11:08:41.955838+0000","last_fullsized":"2024-01-20T11:08:41.955838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:06:04.553729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582132+0000","last_change":"2024-01-20T11:08:41.967913+0000","last_active":"2024-01-20T11:08:43.582132+0000","last_peered":"2024-01-20T11:08:43.582132+0000","last_clean":"2024-01-20T11:08:43.582132+0000","last_became_active":"2024-01-20T11:08:41.967312+0000","last_became_peered":"2024-01-20T11:08:41.967312+0000","last_unstale":"2024-01-20T11:08:43.582132+0000","last_undegraded":"2024-01-20T11:08:43.582132+0000","last_fullsized":"2024-01-20T11:08:43.582132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:17.384788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.004716+0000","last_change":"2024-01-20T11:08:40.610528+0000","last_active":"2024-01-20T11:08:42.004716+0000","last_peered":"2024-01-20T11:08:42.004716+0000","last_clean":"2024-01-20T11:08:42.004716+0000","last_became_active":"2024-01-20T11:08:40.610186+0000","last_became_peered":"2024-01-20T11:08:40.610186+0000","last_unstale":"2024-01-20T11:08:42.004716+0000","last_undegraded":"2024-01-20T11:08:42.004716+0000","last_fullsized":"2024-01-20T11:08:42.004716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:34.761327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978433+0000","last_change":"2024-01-20T11:08:41.983483+0000","last_active":"2024-01-20T11:08:42.978433+0000","last_peered":"2024-01-20T11:08:42.978433+0000","last_clean":"2024-01-20T11:08:42.978433+0000","last_became_active":"2024-01-20T11:08:41.982865+0000","last_became_peered":"2024-01-20T11:08:41.982865+0000","last_unstale":"2024-01-20T11:08:42.978433+0000","last_undegraded":"2024-01-20T11:08:42.978433+0000","last_fullsized":"2024-01-20T11:08:42.978433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:28:37.409334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974537+0000","last_change":"2024-01-20T11:08:40.605892+0000","last_active":"2024-01-20T11:08:42.974537+0000","last_peered":"2024-01-20T11:08:42.974537+0000","last_clean":"2024-01-20T11:08:42.974537+0000","last_became_active":"2024-01-20T11:08:40.605520+0000","last_became_peered":"2024-01-20T11:08:40.605520+0000","last_unstale":"2024-01-20T11:08:42.974537+0000","last_undegraded":"2024-01-20T11:08:42.974537+0000","last_fullsized":"2024-01-20T11:08:42.974537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:55.280596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.973881+0000","last_change":"2024-01-20T11:08:41.996321+0000","last_active":"2024-01-20T11:08:42.973881+0000","last_peered":"2024-01-20T11:08:42.973881+0000","last_clean":"2024-01-20T11:08:42.973881+0000","last_became_active":"2024-01-20T11:08:41.995679+0000","last_became_peered":"2024-01-20T11:08:41.995679+0000","last_unstale":"2024-01-20T11:08:42.973881+0000","last_undegraded":"2024-01-20T11:08:42.973881+0000","last_fullsized":"2024-01-20T11:08:42.973881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:18:34.682622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.972536+0000","last_change":"2024-01-20T11:08:40.605017+0000","last_active":"2024-01-20T11:08:41.972536+0000","last_peered":"2024-01-20T11:08:41.972536+0000","last_clean":"2024-01-20T11:08:41.972536+0000","last_became_active":"2024-01-20T11:08:40.603984+0000","last_became_peered":"2024-01-20T11:08:40.603984+0000","last_unstale":"2024-01-20T11:08:41.972536+0000","last_undegraded":"2024-01-20T11:08:41.972536+0000","last_fullsized":"2024-01-20T11:08:41.972536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:12.505823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582367+0000","last_change":"2024-01-20T11:08:41.984970+0000","last_active":"2024-01-20T11:08:43.582367+0000","last_peered":"2024-01-20T11:08:43.582367+0000","last_clean":"2024-01-20T11:08:43.582367+0000","last_became_active":"2024-01-20T11:08:41.983951+0000","last_became_peered":"2024-01-20T11:08:41.983951+0000","last_unstale":"2024-01-20T11:08:43.582367+0000","last_undegraded":"2024-01-20T11:08:43.582367+0000","last_fullsized":"2024-01-20T11:08:43.582367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:56:55.364879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974030+0000","last_change":"2024-01-20T11:08:40.609543+0000","last_active":"2024-01-20T11:08:42.974030+0000","last_peered":"2024-01-20T11:08:42.974030+0000","last_clean":"2024-01-20T11:08:42.974030+0000","last_became_active":"2024-01-20T11:08:40.609230+0000","last_became_peered":"2024-01-20T11:08:40.609230+0000","last_unstale":"2024-01-20T11:08:42.974030+0000","last_undegraded":"2024-01-20T11:08:42.974030+0000","last_fullsized":"2024-01-20T11:08:42.974030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:17:48.731371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.973874+0000","last_change":"2024-01-20T11:08:41.990537+0000","last_active":"2024-01-20T11:08:42.973874+0000","last_peered":"2024-01-20T11:08:42.973874+0000","last_clean":"2024-01-20T11:08:42.973874+0000","last_became_active":"2024-01-20T11:08:41.988093+0000","last_became_peered":"2024-01-20T11:08:41.988093+0000","last_unstale":"2024-01-20T11:08:42.973874+0000","last_undegraded":"2024-01-20T11:08:42.973874+0000","last_fullsized":"2024-01-20T11:08:42.973874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:06:05.559719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.972126+0000","last_change":"2024-01-20T11:08:40.606231+0000","last_active":"2024-01-20T11:08:41.972126+0000","last_peered":"2024-01-20T11:08:41.972126+0000","last_clean":"2024-01-20T11:08:41.972126+0000","last_became_active":"2024-01-20T11:08:40.606000+0000","last_became_peered":"2024-01-20T11:08:40.606000+0000","last_unstale":"2024-01-20T11:08:41.972126+0000","last_undegraded":"2024-01-20T11:08:41.972126+0000","last_fullsized":"2024-01-20T11:08:41.972126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:21.032826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583942+0000","last_change":"2024-01-20T11:08:41.986522+0000","last_active":"2024-01-20T11:08:43.583942+0000","last_peered":"2024-01-20T11:08:43.583942+0000","last_clean":"2024-01-20T11:08:43.583942+0000","last_became_active":"2024-01-20T11:08:41.986267+0000","last_became_peered":"2024-01-20T11:08:41.986267+0000","last_unstale":"2024-01-20T11:08:43.583942+0000","last_undegraded":"2024-01-20T11:08:43.583942+0000","last_fullsized":"2024-01-20T11:08:43.583942+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:28:37.409334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.976713+0000","last_change":"2024-01-20T11:08:40.611802+0000","last_active":"2024-01-20T11:08:41.976713+0000","last_peered":"2024-01-20T11:08:41.976713+0000","last_clean":"2024-01-20T11:08:41.976713+0000","last_became_active":"2024-01-20T11:08:40.611456+0000","last_became_peered":"2024-01-20T11:08:40.611456+0000","last_unstale":"2024-01-20T11:08:41.976713+0000","last_undegraded":"2024-01-20T11:08:41.976713+0000","last_fullsized":"2024-01-20T11:08:41.976713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:25:01.600531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581748+0000","last_change":"2024-01-20T11:08:41.992525+0000","last_active":"2024-01-20T11:08:43.581748+0000","last_peered":"2024-01-20T11:08:43.581748+0000","last_clean":"2024-01-20T11:08:43.581748+0000","last_became_active":"2024-01-20T11:08:41.992204+0000","last_became_peered":"2024-01-20T11:08:41.992204+0000","last_unstale":"2024-01-20T11:08:43.581748+0000","last_undegraded":"2024-01-20T11:08:43.581748+0000","last_fullsized":"2024-01-20T11:08:43.581748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:37:53.685410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.970684+0000","last_change":"2024-01-20T11:08:40.615448+0000","last_active":"2024-01-20T11:08:41.970684+0000","last_peered":"2024-01-20T11:08:41.970684+0000","last_clean":"2024-01-20T11:08:41.970684+0000","last_became_active":"2024-01-20T11:08:40.615183+0000","last_became_peered":"2024-01-20T11:08:40.615183+0000","last_unstale":"2024-01-20T11:08:41.970684+0000","last_undegraded":"2024-01-20T11:08:41.970684+0000","last_fullsized":"2024-01-20T11:08:41.970684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:07:53.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977212+0000","last_change":"2024-01-20T11:08:41.983368+0000","last_active":"2024-01-20T11:08:42.977212+0000","last_peered":"2024-01-20T11:08:42.977212+0000","last_clean":"2024-01-20T11:08:42.977212+0000","last_became_active":"2024-01-20T11:08:41.982814+0000","last_became_peered":"2024-01-20T11:08:41.982814+0000","last_unstale":"2024-01-20T11:08:42.977212+0000","last_undegraded":"2024-01-20T11:08:42.977212+0000","last_fullsized":"2024-01-20T11:08:42.977212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:50.537772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.978583+0000","last_change":"2024-01-20T11:08:40.616257+0000","last_active":"2024-01-20T11:08:41.978583+0000","last_peered":"2024-01-20T11:08:41.978583+0000","last_clean":"2024-01-20T11:08:41.978583+0000","last_became_active":"2024-01-20T11:08:40.615824+0000","last_became_peered":"2024-01-20T11:08:40.615824+0000","last_unstale":"2024-01-20T11:08:41.978583+0000","last_undegraded":"2024-01-20T11:08:41.978583+0000","last_fullsized":"2024-01-20T11:08:41.978583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:17:48.731371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.963123+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:08:41.963123+0000","last_peered":"2024-01-20T11:08:41.963123+0000","last_clean":"2024-01-20T11:08:41.963123+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:08:41.963123+0000","last_undegraded":"2024-01-20T11:08:41.963123+0000","last_fullsized":"2024-01-20T11:08:41.963123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":750183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.113}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.222}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.169},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.6379999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.048},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.748}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.329}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.383}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.484}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":160341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":0.878},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.1359999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.091},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.4550000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.554},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.2190000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":3.0289999999999999,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.659}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":160397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.724},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.0660000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.607}]},{"osd":2,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.2490000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.8089999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4059999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.8859999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.391,"5min":1.391,"15min":1.391},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.762}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":159829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.4590000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.385},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.92200000000000004}]},{"osd":3,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.054}]},{"osd":5,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.3109999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.28},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.222},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.494}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":161359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.248},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.157}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.4650000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.681}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.036},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.377}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.532},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.6180000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.4239999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.577},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1970000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":159795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.1200000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.80200000000000005}]},{"osd":3,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.95399999999999996}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":1.2010000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.1559999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2649999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":1.367},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3220000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":161359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.4729999999999999,"5min":5.4729999999999999,"15min":5.4729999999999999},"last":0.874}]},{"osd":2,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.468},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.0579999999999998,"5min":5.0579999999999998,"15min":5.0579999999999998},"last":1.1559999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":5.0010000000000003,"5min":5.0010000000000003,"15min":5.0010000000000003},"last":1.224},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.4139999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.3399999999999999,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":1.5209999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":1.095},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":1.609}]},{"osd":6,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":5.1769999999999996,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.266}]},{"osd":7,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":5.391,"5min":5.391,"15min":5.391},"last":1.369},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":5.5469999999999997,"5min":5.5469999999999997,"15min":5.5469999999999997},"last":1.3200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":750093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.119},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.397}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.73399999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.4870000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.823},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":2.0379999999999998}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3380000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":2.1459999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.7250000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.55},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":2.2029999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:08:46.345 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:08:46.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.586+0000 7f53cfe00640 1 Processor -- start 2024-01-20T11:08:46.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.586+0000 7f53cfe00640 1 -- start start 2024-01-20T11:08:46.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.587+0000 7f53cfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53d0143c70 0x7f53d0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.587+0000 7f53cfe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53d00b3ad0 0x7f53d00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cfe00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00cd300 con 0x7f53d00cf960 2024-01-20T11:08:46.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00cfd40 con 0x7f53d0143c70 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cfe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00cc9d0 con 0x7f53d00b3ad0 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53d0143c70 0x7f53d0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53d0143c70 0x7f53d0070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58086/0 (socket says 172.21.15.162:58086) 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cea00640 1 -- 172.21.15.162:0/946494216 learned_addr learned my addr 172.21.15.162:0/946494216 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cea00640 1 -- 172.21.15.162:0/946494216 >> v2:172.21.15.179:3300/0 conn(0x7f53d00b3ad0 msgr2=0x7f53d00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53c5e00640 1 --2- 172.21.15.162:0/946494216 >> v2:172.21.15.179:3300/0 conn(0x7f53d00b3ad0 0x7f53d00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cea00640 1 --2- 172.21.15.162:0/946494216 >> v2:172.21.15.179:3300/0 conn(0x7f53d00b3ad0 0x7f53d00cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cea00640 1 -- 172.21.15.162:0/946494216 >> v1:172.21.15.179:6789/0 conn(0x7f53d00cf960 legacy=0x7f53d00b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:46.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.588+0000 7f53cea00640 1 -- 172.21.15.162:0/946494216 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00cccb0 con 0x7f53d0143c70 2024-01-20T11:08:46.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.589+0000 7f53cea00640 1 --2- 172.21.15.162:0/946494216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d0143c70 0x7f53d0070d20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53d006e800 tx=0x7f53c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f301c438a5ef6d3b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:46.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.590+0000 7f53ce000640 1 -- 172.21.15.162:0/946494216 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0031870 con 0x7f53d0143c70 2024-01-20T11:08:46.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.590+0000 7f53ce000640 1 -- 172.21.15.162:0/946494216 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c00319d0 con 0x7f53d0143c70 2024-01-20T11:08:46.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.590+0000 7f53ce000640 1 -- 172.21.15.162:0/946494216 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0031d60 con 0x7f53d0143c70 2024-01-20T11:08:46.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.590+0000 7f53cfe00640 1 -- 172.21.15.162:0/946494216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d0143c70 msgr2=0x7f53d0070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.590+0000 7f53cfe00640 1 --2- 172.21.15.162:0/946494216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d0143c70 0x7f53d0070d20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53d006e800 tx=0x7f53c002b910 comp rx=0 tx=0).stop 2024-01-20T11:08:46.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.591+0000 7f53cfe00640 1 -- 172.21.15.162:0/946494216 shutdown_connections 2024-01-20T11:08:46.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.591+0000 7f53cfe00640 1 --2- 172.21.15.162:0/946494216 >> v2:172.21.15.179:3300/0 conn(0x7f53d00b3ad0 0x7f53d00cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.591+0000 7f53cfe00640 1 --2- 172.21.15.162:0/946494216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d0143c70 0x7f53d0070d20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.591+0000 7f53cfe00640 1 -- 172.21.15.162:0/946494216 >> 172.21.15.162:0/946494216 conn(0x7f53d006aa20 msgr2=0x7f53d006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:46.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.591+0000 7f53cfe00640 1 -- 172.21.15.162:0/946494216 shutdown_connections 2024-01-20T11:08:46.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.591+0000 7f53cfe00640 1 -- 172.21.15.162:0/946494216 wait complete. 2024-01-20T11:08:46.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.593+0000 7f53cfe00640 1 Processor -- start 2024-01-20T11:08:46.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.593+0000 7f53cfe00640 1 -- start start 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cfe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d00b3ad0 0x7f53d01e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d00cf960 0x7f53d00c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cfe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53d0143c70 0x7f53d01f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c66c0 con 0x7f53d00cf960 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cfe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c69a0 con 0x7f53d0143c70 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cfe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c6c80 con 0x7f53d00b3ad0 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53c5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d00cf960 0x7f53d00c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53c5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d00cf960 0x7f53d00c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58100/0 (socket says 172.21.15.162:58100) 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53c5e00640 1 -- 172.21.15.162:0/3130904163 learned_addr learned my addr 172.21.15.162:0/3130904163 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cea00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d00b3ad0 0x7f53d01e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53cf400640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53d0143c70 0x7f53d01f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53c5e00640 1 -- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d00b3ad0 msgr2=0x7f53d01e39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.594+0000 7f53c5e00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d00b3ad0 0x7f53d01e39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53c5e00640 1 -- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53d0143c70 msgr2=0x7f53d01f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53c5e00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53d0143c70 0x7f53d01f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53c5e00640 1 -- 172.21.15.162:0/3130904163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00094d0 con 0x7f53d00cf960 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53cf400640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53d0143c70 0x7f53d01f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53c5e00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d00cf960 0x7f53d00c51f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ce10 tx=0x7f53b800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53c7400640 1 -- 172.21.15.162:0/3130904163 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8003b90 con 0x7f53d00cf960 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53c7400640 1 -- 172.21.15.162:0/3130904163 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8003cf0 con 0x7f53d00cf960 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53c7400640 1 -- 172.21.15.162:0/3130904163 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8003ea0 con 0x7f53d00cf960 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d00c6f60 con 0x7f53d00cf960 2024-01-20T11:08:46.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.595+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00c6230 con 0x7f53d00cf960 2024-01-20T11:08:46.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.597+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d00c7480 con 0x7f53d00cf960 2024-01-20T11:08:46.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.597+0000 7f53c7400640 1 -- 172.21.15.162:0/3130904163 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f53b8004240 con 0x7f53d00cf960 2024-01-20T11:08:46.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.598+0000 7f53c7400640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f53a806aed0 0x7f53a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:46.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.598+0000 7f53c7400640 1 -- 172.21.15.162:0/3130904163 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53b8012070 con 0x7f53d00cf960 2024-01-20T11:08:46.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.599+0000 7f53cea00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f53a806aed0 0x7f53a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:46.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.599+0000 7f53cea00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f53a806aed0 0x7f53a806d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53c0036000 tx=0x7f53c003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:46.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.602+0000 7f53c7400640 1 -- 172.21.15.162:0/3130904163 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f53d00c7480 con 0x7f53d00cf960 2024-01-20T11:08:46.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.788+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53d00c64b0 con 0x7f53a806aed0 2024-01-20T11:08:46.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.810+0000 7f53c7400640 1 -- 172.21.15.162:0/3130904163 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286713 (secure 0 0 0) 0x7f53d00c64b0 con 0x7f53a806aed0 2024-01-20T11:08:46.815 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:46.817 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.816+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f53a806aed0 msgr2=0x7f53a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.816+0000 7f53cfe00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f53a806aed0 0x7f53a806d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53c0036000 tx=0x7f53c003c040 comp rx=0 tx=0).stop 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.816+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d00cf960 msgr2=0x7f53d00c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.816+0000 7f53cfe00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d00cf960 0x7f53d00c51f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ce10 tx=0x7f53b800a660 comp rx=0 tx=0).stop 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 shutdown_connections 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f53a806aed0 0x7f53a806d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53d0143c70 0x7f53d01f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d00cf960 0x7f53d00c51f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 --2- 172.21.15.162:0/3130904163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d00b3ad0 0x7f53d01e39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 >> 172.21.15.162:0/3130904163 conn(0x7f53d006aa20 msgr2=0x7f53d00b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 shutdown_connections 2024-01-20T11:08:46.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:46.817+0000 7f53cfe00640 1 -- 172.21.15.162:0/3130904163 wait complete. 2024-01-20T11:08:46.835 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-01-20T11:08:45.603109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220588,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754132,"statfs":{"total":773094113280,"available":772868231168,"internally_reserved":0,"allocated":4497408,"data_stored":2463356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001567"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583265+0000","last_change":"2024-01-20T11:08:41.989816+0000","last_active":"2024-01-20T11:08:43.583265+0000","last_peered":"2024-01-20T11:08:43.583265+0000","last_clean":"2024-01-20T11:08:43.583265+0000","last_became_active":"2024-01-20T11:08:41.989587+0000","last_became_peered":"2024-01-20T11:08:41.989587+0000","last_unstale":"2024-01-20T11:08:43.583265+0000","last_undegraded":"2024-01-20T11:08:43.583265+0000","last_fullsized":"2024-01-20T11:08:43.583265+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:06:05.559719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583135+0000","last_change":"2024-01-20T11:08:41.992696+0000","last_active":"2024-01-20T11:08:43.583135+0000","last_peered":"2024-01-20T11:08:43.583135+0000","last_clean":"2024-01-20T11:08:43.583135+0000","last_became_active":"2024-01-20T11:08:41.991982+0000","last_became_peered":"2024-01-20T11:08:41.991982+0000","last_unstale":"2024-01-20T11:08:43.583135+0000","last_undegraded":"2024-01-20T11:08:43.583135+0000","last_fullsized":"2024-01-20T11:08:43.583135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:10:47.923238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978295+0000","last_change":"2024-01-20T11:08:41.995812+0000","last_active":"2024-01-20T11:08:42.978295+0000","last_peered":"2024-01-20T11:08:42.978295+0000","last_clean":"2024-01-20T11:08:42.978295+0000","last_became_active":"2024-01-20T11:08:41.995593+0000","last_became_peered":"2024-01-20T11:08:41.995593+0000","last_unstale":"2024-01-20T11:08:42.978295+0000","last_undegraded":"2024-01-20T11:08:42.978295+0000","last_fullsized":"2024-01-20T11:08:42.978295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:50.537772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.586293+0000","last_change":"2024-01-20T11:08:41.981781+0000","last_active":"2024-01-20T11:08:43.586293+0000","last_peered":"2024-01-20T11:08:43.586293+0000","last_clean":"2024-01-20T11:08:43.586293+0000","last_became_active":"2024-01-20T11:08:41.981494+0000","last_became_peered":"2024-01-20T11:08:41.981494+0000","last_unstale":"2024-01-20T11:08:43.586293+0000","last_undegraded":"2024-01-20T11:08:43.586293+0000","last_fullsized":"2024-01-20T11:08:43.586293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:50:32.248265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583612+0000","last_change":"2024-01-20T11:08:41.999595+0000","last_active":"2024-01-20T11:08:43.583612+0000","last_peered":"2024-01-20T11:08:43.583612+0000","last_clean":"2024-01-20T11:08:43.583612+0000","last_became_active":"2024-01-20T11:08:41.999353+0000","last_became_peered":"2024-01-20T11:08:41.999353+0000","last_unstale":"2024-01-20T11:08:43.583612+0000","last_undegraded":"2024-01-20T11:08:43.583612+0000","last_fullsized":"2024-01-20T11:08:43.583612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:22.038815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582587+0000","last_change":"2024-01-20T11:08:41.993444+0000","last_active":"2024-01-20T11:08:43.582587+0000","last_peered":"2024-01-20T11:08:43.582587+0000","last_clean":"2024-01-20T11:08:43.582587+0000","last_became_active":"2024-01-20T11:08:41.991639+0000","last_became_peered":"2024-01-20T11:08:41.991639+0000","last_unstale":"2024-01-20T11:08:43.582587+0000","last_undegraded":"2024-01-20T11:08:43.582587+0000","last_fullsized":"2024-01-20T11:08:43.582587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:56:45.487833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976661+0000","last_change":"2024-01-20T11:08:41.982135+0000","last_active":"2024-01-20T11:08:42.976661+0000","last_peered":"2024-01-20T11:08:42.976661+0000","last_clean":"2024-01-20T11:08:42.976661+0000","last_became_active":"2024-01-20T11:08:41.981842+0000","last_became_peered":"2024-01-20T11:08:41.981842+0000","last_unstale":"2024-01-20T11:08:42.976661+0000","last_undegraded":"2024-01-20T11:08:42.976661+0000","last_fullsized":"2024-01-20T11:08:42.976661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:56:45.487833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976141+0000","last_change":"2024-01-20T11:08:41.983061+0000","last_active":"2024-01-20T11:08:42.976141+0000","last_peered":"2024-01-20T11:08:42.976141+0000","last_clean":"2024-01-20T11:08:42.976141+0000","last_became_active":"2024-01-20T11:08:41.982770+0000","last_became_peered":"2024-01-20T11:08:41.982770+0000","last_unstale":"2024-01-20T11:08:42.976141+0000","last_undegraded":"2024-01-20T11:08:42.976141+0000","last_fullsized":"2024-01-20T11:08:42.976141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:30:45.424657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582904+0000","last_change":"2024-01-20T11:08:41.991154+0000","last_active":"2024-01-20T11:08:43.582904+0000","last_peered":"2024-01-20T11:08:43.582904+0000","last_clean":"2024-01-20T11:08:43.582904+0000","last_became_active":"2024-01-20T11:08:41.990859+0000","last_became_peered":"2024-01-20T11:08:41.990859+0000","last_unstale":"2024-01-20T11:08:43.582904+0000","last_undegraded":"2024-01-20T11:08:43.582904+0000","last_fullsized":"2024-01-20T11:08:43.582904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:46:23.271209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.585169+0000","last_change":"2024-01-20T11:08:42.001509+0000","last_active":"2024-01-20T11:08:43.585169+0000","last_peered":"2024-01-20T11:08:43.585169+0000","last_clean":"2024-01-20T11:08:43.585169+0000","last_became_active":"2024-01-20T11:08:42.000647+0000","last_became_peered":"2024-01-20T11:08:42.000647+0000","last_unstale":"2024-01-20T11:08:43.585169+0000","last_undegraded":"2024-01-20T11:08:43.585169+0000","last_fullsized":"2024-01-20T11:08:43.585169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:46:23.271209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977079+0000","last_change":"2024-01-20T11:08:41.996624+0000","last_active":"2024-01-20T11:08:42.977079+0000","last_peered":"2024-01-20T11:08:42.977079+0000","last_clean":"2024-01-20T11:08:42.977079+0000","last_became_active":"2024-01-20T11:08:41.996312+0000","last_became_peered":"2024-01-20T11:08:41.996312+0000","last_unstale":"2024-01-20T11:08:42.977079+0000","last_undegraded":"2024-01-20T11:08:42.977079+0000","last_fullsized":"2024-01-20T11:08:42.977079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:10:47.923238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978062+0000","last_change":"2024-01-20T11:08:42.000132+0000","last_active":"2024-01-20T11:08:42.978062+0000","last_peered":"2024-01-20T11:08:42.978062+0000","last_clean":"2024-01-20T11:08:42.978062+0000","last_became_active":"2024-01-20T11:08:41.999824+0000","last_became_peered":"2024-01-20T11:08:41.999824+0000","last_unstale":"2024-01-20T11:08:42.978062+0000","last_undegraded":"2024-01-20T11:08:42.978062+0000","last_fullsized":"2024-01-20T11:08:42.978062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:10:47.923238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583515+0000","last_change":"2024-01-20T11:08:41.990047+0000","last_active":"2024-01-20T11:08:43.583515+0000","last_peered":"2024-01-20T11:08:43.583515+0000","last_clean":"2024-01-20T11:08:43.583515+0000","last_became_active":"2024-01-20T11:08:41.989757+0000","last_became_peered":"2024-01-20T11:08:41.989757+0000","last_unstale":"2024-01-20T11:08:43.583515+0000","last_undegraded":"2024-01-20T11:08:43.583515+0000","last_fullsized":"2024-01-20T11:08:43.583515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:28.624552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582897+0000","last_change":"2024-01-20T11:08:41.992963+0000","last_active":"2024-01-20T11:08:43.582897+0000","last_peered":"2024-01-20T11:08:43.582897+0000","last_clean":"2024-01-20T11:08:43.582897+0000","last_became_active":"2024-01-20T11:08:41.992222+0000","last_became_peered":"2024-01-20T11:08:41.992222+0000","last_unstale":"2024-01-20T11:08:43.582897+0000","last_undegraded":"2024-01-20T11:08:43.582897+0000","last_fullsized":"2024-01-20T11:08:43.582897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:00:58.308363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977010+0000","last_change":"2024-01-20T11:08:41.979476+0000","last_active":"2024-01-20T11:08:42.977010+0000","last_peered":"2024-01-20T11:08:42.977010+0000","last_clean":"2024-01-20T11:08:42.977010+0000","last_became_active":"2024-01-20T11:08:41.977977+0000","last_became_peered":"2024-01-20T11:08:41.977977+0000","last_unstale":"2024-01-20T11:08:42.977010+0000","last_undegraded":"2024-01-20T11:08:42.977010+0000","last_fullsized":"2024-01-20T11:08:42.977010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:15.815638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977004+0000","last_change":"2024-01-20T11:08:41.992387+0000","last_active":"2024-01-20T11:08:42.977004+0000","last_peered":"2024-01-20T11:08:42.977004+0000","last_clean":"2024-01-20T11:08:42.977004+0000","last_became_active":"2024-01-20T11:08:41.992123+0000","last_became_peered":"2024-01-20T11:08:41.992123+0000","last_unstale":"2024-01-20T11:08:42.977004+0000","last_undegraded":"2024-01-20T11:08:42.977004+0000","last_fullsized":"2024-01-20T11:08:42.977004+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:00:58.308363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977697+0000","last_change":"2024-01-20T11:08:41.985018+0000","last_active":"2024-01-20T11:08:42.977697+0000","last_peered":"2024-01-20T11:08:42.977697+0000","last_clean":"2024-01-20T11:08:42.977697+0000","last_became_active":"2024-01-20T11:08:41.984691+0000","last_became_peered":"2024-01-20T11:08:41.984691+0000","last_unstale":"2024-01-20T11:08:42.977697+0000","last_undegraded":"2024-01-20T11:08:42.977697+0000","last_fullsized":"2024-01-20T11:08:42.977697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:33:01.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583480+0000","last_change":"2024-01-20T11:08:41.986114+0000","last_active":"2024-01-20T11:08:43.583480+0000","last_peered":"2024-01-20T11:08:43.583480+0000","last_clean":"2024-01-20T11:08:43.583480+0000","last_became_active":"2024-01-20T11:08:41.985808+0000","last_became_peered":"2024-01-20T11:08:41.985808+0000","last_unstale":"2024-01-20T11:08:43.583480+0000","last_undegraded":"2024-01-20T11:08:43.583480+0000","last_fullsized":"2024-01-20T11:08:43.583480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:17:54.363561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582350+0000","last_change":"2024-01-20T11:08:42.005062+0000","last_active":"2024-01-20T11:08:43.582350+0000","last_peered":"2024-01-20T11:08:43.582350+0000","last_clean":"2024-01-20T11:08:43.582350+0000","last_became_active":"2024-01-20T11:08:42.004155+0000","last_became_peered":"2024-01-20T11:08:42.004155+0000","last_unstale":"2024-01-20T11:08:43.582350+0000","last_undegraded":"2024-01-20T11:08:43.582350+0000","last_fullsized":"2024-01-20T11:08:43.582350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:15.815638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584902+0000","last_change":"2024-01-20T11:08:41.968261+0000","last_active":"2024-01-20T11:08:43.584902+0000","last_peered":"2024-01-20T11:08:43.584902+0000","last_clean":"2024-01-20T11:08:43.584902+0000","last_became_active":"2024-01-20T11:08:41.967546+0000","last_became_peered":"2024-01-20T11:08:41.967546+0000","last_unstale":"2024-01-20T11:08:43.584902+0000","last_undegraded":"2024-01-20T11:08:43.584902+0000","last_fullsized":"2024-01-20T11:08:43.584902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:12:45.642500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582536+0000","last_change":"2024-01-20T11:08:41.977075+0000","last_active":"2024-01-20T11:08:43.582536+0000","last_peered":"2024-01-20T11:08:43.582536+0000","last_clean":"2024-01-20T11:08:43.582536+0000","last_became_active":"2024-01-20T11:08:41.976397+0000","last_became_peered":"2024-01-20T11:08:41.976397+0000","last_unstale":"2024-01-20T11:08:43.582536+0000","last_undegraded":"2024-01-20T11:08:43.582536+0000","last_fullsized":"2024-01-20T11:08:43.582536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:01:44.129587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582690+0000","last_change":"2024-01-20T11:08:42.000200+0000","last_active":"2024-01-20T11:08:43.582690+0000","last_peered":"2024-01-20T11:08:43.582690+0000","last_clean":"2024-01-20T11:08:43.582690+0000","last_became_active":"2024-01-20T11:08:41.999250+0000","last_became_peered":"2024-01-20T11:08:41.999250+0000","last_unstale":"2024-01-20T11:08:43.582690+0000","last_undegraded":"2024-01-20T11:08:43.582690+0000","last_fullsized":"2024-01-20T11:08:43.582690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:21:58.762316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.973257+0000","last_change":"2024-01-20T11:08:41.966346+0000","last_active":"2024-01-20T11:08:42.973257+0000","last_peered":"2024-01-20T11:08:42.973257+0000","last_clean":"2024-01-20T11:08:42.973257+0000","last_became_active":"2024-01-20T11:08:41.965557+0000","last_became_peered":"2024-01-20T11:08:41.965557+0000","last_unstale":"2024-01-20T11:08:42.973257+0000","last_undegraded":"2024-01-20T11:08:42.973257+0000","last_fullsized":"2024-01-20T11:08:42.973257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:04:43.396527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976166+0000","last_change":"2024-01-20T11:08:41.967767+0000","last_active":"2024-01-20T11:08:42.976166+0000","last_peered":"2024-01-20T11:08:42.976166+0000","last_clean":"2024-01-20T11:08:42.976166+0000","last_became_active":"2024-01-20T11:08:41.967034+0000","last_became_peered":"2024-01-20T11:08:41.967034+0000","last_unstale":"2024-01-20T11:08:42.976166+0000","last_undegraded":"2024-01-20T11:08:42.976166+0000","last_fullsized":"2024-01-20T11:08:42.976166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:27:46.531326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.585658+0000","last_change":"2024-01-20T11:08:41.985863+0000","last_active":"2024-01-20T11:08:43.585658+0000","last_peered":"2024-01-20T11:08:43.585658+0000","last_clean":"2024-01-20T11:08:43.585658+0000","last_became_active":"2024-01-20T11:08:41.985590+0000","last_became_peered":"2024-01-20T11:08:41.985590+0000","last_unstale":"2024-01-20T11:08:43.585658+0000","last_undegraded":"2024-01-20T11:08:43.585658+0000","last_fullsized":"2024-01-20T11:08:43.585658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:08.878331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583800+0000","last_change":"2024-01-20T11:08:41.992698+0000","last_active":"2024-01-20T11:08:43.583800+0000","last_peered":"2024-01-20T11:08:43.583800+0000","last_clean":"2024-01-20T11:08:43.583800+0000","last_became_active":"2024-01-20T11:08:41.992421+0000","last_became_peered":"2024-01-20T11:08:41.992421+0000","last_unstale":"2024-01-20T11:08:43.583800+0000","last_undegraded":"2024-01-20T11:08:43.583800+0000","last_fullsized":"2024-01-20T11:08:43.583800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:33:01.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583996+0000","last_change":"2024-01-20T11:08:41.986563+0000","last_active":"2024-01-20T11:08:43.583996+0000","last_peered":"2024-01-20T11:08:43.583996+0000","last_clean":"2024-01-20T11:08:43.583996+0000","last_became_active":"2024-01-20T11:08:41.986320+0000","last_became_peered":"2024-01-20T11:08:41.986320+0000","last_unstale":"2024-01-20T11:08:43.583996+0000","last_undegraded":"2024-01-20T11:08:43.583996+0000","last_fullsized":"2024-01-20T11:08:43.583996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:06:06.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978417+0000","last_change":"2024-01-20T11:08:41.978748+0000","last_active":"2024-01-20T11:08:42.978417+0000","last_peered":"2024-01-20T11:08:42.978417+0000","last_clean":"2024-01-20T11:08:42.978417+0000","last_became_active":"2024-01-20T11:08:41.978442+0000","last_became_peered":"2024-01-20T11:08:41.978442+0000","last_unstale":"2024-01-20T11:08:42.978417+0000","last_undegraded":"2024-01-20T11:08:42.978417+0000","last_fullsized":"2024-01-20T11:08:42.978417+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:17:54.363561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582329+0000","last_change":"2024-01-20T11:08:42.002922+0000","last_active":"2024-01-20T11:08:43.582329+0000","last_peered":"2024-01-20T11:08:43.582329+0000","last_clean":"2024-01-20T11:08:43.582329+0000","last_became_active":"2024-01-20T11:08:42.002082+0000","last_became_peered":"2024-01-20T11:08:42.002082+0000","last_unstale":"2024-01-20T11:08:43.582329+0000","last_undegraded":"2024-01-20T11:08:43.582329+0000","last_fullsized":"2024-01-20T11:08:43.582329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:06:06.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976597+0000","last_change":"2024-01-20T11:08:41.978599+0000","last_active":"2024-01-20T11:08:42.976597+0000","last_peered":"2024-01-20T11:08:42.976597+0000","last_clean":"2024-01-20T11:08:42.976597+0000","last_became_active":"2024-01-20T11:08:41.978282+0000","last_became_peered":"2024-01-20T11:08:41.978282+0000","last_unstale":"2024-01-20T11:08:42.976597+0000","last_undegraded":"2024-01-20T11:08:42.976597+0000","last_fullsized":"2024-01-20T11:08:42.976597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:15.815638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581243+0000","last_change":"2024-01-20T11:08:41.984359+0000","last_active":"2024-01-20T11:08:43.581243+0000","last_peered":"2024-01-20T11:08:43.581243+0000","last_clean":"2024-01-20T11:08:43.581243+0000","last_became_active":"2024-01-20T11:08:41.984038+0000","last_became_peered":"2024-01-20T11:08:41.984038+0000","last_unstale":"2024-01-20T11:08:43.581243+0000","last_undegraded":"2024-01-20T11:08:43.581243+0000","last_fullsized":"2024-01-20T11:08:43.581243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:10:15.246709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976348+0000","last_change":"2024-01-20T11:08:41.974016+0000","last_active":"2024-01-20T11:08:42.976348+0000","last_peered":"2024-01-20T11:08:42.976348+0000","last_clean":"2024-01-20T11:08:42.976348+0000","last_became_active":"2024-01-20T11:08:41.973615+0000","last_became_peered":"2024-01-20T11:08:41.973615+0000","last_unstale":"2024-01-20T11:08:42.976348+0000","last_undegraded":"2024-01-20T11:08:42.976348+0000","last_fullsized":"2024-01-20T11:08:42.976348+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:01:01.041378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974336+0000","last_change":"2024-01-20T11:08:41.976140+0000","last_active":"2024-01-20T11:08:42.974336+0000","last_peered":"2024-01-20T11:08:42.974336+0000","last_clean":"2024-01-20T11:08:42.974336+0000","last_became_active":"2024-01-20T11:08:41.975849+0000","last_became_peered":"2024-01-20T11:08:41.975849+0000","last_unstale":"2024-01-20T11:08:42.974336+0000","last_undegraded":"2024-01-20T11:08:42.974336+0000","last_fullsized":"2024-01-20T11:08:42.974336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:37:52.753754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.003673+0000","last_change":"2024-01-20T11:08:40.617984+0000","last_active":"2024-01-20T11:08:42.003673+0000","last_peered":"2024-01-20T11:08:42.003673+0000","last_clean":"2024-01-20T11:08:42.003673+0000","last_became_active":"2024-01-20T11:08:40.617702+0000","last_became_peered":"2024-01-20T11:08:40.617702+0000","last_unstale":"2024-01-20T11:08:42.003673+0000","last_undegraded":"2024-01-20T11:08:42.003673+0000","last_fullsized":"2024-01-20T11:08:42.003673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:50:37.063034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583507+0000","last_change":"2024-01-20T11:08:41.986129+0000","last_active":"2024-01-20T11:08:43.583507+0000","last_peered":"2024-01-20T11:08:43.583507+0000","last_clean":"2024-01-20T11:08:43.583507+0000","last_became_active":"2024-01-20T11:08:41.985704+0000","last_became_peered":"2024-01-20T11:08:41.985704+0000","last_unstale":"2024-01-20T11:08:43.583507+0000","last_undegraded":"2024-01-20T11:08:43.583507+0000","last_fullsized":"2024-01-20T11:08:43.583507+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:18:34.682622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974427+0000","last_change":"2024-01-20T11:08:40.613149+0000","last_active":"2024-01-20T11:08:42.974427+0000","last_peered":"2024-01-20T11:08:42.974427+0000","last_clean":"2024-01-20T11:08:42.974427+0000","last_became_active":"2024-01-20T11:08:40.612848+0000","last_became_peered":"2024-01-20T11:08:40.612848+0000","last_unstale":"2024-01-20T11:08:42.974427+0000","last_undegraded":"2024-01-20T11:08:42.974427+0000","last_fullsized":"2024-01-20T11:08:42.974427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:08.632328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583489+0000","last_change":"2024-01-20T11:08:41.999568+0000","last_active":"2024-01-20T11:08:43.583489+0000","last_peered":"2024-01-20T11:08:43.583489+0000","last_clean":"2024-01-20T11:08:43.583489+0000","last_became_active":"2024-01-20T11:08:41.999218+0000","last_became_peered":"2024-01-20T11:08:41.999218+0000","last_unstale":"2024-01-20T11:08:43.583489+0000","last_undegraded":"2024-01-20T11:08:43.583489+0000","last_fullsized":"2024-01-20T11:08:43.583489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:08.878331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.010731+0000","last_change":"2024-01-20T11:08:40.600676+0000","last_active":"2024-01-20T11:08:42.010731+0000","last_peered":"2024-01-20T11:08:42.010731+0000","last_clean":"2024-01-20T11:08:42.010731+0000","last_became_active":"2024-01-20T11:08:40.600167+0000","last_became_peered":"2024-01-20T11:08:40.600167+0000","last_unstale":"2024-01-20T11:08:42.010731+0000","last_undegraded":"2024-01-20T11:08:42.010731+0000","last_fullsized":"2024-01-20T11:08:42.010731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:59:31.263057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584215+0000","last_change":"2024-01-20T11:08:41.986520+0000","last_active":"2024-01-20T11:08:43.584215+0000","last_peered":"2024-01-20T11:08:43.584215+0000","last_clean":"2024-01-20T11:08:43.584215+0000","last_became_active":"2024-01-20T11:08:41.986024+0000","last_became_peered":"2024-01-20T11:08:41.986024+0000","last_unstale":"2024-01-20T11:08:43.584215+0000","last_undegraded":"2024-01-20T11:08:43.584215+0000","last_fullsized":"2024-01-20T11:08:43.584215+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:21:58.762316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.004799+0000","last_change":"2024-01-20T11:08:40.598561+0000","last_active":"2024-01-20T11:08:42.004799+0000","last_peered":"2024-01-20T11:08:42.004799+0000","last_clean":"2024-01-20T11:08:42.004799+0000","last_became_active":"2024-01-20T11:08:40.598283+0000","last_became_peered":"2024-01-20T11:08:40.598283+0000","last_unstale":"2024-01-20T11:08:42.004799+0000","last_undegraded":"2024-01-20T11:08:42.004799+0000","last_fullsized":"2024-01-20T11:08:42.004799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:30:42.327348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978272+0000","last_change":"2024-01-20T11:08:41.973464+0000","last_active":"2024-01-20T11:08:42.978272+0000","last_peered":"2024-01-20T11:08:42.978272+0000","last_clean":"2024-01-20T11:08:42.978272+0000","last_became_active":"2024-01-20T11:08:41.972835+0000","last_became_peered":"2024-01-20T11:08:41.972835+0000","last_unstale":"2024-01-20T11:08:42.978272+0000","last_undegraded":"2024-01-20T11:08:42.978272+0000","last_fullsized":"2024-01-20T11:08:42.978272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:28:37.409334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.009415+0000","last_change":"2024-01-20T11:08:40.614625+0000","last_active":"2024-01-20T11:08:42.009415+0000","last_peered":"2024-01-20T11:08:42.009415+0000","last_clean":"2024-01-20T11:08:42.009415+0000","last_became_active":"2024-01-20T11:08:40.613996+0000","last_became_peered":"2024-01-20T11:08:40.613996+0000","last_unstale":"2024-01-20T11:08:42.009415+0000","last_undegraded":"2024-01-20T11:08:42.009415+0000","last_fullsized":"2024-01-20T11:08:42.009415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:16.378799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977766+0000","last_change":"2024-01-20T11:08:41.979523+0000","last_active":"2024-01-20T11:08:42.977766+0000","last_peered":"2024-01-20T11:08:42.977766+0000","last_clean":"2024-01-20T11:08:42.977766+0000","last_became_active":"2024-01-20T11:08:41.979202+0000","last_became_peered":"2024-01-20T11:08:41.979202+0000","last_unstale":"2024-01-20T11:08:42.977766+0000","last_undegraded":"2024-01-20T11:08:42.977766+0000","last_fullsized":"2024-01-20T11:08:42.977766+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:56:45.487833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.002589+0000","last_change":"2024-01-20T11:08:40.613223+0000","last_active":"2024-01-20T11:08:42.002589+0000","last_peered":"2024-01-20T11:08:42.002589+0000","last_clean":"2024-01-20T11:08:42.002589+0000","last_became_active":"2024-01-20T11:08:40.612939+0000","last_became_peered":"2024-01-20T11:08:40.612939+0000","last_unstale":"2024-01-20T11:08:42.002589+0000","last_undegraded":"2024-01-20T11:08:42.002589+0000","last_fullsized":"2024-01-20T11:08:42.002589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:50:07.883678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581817+0000","last_change":"2024-01-20T11:08:41.985123+0000","last_active":"2024-01-20T11:08:43.581817+0000","last_peered":"2024-01-20T11:08:43.581817+0000","last_clean":"2024-01-20T11:08:43.581817+0000","last_became_active":"2024-01-20T11:08:41.984850+0000","last_became_peered":"2024-01-20T11:08:41.984850+0000","last_unstale":"2024-01-20T11:08:43.581817+0000","last_undegraded":"2024-01-20T11:08:43.581817+0000","last_fullsized":"2024-01-20T11:08:43.581817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:08.780431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.984010+0000","last_change":"2024-01-20T11:08:40.601786+0000","last_active":"2024-01-20T11:08:41.984010+0000","last_peered":"2024-01-20T11:08:41.984010+0000","last_clean":"2024-01-20T11:08:41.984010+0000","last_became_active":"2024-01-20T11:08:40.601568+0000","last_became_peered":"2024-01-20T11:08:40.601568+0000","last_unstale":"2024-01-20T11:08:41.984010+0000","last_undegraded":"2024-01-20T11:08:41.984010+0000","last_fullsized":"2024-01-20T11:08:41.984010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:04:42.390537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581504+0000","last_change":"2024-01-20T11:08:41.990172+0000","last_active":"2024-01-20T11:08:43.581504+0000","last_peered":"2024-01-20T11:08:43.581504+0000","last_clean":"2024-01-20T11:08:43.581504+0000","last_became_active":"2024-01-20T11:08:41.988192+0000","last_became_peered":"2024-01-20T11:08:41.988192+0000","last_unstale":"2024-01-20T11:08:43.581504+0000","last_undegraded":"2024-01-20T11:08:43.581504+0000","last_fullsized":"2024-01-20T11:08:43.581504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:56:01.876027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.973346+0000","last_change":"2024-01-20T11:08:40.607493+0000","last_active":"2024-01-20T11:08:41.973346+0000","last_peered":"2024-01-20T11:08:41.973346+0000","last_clean":"2024-01-20T11:08:41.973346+0000","last_became_active":"2024-01-20T11:08:40.607100+0000","last_became_peered":"2024-01-20T11:08:40.607100+0000","last_unstale":"2024-01-20T11:08:41.973346+0000","last_undegraded":"2024-01-20T11:08:41.973346+0000","last_fullsized":"2024-01-20T11:08:41.973346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:02:11.948279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978440+0000","last_change":"2024-01-20T11:08:41.998783+0000","last_active":"2024-01-20T11:08:42.978440+0000","last_peered":"2024-01-20T11:08:42.978440+0000","last_clean":"2024-01-20T11:08:42.978440+0000","last_became_active":"2024-01-20T11:08:41.998511+0000","last_became_peered":"2024-01-20T11:08:41.998511+0000","last_unstale":"2024-01-20T11:08:42.978440+0000","last_undegraded":"2024-01-20T11:08:42.978440+0000","last_fullsized":"2024-01-20T11:08:42.978440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:59:51.869423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.001664+0000","last_change":"2024-01-20T11:08:40.619833+0000","last_active":"2024-01-20T11:08:42.001664+0000","last_peered":"2024-01-20T11:08:42.001664+0000","last_clean":"2024-01-20T11:08:42.001664+0000","last_became_active":"2024-01-20T11:08:40.619634+0000","last_became_peered":"2024-01-20T11:08:40.619634+0000","last_unstale":"2024-01-20T11:08:42.001664+0000","last_undegraded":"2024-01-20T11:08:42.001664+0000","last_fullsized":"2024-01-20T11:08:42.001664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:01:00.035388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584560+0000","last_change":"2024-01-20T11:08:42.001299+0000","last_active":"2024-01-20T11:08:43.584560+0000","last_peered":"2024-01-20T11:08:43.584560+0000","last_clean":"2024-01-20T11:08:43.584560+0000","last_became_active":"2024-01-20T11:08:41.999155+0000","last_became_peered":"2024-01-20T11:08:41.999155+0000","last_unstale":"2024-01-20T11:08:43.584560+0000","last_undegraded":"2024-01-20T11:08:43.584560+0000","last_fullsized":"2024-01-20T11:08:43.584560+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:42:11.154049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974618+0000","last_change":"2024-01-20T11:08:40.604664+0000","last_active":"2024-01-20T11:08:42.974618+0000","last_peered":"2024-01-20T11:08:42.974618+0000","last_clean":"2024-01-20T11:08:42.974618+0000","last_became_active":"2024-01-20T11:08:40.604346+0000","last_became_peered":"2024-01-20T11:08:40.604346+0000","last_unstale":"2024-01-20T11:08:42.974618+0000","last_undegraded":"2024-01-20T11:08:42.974618+0000","last_fullsized":"2024-01-20T11:08:42.974618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:23:06.341358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.584279+0000","last_change":"2024-01-20T11:08:41.997680+0000","last_active":"2024-01-20T11:08:43.584279+0000","last_peered":"2024-01-20T11:08:43.584279+0000","last_clean":"2024-01-20T11:08:43.584279+0000","last_became_active":"2024-01-20T11:08:41.997336+0000","last_became_peered":"2024-01-20T11:08:41.997336+0000","last_unstale":"2024-01-20T11:08:43.584279+0000","last_undegraded":"2024-01-20T11:08:43.584279+0000","last_fullsized":"2024-01-20T11:08:43.584279+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:59:51.869423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.001719+0000","last_change":"2024-01-20T11:08:40.620003+0000","last_active":"2024-01-20T11:08:42.001719+0000","last_peered":"2024-01-20T11:08:42.001719+0000","last_clean":"2024-01-20T11:08:42.001719+0000","last_became_active":"2024-01-20T11:08:40.619634+0000","last_became_peered":"2024-01-20T11:08:40.619634+0000","last_unstale":"2024-01-20T11:08:42.001719+0000","last_undegraded":"2024-01-20T11:08:42.001719+0000","last_fullsized":"2024-01-20T11:08:42.001719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:18:33.676633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977921+0000","last_change":"2024-01-20T11:08:42.001875+0000","last_active":"2024-01-20T11:08:42.977921+0000","last_peered":"2024-01-20T11:08:42.977921+0000","last_clean":"2024-01-20T11:08:42.977921+0000","last_became_active":"2024-01-20T11:08:42.001486+0000","last_became_peered":"2024-01-20T11:08:42.001486+0000","last_unstale":"2024-01-20T11:08:42.977921+0000","last_undegraded":"2024-01-20T11:08:42.977921+0000","last_fullsized":"2024-01-20T11:08:42.977921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:00:58.308363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.014765+0000","last_change":"2024-01-20T11:08:40.602465+0000","last_active":"2024-01-20T11:08:42.014765+0000","last_peered":"2024-01-20T11:08:42.014765+0000","last_clean":"2024-01-20T11:08:42.014765+0000","last_became_active":"2024-01-20T11:08:40.602167+0000","last_became_peered":"2024-01-20T11:08:40.602167+0000","last_unstale":"2024-01-20T11:08:42.014765+0000","last_undegraded":"2024-01-20T11:08:42.014765+0000","last_fullsized":"2024-01-20T11:08:42.014765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:35:02.616750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581640+0000","last_change":"2024-01-20T11:08:41.982473+0000","last_active":"2024-01-20T11:08:43.581640+0000","last_peered":"2024-01-20T11:08:43.581640+0000","last_clean":"2024-01-20T11:08:43.581640+0000","last_became_active":"2024-01-20T11:08:41.982087+0000","last_became_peered":"2024-01-20T11:08:41.982087+0000","last_unstale":"2024-01-20T11:08:43.581640+0000","last_undegraded":"2024-01-20T11:08:43.581640+0000","last_fullsized":"2024-01-20T11:08:43.581640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:01:44.129587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.003762+0000","last_change":"2024-01-20T11:08:40.606370+0000","last_active":"2024-01-20T11:08:42.003762+0000","last_peered":"2024-01-20T11:08:42.003762+0000","last_clean":"2024-01-20T11:08:42.003762+0000","last_became_active":"2024-01-20T11:08:40.606012+0000","last_became_peered":"2024-01-20T11:08:40.606012+0000","last_unstale":"2024-01-20T11:08:42.003762+0000","last_undegraded":"2024-01-20T11:08:42.003762+0000","last_fullsized":"2024-01-20T11:08:42.003762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:27:51.880438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583206+0000","last_change":"2024-01-20T11:08:41.993660+0000","last_active":"2024-01-20T11:08:43.583206+0000","last_peered":"2024-01-20T11:08:43.583206+0000","last_clean":"2024-01-20T11:08:43.583206+0000","last_became_active":"2024-01-20T11:08:41.993166+0000","last_became_peered":"2024-01-20T11:08:41.993166+0000","last_unstale":"2024-01-20T11:08:43.583206+0000","last_undegraded":"2024-01-20T11:08:43.583206+0000","last_fullsized":"2024-01-20T11:08:43.583206+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:50.537772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.971886+0000","last_change":"2024-01-20T11:08:40.603518+0000","last_active":"2024-01-20T11:08:41.971886+0000","last_peered":"2024-01-20T11:08:41.971886+0000","last_clean":"2024-01-20T11:08:41.971886+0000","last_became_active":"2024-01-20T11:08:40.603213+0000","last_became_peered":"2024-01-20T11:08:40.603213+0000","last_unstale":"2024-01-20T11:08:41.971886+0000","last_undegraded":"2024-01-20T11:08:41.971886+0000","last_fullsized":"2024-01-20T11:08:41.971886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:27.618562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.976577+0000","last_change":"2024-01-20T11:08:41.972835+0000","last_active":"2024-01-20T11:08:42.976577+0000","last_peered":"2024-01-20T11:08:42.976577+0000","last_clean":"2024-01-20T11:08:42.976577+0000","last_became_active":"2024-01-20T11:08:41.972255+0000","last_became_peered":"2024-01-20T11:08:41.972255+0000","last_unstale":"2024-01-20T11:08:42.976577+0000","last_undegraded":"2024-01-20T11:08:42.976577+0000","last_fullsized":"2024-01-20T11:08:42.976577+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:27:46.531326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.983859+0000","last_change":"2024-01-20T11:08:40.615415+0000","last_active":"2024-01-20T11:08:41.983859+0000","last_peered":"2024-01-20T11:08:41.983859+0000","last_clean":"2024-01-20T11:08:41.983859+0000","last_became_active":"2024-01-20T11:08:40.615100+0000","last_became_peered":"2024-01-20T11:08:40.615100+0000","last_unstale":"2024-01-20T11:08:41.983859+0000","last_undegraded":"2024-01-20T11:08:41.983859+0000","last_fullsized":"2024-01-20T11:08:41.983859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:56:54.358889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582489+0000","last_change":"2024-01-20T11:08:41.982183+0000","last_active":"2024-01-20T11:08:43.582489+0000","last_peered":"2024-01-20T11:08:43.582489+0000","last_clean":"2024-01-20T11:08:43.582489+0000","last_became_active":"2024-01-20T11:08:41.981807+0000","last_became_peered":"2024-01-20T11:08:41.981807+0000","last_unstale":"2024-01-20T11:08:43.582489+0000","last_undegraded":"2024-01-20T11:08:43.582489+0000","last_fullsized":"2024-01-20T11:08:43.582489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:04:43.396527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.012730+0000","last_change":"2024-01-20T11:08:40.599936+0000","last_active":"2024-01-20T11:08:42.012730+0000","last_peered":"2024-01-20T11:08:42.012730+0000","last_clean":"2024-01-20T11:08:42.012730+0000","last_became_active":"2024-01-20T11:08:40.599652+0000","last_became_peered":"2024-01-20T11:08:40.599652+0000","last_unstale":"2024-01-20T11:08:42.012730+0000","last_undegraded":"2024-01-20T11:08:42.012730+0000","last_fullsized":"2024-01-20T11:08:42.012730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:10:14.240719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582211+0000","last_change":"2024-01-20T11:08:41.978266+0000","last_active":"2024-01-20T11:08:43.582211+0000","last_peered":"2024-01-20T11:08:43.582211+0000","last_clean":"2024-01-20T11:08:43.582211+0000","last_became_active":"2024-01-20T11:08:41.977955+0000","last_became_peered":"2024-01-20T11:08:41.977955+0000","last_unstale":"2024-01-20T11:08:43.582211+0000","last_undegraded":"2024-01-20T11:08:43.582211+0000","last_fullsized":"2024-01-20T11:08:43.582211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:56:01.876027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.012164+0000","last_change":"2024-01-20T11:08:40.601755+0000","last_active":"2024-01-20T11:08:42.012164+0000","last_peered":"2024-01-20T11:08:42.012164+0000","last_clean":"2024-01-20T11:08:42.012164+0000","last_became_active":"2024-01-20T11:08:40.601250+0000","last_became_peered":"2024-01-20T11:08:40.601250+0000","last_unstale":"2024-01-20T11:08:42.012164+0000","last_undegraded":"2024-01-20T11:08:42.012164+0000","last_fullsized":"2024-01-20T11:08:42.012164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:12:44.636510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978432+0000","last_change":"2024-01-20T11:08:41.983205+0000","last_active":"2024-01-20T11:08:42.978432+0000","last_peered":"2024-01-20T11:08:42.978432+0000","last_clean":"2024-01-20T11:08:42.978432+0000","last_became_active":"2024-01-20T11:08:41.981622+0000","last_became_peered":"2024-01-20T11:08:41.981622+0000","last_unstale":"2024-01-20T11:08:42.978432+0000","last_undegraded":"2024-01-20T11:08:42.978432+0000","last_fullsized":"2024-01-20T11:08:42.978432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:33:01.979849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.000915+0000","last_change":"2024-01-20T11:08:40.610360+0000","last_active":"2024-01-20T11:08:42.000915+0000","last_peered":"2024-01-20T11:08:42.000915+0000","last_clean":"2024-01-20T11:08:42.000915+0000","last_became_active":"2024-01-20T11:08:40.609811+0000","last_became_peered":"2024-01-20T11:08:40.609811+0000","last_unstale":"2024-01-20T11:08:42.000915+0000","last_undegraded":"2024-01-20T11:08:42.000915+0000","last_fullsized":"2024-01-20T11:08:42.000915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:12.505823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.586293+0000","last_change":"2024-01-20T11:08:41.981683+0000","last_active":"2024-01-20T11:08:43.586293+0000","last_peered":"2024-01-20T11:08:43.586293+0000","last_clean":"2024-01-20T11:08:43.586293+0000","last_became_active":"2024-01-20T11:08:41.981414+0000","last_became_peered":"2024-01-20T11:08:41.981414+0000","last_unstale":"2024-01-20T11:08:43.586293+0000","last_undegraded":"2024-01-20T11:08:43.586293+0000","last_fullsized":"2024-01-20T11:08:43.586293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:49:01.607165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.008260+0000","last_change":"2024-01-20T11:08:40.608291+0000","last_active":"2024-01-20T11:08:42.008260+0000","last_peered":"2024-01-20T11:08:42.008260+0000","last_clean":"2024-01-20T11:08:42.008260+0000","last_became_active":"2024-01-20T11:08:40.607985+0000","last_became_peered":"2024-01-20T11:08:40.607985+0000","last_unstale":"2024-01-20T11:08:42.008260+0000","last_undegraded":"2024-01-20T11:08:42.008260+0000","last_fullsized":"2024-01-20T11:08:42.008260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:21.032826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582183+0000","last_change":"2024-01-20T11:08:41.981136+0000","last_active":"2024-01-20T11:08:43.582183+0000","last_peered":"2024-01-20T11:08:43.582183+0000","last_clean":"2024-01-20T11:08:43.582183+0000","last_became_active":"2024-01-20T11:08:41.980825+0000","last_became_peered":"2024-01-20T11:08:41.980825+0000","last_unstale":"2024-01-20T11:08:43.582183+0000","last_undegraded":"2024-01-20T11:08:43.582183+0000","last_fullsized":"2024-01-20T11:08:43.582183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:27:52.886428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.976748+0000","last_change":"2024-01-20T11:08:40.613383+0000","last_active":"2024-01-20T11:08:41.976748+0000","last_peered":"2024-01-20T11:08:41.976748+0000","last_clean":"2024-01-20T11:08:41.976748+0000","last_became_active":"2024-01-20T11:08:40.613064+0000","last_became_peered":"2024-01-20T11:08:40.613064+0000","last_unstale":"2024-01-20T11:08:41.976748+0000","last_undegraded":"2024-01-20T11:08:41.976748+0000","last_fullsized":"2024-01-20T11:08:41.976748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:35.936256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581914+0000","last_change":"2024-01-20T11:08:41.977554+0000","last_active":"2024-01-20T11:08:43.581914+0000","last_peered":"2024-01-20T11:08:43.581914+0000","last_clean":"2024-01-20T11:08:43.581914+0000","last_became_active":"2024-01-20T11:08:41.976728+0000","last_became_peered":"2024-01-20T11:08:41.976728+0000","last_unstale":"2024-01-20T11:08:43.581914+0000","last_undegraded":"2024-01-20T11:08:43.581914+0000","last_fullsized":"2024-01-20T11:08:43.581914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:36.942246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974101+0000","last_change":"2024-01-20T11:08:40.605704+0000","last_active":"2024-01-20T11:08:42.974101+0000","last_peered":"2024-01-20T11:08:42.974101+0000","last_clean":"2024-01-20T11:08:42.974101+0000","last_became_active":"2024-01-20T11:08:40.605320+0000","last_became_peered":"2024-01-20T11:08:40.605320+0000","last_unstale":"2024-01-20T11:08:42.974101+0000","last_undegraded":"2024-01-20T11:08:42.974101+0000","last_fullsized":"2024-01-20T11:08:42.974101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:50:37.063034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583690+0000","last_change":"2024-01-20T11:08:41.966584+0000","last_active":"2024-01-20T11:08:43.583690+0000","last_peered":"2024-01-20T11:08:43.583690+0000","last_clean":"2024-01-20T11:08:43.583690+0000","last_became_active":"2024-01-20T11:08:41.965856+0000","last_became_peered":"2024-01-20T11:08:41.965856+0000","last_unstale":"2024-01-20T11:08:43.583690+0000","last_undegraded":"2024-01-20T11:08:43.583690+0000","last_fullsized":"2024-01-20T11:08:43.583690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:13.511813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.974841+0000","last_change":"2024-01-20T11:08:40.613167+0000","last_active":"2024-01-20T11:08:41.974841+0000","last_peered":"2024-01-20T11:08:41.974841+0000","last_clean":"2024-01-20T11:08:41.974841+0000","last_became_active":"2024-01-20T11:08:40.612711+0000","last_became_peered":"2024-01-20T11:08:40.612711+0000","last_unstale":"2024-01-20T11:08:41.974841+0000","last_undegraded":"2024-01-20T11:08:41.974841+0000","last_fullsized":"2024-01-20T11:08:41.974841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:26.428713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581570+0000","last_change":"2024-01-20T11:08:41.977691+0000","last_active":"2024-01-20T11:08:43.581570+0000","last_peered":"2024-01-20T11:08:43.581570+0000","last_clean":"2024-01-20T11:08:43.581570+0000","last_became_active":"2024-01-20T11:08:41.976750+0000","last_became_peered":"2024-01-20T11:08:41.976750+0000","last_unstale":"2024-01-20T11:08:43.581570+0000","last_undegraded":"2024-01-20T11:08:43.581570+0000","last_fullsized":"2024-01-20T11:08:43.581570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:25:02.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.976551+0000","last_change":"2024-01-20T11:08:40.605328+0000","last_active":"2024-01-20T11:08:41.976551+0000","last_peered":"2024-01-20T11:08:41.976551+0000","last_clean":"2024-01-20T11:08:41.976551+0000","last_became_active":"2024-01-20T11:08:40.603861+0000","last_became_peered":"2024-01-20T11:08:40.603861+0000","last_unstale":"2024-01-20T11:08:41.976551+0000","last_undegraded":"2024-01-20T11:08:41.976551+0000","last_fullsized":"2024-01-20T11:08:41.976551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:34.522031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977930+0000","last_change":"2024-01-20T11:08:41.978444+0000","last_active":"2024-01-20T11:08:42.977930+0000","last_peered":"2024-01-20T11:08:42.977930+0000","last_clean":"2024-01-20T11:08:42.977930+0000","last_became_active":"2024-01-20T11:08:41.978100+0000","last_became_peered":"2024-01-20T11:08:41.978100+0000","last_unstale":"2024-01-20T11:08:42.977930+0000","last_undegraded":"2024-01-20T11:08:42.977930+0000","last_fullsized":"2024-01-20T11:08:42.977930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:17:54.363561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.955838+0000","last_change":"2024-01-20T11:08:40.618140+0000","last_active":"2024-01-20T11:08:41.955838+0000","last_peered":"2024-01-20T11:08:41.955838+0000","last_clean":"2024-01-20T11:08:41.955838+0000","last_became_active":"2024-01-20T11:08:40.617681+0000","last_became_peered":"2024-01-20T11:08:40.617681+0000","last_unstale":"2024-01-20T11:08:41.955838+0000","last_undegraded":"2024-01-20T11:08:41.955838+0000","last_fullsized":"2024-01-20T11:08:41.955838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:06:04.553729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582132+0000","last_change":"2024-01-20T11:08:41.967913+0000","last_active":"2024-01-20T11:08:43.582132+0000","last_peered":"2024-01-20T11:08:43.582132+0000","last_clean":"2024-01-20T11:08:43.582132+0000","last_became_active":"2024-01-20T11:08:41.967312+0000","last_became_peered":"2024-01-20T11:08:41.967312+0000","last_unstale":"2024-01-20T11:08:43.582132+0000","last_undegraded":"2024-01-20T11:08:43.582132+0000","last_fullsized":"2024-01-20T11:08:43.582132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:17.384788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.004716+0000","last_change":"2024-01-20T11:08:40.610528+0000","last_active":"2024-01-20T11:08:42.004716+0000","last_peered":"2024-01-20T11:08:42.004716+0000","last_clean":"2024-01-20T11:08:42.004716+0000","last_became_active":"2024-01-20T11:08:40.610186+0000","last_became_peered":"2024-01-20T11:08:40.610186+0000","last_unstale":"2024-01-20T11:08:42.004716+0000","last_undegraded":"2024-01-20T11:08:42.004716+0000","last_fullsized":"2024-01-20T11:08:42.004716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:34.761327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.978433+0000","last_change":"2024-01-20T11:08:41.983483+0000","last_active":"2024-01-20T11:08:42.978433+0000","last_peered":"2024-01-20T11:08:42.978433+0000","last_clean":"2024-01-20T11:08:42.978433+0000","last_became_active":"2024-01-20T11:08:41.982865+0000","last_became_peered":"2024-01-20T11:08:41.982865+0000","last_unstale":"2024-01-20T11:08:42.978433+0000","last_undegraded":"2024-01-20T11:08:42.978433+0000","last_fullsized":"2024-01-20T11:08:42.978433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:28:37.409334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974537+0000","last_change":"2024-01-20T11:08:40.605892+0000","last_active":"2024-01-20T11:08:42.974537+0000","last_peered":"2024-01-20T11:08:42.974537+0000","last_clean":"2024-01-20T11:08:42.974537+0000","last_became_active":"2024-01-20T11:08:40.605520+0000","last_became_peered":"2024-01-20T11:08:40.605520+0000","last_unstale":"2024-01-20T11:08:42.974537+0000","last_undegraded":"2024-01-20T11:08:42.974537+0000","last_fullsized":"2024-01-20T11:08:42.974537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:55.280596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.973881+0000","last_change":"2024-01-20T11:08:41.996321+0000","last_active":"2024-01-20T11:08:42.973881+0000","last_peered":"2024-01-20T11:08:42.973881+0000","last_clean":"2024-01-20T11:08:42.973881+0000","last_became_active":"2024-01-20T11:08:41.995679+0000","last_became_peered":"2024-01-20T11:08:41.995679+0000","last_unstale":"2024-01-20T11:08:42.973881+0000","last_undegraded":"2024-01-20T11:08:42.973881+0000","last_fullsized":"2024-01-20T11:08:42.973881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:18:34.682622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.972536+0000","last_change":"2024-01-20T11:08:40.605017+0000","last_active":"2024-01-20T11:08:41.972536+0000","last_peered":"2024-01-20T11:08:41.972536+0000","last_clean":"2024-01-20T11:08:41.972536+0000","last_became_active":"2024-01-20T11:08:40.603984+0000","last_became_peered":"2024-01-20T11:08:40.603984+0000","last_unstale":"2024-01-20T11:08:41.972536+0000","last_undegraded":"2024-01-20T11:08:41.972536+0000","last_fullsized":"2024-01-20T11:08:41.972536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:12.505823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.582367+0000","last_change":"2024-01-20T11:08:41.984970+0000","last_active":"2024-01-20T11:08:43.582367+0000","last_peered":"2024-01-20T11:08:43.582367+0000","last_clean":"2024-01-20T11:08:43.582367+0000","last_became_active":"2024-01-20T11:08:41.983951+0000","last_became_peered":"2024-01-20T11:08:41.983951+0000","last_unstale":"2024-01-20T11:08:43.582367+0000","last_undegraded":"2024-01-20T11:08:43.582367+0000","last_fullsized":"2024-01-20T11:08:43.582367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:56:55.364879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.974030+0000","last_change":"2024-01-20T11:08:40.609543+0000","last_active":"2024-01-20T11:08:42.974030+0000","last_peered":"2024-01-20T11:08:42.974030+0000","last_clean":"2024-01-20T11:08:42.974030+0000","last_became_active":"2024-01-20T11:08:40.609230+0000","last_became_peered":"2024-01-20T11:08:40.609230+0000","last_unstale":"2024-01-20T11:08:42.974030+0000","last_undegraded":"2024-01-20T11:08:42.974030+0000","last_fullsized":"2024-01-20T11:08:42.974030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:17:48.731371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.973874+0000","last_change":"2024-01-20T11:08:41.990537+0000","last_active":"2024-01-20T11:08:42.973874+0000","last_peered":"2024-01-20T11:08:42.973874+0000","last_clean":"2024-01-20T11:08:42.973874+0000","last_became_active":"2024-01-20T11:08:41.988093+0000","last_became_peered":"2024-01-20T11:08:41.988093+0000","last_unstale":"2024-01-20T11:08:42.973874+0000","last_undegraded":"2024-01-20T11:08:42.973874+0000","last_fullsized":"2024-01-20T11:08:42.973874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:06:05.559719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.972126+0000","last_change":"2024-01-20T11:08:40.606231+0000","last_active":"2024-01-20T11:08:41.972126+0000","last_peered":"2024-01-20T11:08:41.972126+0000","last_clean":"2024-01-20T11:08:41.972126+0000","last_became_active":"2024-01-20T11:08:40.606000+0000","last_became_peered":"2024-01-20T11:08:40.606000+0000","last_unstale":"2024-01-20T11:08:41.972126+0000","last_undegraded":"2024-01-20T11:08:41.972126+0000","last_fullsized":"2024-01-20T11:08:41.972126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:40:21.032826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.583942+0000","last_change":"2024-01-20T11:08:41.986522+0000","last_active":"2024-01-20T11:08:43.583942+0000","last_peered":"2024-01-20T11:08:43.583942+0000","last_clean":"2024-01-20T11:08:43.583942+0000","last_became_active":"2024-01-20T11:08:41.986267+0000","last_became_peered":"2024-01-20T11:08:41.986267+0000","last_unstale":"2024-01-20T11:08:43.583942+0000","last_undegraded":"2024-01-20T11:08:43.583942+0000","last_fullsized":"2024-01-20T11:08:43.583942+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:28:37.409334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.976713+0000","last_change":"2024-01-20T11:08:40.611802+0000","last_active":"2024-01-20T11:08:41.976713+0000","last_peered":"2024-01-20T11:08:41.976713+0000","last_clean":"2024-01-20T11:08:41.976713+0000","last_became_active":"2024-01-20T11:08:40.611456+0000","last_became_peered":"2024-01-20T11:08:40.611456+0000","last_unstale":"2024-01-20T11:08:41.976713+0000","last_undegraded":"2024-01-20T11:08:41.976713+0000","last_fullsized":"2024-01-20T11:08:41.976713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:25:01.600531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:43.581748+0000","last_change":"2024-01-20T11:08:41.992525+0000","last_active":"2024-01-20T11:08:43.581748+0000","last_peered":"2024-01-20T11:08:43.581748+0000","last_clean":"2024-01-20T11:08:43.581748+0000","last_became_active":"2024-01-20T11:08:41.992204+0000","last_became_peered":"2024-01-20T11:08:41.992204+0000","last_unstale":"2024-01-20T11:08:43.581748+0000","last_undegraded":"2024-01-20T11:08:43.581748+0000","last_fullsized":"2024-01-20T11:08:43.581748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:37:53.685410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.970684+0000","last_change":"2024-01-20T11:08:40.615448+0000","last_active":"2024-01-20T11:08:41.970684+0000","last_peered":"2024-01-20T11:08:41.970684+0000","last_clean":"2024-01-20T11:08:41.970684+0000","last_became_active":"2024-01-20T11:08:40.615183+0000","last_became_peered":"2024-01-20T11:08:40.615183+0000","last_unstale":"2024-01-20T11:08:41.970684+0000","last_undegraded":"2024-01-20T11:08:41.970684+0000","last_fullsized":"2024-01-20T11:08:41.970684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:07:53.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T11:08:42.977212+0000","last_change":"2024-01-20T11:08:41.983368+0000","last_active":"2024-01-20T11:08:42.977212+0000","last_peered":"2024-01-20T11:08:42.977212+0000","last_clean":"2024-01-20T11:08:42.977212+0000","last_became_active":"2024-01-20T11:08:41.982814+0000","last_became_peered":"2024-01-20T11:08:41.982814+0000","last_unstale":"2024-01-20T11:08:42.977212+0000","last_undegraded":"2024-01-20T11:08:42.977212+0000","last_fullsized":"2024-01-20T11:08:42.977212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:40.563141+0000","last_clean_scrub_stamp":"2024-01-20T11:08:40.563141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:50.537772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.978583+0000","last_change":"2024-01-20T11:08:40.616257+0000","last_active":"2024-01-20T11:08:41.978583+0000","last_peered":"2024-01-20T11:08:41.978583+0000","last_clean":"2024-01-20T11:08:41.978583+0000","last_became_active":"2024-01-20T11:08:40.615824+0000","last_became_peered":"2024-01-20T11:08:40.615824+0000","last_unstale":"2024-01-20T11:08:41.978583+0000","last_undegraded":"2024-01-20T11:08:41.978583+0000","last_fullsized":"2024-01-20T11:08:41.978583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:08:39.557152+0000","last_clean_scrub_stamp":"2024-01-20T11:08:39.557152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:17:48.731371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-20T11:08:41.963123+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:08:41.963123+0000","last_peered":"2024-01-20T11:08:41.963123+0000","last_clean":"2024-01-20T11:08:41.963123+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:08:41.963123+0000","last_undegraded":"2024-01-20T11:08:41.963123+0000","last_fullsized":"2024-01-20T11:08:41.963123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":750183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.113}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.222}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.169},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.6379999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.048},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.748}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.329}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.383}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.484}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":160341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":0.878},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.1359999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.091},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.4550000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.554},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.2190000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":3.0289999999999999,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.659}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":160397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.724},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.0660000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.607}]},{"osd":2,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.2490000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.8089999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4059999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.8859999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.391,"5min":1.391,"15min":1.391},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.762}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":159829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.4590000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.385},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.92200000000000004}]},{"osd":3,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.054}]},{"osd":5,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.3109999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.28},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.222},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.494}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":161359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.248},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.157}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.4650000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.681}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.036},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.377}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.532},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.6180000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.4239999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.577},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1970000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":159795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.1200000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.80200000000000005}]},{"osd":3,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.95399999999999996}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":1.2010000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.1559999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2649999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":1.367},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3220000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":161359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.4729999999999999,"5min":5.4729999999999999,"15min":5.4729999999999999},"last":0.874}]},{"osd":2,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.468},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.0579999999999998,"5min":5.0579999999999998,"15min":5.0579999999999998},"last":1.1559999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":5.0010000000000003,"5min":5.0010000000000003,"15min":5.0010000000000003},"last":1.224},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.4139999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.3399999999999999,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":1.5209999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":1.095},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":1.609}]},{"osd":6,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":5.1769999999999996,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.266}]},{"osd":7,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":5.391,"5min":5.391,"15min":5.391},"last":1.369},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":5.5469999999999997,"5min":5.5469999999999997,"15min":5.5469999999999997},"last":1.3200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":750093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.119},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.397}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.73399999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.4870000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.823},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":2.0379999999999998}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3380000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":2.1459999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.7250000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.55},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":2.2029999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:08:46.839 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T11:08:46.839 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-20T11:08:47.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.097+0000 7fc08b000640 1 Processor -- start 2024-01-20T11:08:47.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.098+0000 7fc08b000640 1 -- start start 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.099+0000 7fc08b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc08415d630 0x7fc0840cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.099+0000 7fc08b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0840cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.099+0000 7fc08b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0840ce500 con 0x7fc0840ce060 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.099+0000 7fc08b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840ce7e0 con 0x7fc08415d630 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.099+0000 7fc08b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840ceac0 con 0x7fc0840d16d0 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc083e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc08415d630 0x7fc0840cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc083e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc08415d630 0x7fc0840cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58106/0 (socket says 172.21.15.162:58106) 2024-01-20T11:08:47.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc083e00640 1 -- 172.21.15.162:0/1961509473 learned_addr learned my addr 172.21.15.162:0/1961509473 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:47.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc07b200640 1 --2- 172.21.15.162:0/1961509473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0840cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc083e00640 1 -- 172.21.15.162:0/1961509473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 msgr2=0x7fc0840cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:47.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc083e00640 1 --2- 172.21.15.162:0/1961509473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0840cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc083e00640 1 -- 172.21.15.162:0/1961509473 >> v1:172.21.15.162:6789/0 conn(0x7fc0840ce060 legacy=0x7fc0840b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.100+0000 7fc083e00640 1 -- 172.21.15.162:0/1961509473 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0840ceda0 con 0x7fc08415d630 2024-01-20T11:08:47.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.101+0000 7fc083e00640 1 --2- 172.21.15.162:0/1961509473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0840cdb20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc074009e50 tx=0x7fc07402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b1de6076376850 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:47.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.101+0000 7fc083400640 1 -- 172.21.15.162:0/1961509473 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07402cb00 con 0x7fc08415d630 2024-01-20T11:08:47.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc083400640 1 -- 172.21.15.162:0/1961509473 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07402cc60 con 0x7fc08415d630 2024-01-20T11:08:47.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc083400640 1 -- 172.21.15.162:0/1961509473 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0740343f0 con 0x7fc08415d630 2024-01-20T11:08:47.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 -- 172.21.15.162:0/1961509473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 msgr2=0x7fc0840cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 --2- 172.21.15.162:0/1961509473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0840cdb20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc074009e50 tx=0x7fc07402bf60 comp rx=0 tx=0).stop 2024-01-20T11:08:47.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 -- 172.21.15.162:0/1961509473 shutdown_connections 2024-01-20T11:08:47.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 --2- 172.21.15.162:0/1961509473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0840cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 --2- 172.21.15.162:0/1961509473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0840cdb20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 -- 172.21.15.162:0/1961509473 >> 172.21.15.162:0/1961509473 conn(0x7fc08408afe0 msgr2=0x7fc08409c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:47.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 -- 172.21.15.162:0/1961509473 shutdown_connections 2024-01-20T11:08:47.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.102+0000 7fc08b000640 1 -- 172.21.15.162:0/1961509473 wait complete. 2024-01-20T11:08:47.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.104+0000 7fc08b000640 1 Processor -- start 2024-01-20T11:08:47.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.104+0000 7fc08b000640 1 -- start start 2024-01-20T11:08:47.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc08b000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0840ce060 0x7fc0840cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc08b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0841f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc08b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0841f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc08b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840ca740 con 0x7fc08415d630 2024-01-20T11:08:47.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc08b000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841544b0 con 0x7fc0840ce060 2024-01-20T11:08:47.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc08b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841f74f0 con 0x7fc0840d16d0 2024-01-20T11:08:47.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc089000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0841f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc089000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0841f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58114/0 (socket says 172.21.15.162:58114) 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.105+0000 7fc089000640 1 -- 172.21.15.162:0/97791199 learned_addr learned my addr 172.21.15.162:0/97791199 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc083e00640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0840ce060 0x7fc0840cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc07b200640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0841f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc089000640 1 -- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 msgr2=0x7fc0841f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc089000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0841f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc089000640 1 -- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0840ce060 msgr2=0x7fc0840cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc089000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0840ce060 0x7fc0840cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc089000640 1 -- 172.21.15.162:0/97791199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074009b30 con 0x7fc08415d630 2024-01-20T11:08:47.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc089000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0841f2760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c430 tx=0x7fc07c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:47.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc080c00640 1 -- 172.21.15.162:0/97791199 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0052d0 con 0x7fc08415d630 2024-01-20T11:08:47.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc080c00640 1 -- 172.21.15.162:0/97791199 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c005430 con 0x7fc08415d630 2024-01-20T11:08:47.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0841f6c50 con 0x7fc08415d630 2024-01-20T11:08:47.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.106+0000 7fc080c00640 1 -- 172.21.15.162:0/97791199 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c003810 con 0x7fc08415d630 2024-01-20T11:08:47.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.107+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0841f7210 con 0x7fc08415d630 2024-01-20T11:08:47.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.108+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0840cf790 con 0x7fc08415d630 2024-01-20T11:08:47.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.108+0000 7fc080c00640 1 -- 172.21.15.162:0/97791199 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc07c003970 con 0x7fc08415d630 2024-01-20T11:08:47.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.109+0000 7fc080c00640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05c06af00 0x7fc05c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.109+0000 7fc080c00640 1 -- 172.21.15.162:0/97791199 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc07c088c30 con 0x7fc08415d630 2024-01-20T11:08:47.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.110+0000 7fc083e00640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05c06af00 0x7fc05c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.110+0000 7fc083e00640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05c06af00 0x7fc05c06d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc074035000 tx=0x7fc074030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:47.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.114+0000 7fc080c00640 1 -- 172.21.15.162:0/97791199 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc07c053a60 con 0x7fc08415d630 2024-01-20T11:08:47.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.377+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc0840ca8f0 con 0x7fc08415d630 2024-01-20T11:08:47.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.381+0000 7fc080c00640 1 -- 172.21.15.162:0/97791199 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc0840ca8f0 con 0x7fc08415d630 2024-01-20T11:08:47.382 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-01-20T11:08:47.382 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA3qatljGIeOBAAZAh1ameerRU000krb9bN6g== 2024-01-20T11:08:47.382 INFO:teuthology.orchestra.run.smithi162.stdout: caps mds = "allow" 2024-01-20T11:08:47.382 INFO:teuthology.orchestra.run.smithi162.stdout: caps mon = "allow r" 2024-01-20T11:08:47.382 INFO:teuthology.orchestra.run.smithi162.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-20T11:08:47.383 INFO:teuthology.orchestra.run.smithi162.stderr:updated caps for client.0 2024-01-20T11:08:47.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.384+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05c06af00 msgr2=0x7fc05c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.384+0000 7fc08b000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05c06af00 0x7fc05c06d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc074035000 tx=0x7fc074030000 comp rx=0 tx=0).stop 2024-01-20T11:08:47.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.384+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 msgr2=0x7fc0841f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.384+0000 7fc08b000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0841f2760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c430 tx=0x7fc07c00c8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 shutdown_connections 2024-01-20T11:08:47.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08415d630 0x7fc0841f2760 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0840d16d0 0x7fc0841f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc05c06af00 0x7fc05c06d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 --2- 172.21.15.162:0/97791199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0840ce060 0x7fc0840cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 >> 172.21.15.162:0/97791199 conn(0x7fc08408afe0 msgr2=0x7fc0840c7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:47.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 shutdown_connections 2024-01-20T11:08:47.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.385+0000 7fc08b000640 1 -- 172.21.15.162:0/97791199 wait complete. 2024-01-20T11:08:47.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:47.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.608+0000 7f2d27400640 1 Processor -- start 2024-01-20T11:08:47.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.608+0000 7f2d27400640 1 -- start start 2024-01-20T11:08:47.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.610+0000 7f2d27400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2d20155a30 0x7f2d200ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.610+0000 7f2d27400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.610+0000 7f2d27400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d20070b60 con 0x7f2d2015c6e0 2024-01-20T11:08:47.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.610+0000 7f2d27400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2015ba10 con 0x7f2d20155a30 2024-01-20T11:08:47.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.610+0000 7f2d27400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2015bc00 con 0x7f2d20070630 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.611+0000 7f2d17c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.611+0000 7f2d24a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2d20155a30 0x7f2d200ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.611+0000 7f2d17c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:34574/0 (socket says 172.21.15.162:34574) 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.611+0000 7f2d17c00640 1 -- 172.21.15.162:0/3031225504 learned_addr learned my addr 172.21.15.162:0/3031225504 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.612+0000 7f2d17c00640 1 -- 172.21.15.162:0/3031225504 >> v2:172.21.15.179:3300/0 conn(0x7f2d20155a30 msgr2=0x7f2d200ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.612+0000 7f2d17c00640 1 --2- 172.21.15.162:0/3031225504 >> v2:172.21.15.179:3300/0 conn(0x7f2d20155a30 0x7f2d200ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.612+0000 7f2d17c00640 1 -- 172.21.15.162:0/3031225504 >> v1:172.21.15.179:6789/0 conn(0x7f2d2015c6e0 legacy=0x7f2d2006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.612+0000 7f2d17c00640 1 -- 172.21.15.162:0/3031225504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2015bee0 con 0x7f2d20070630 2024-01-20T11:08:47.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.613+0000 7f2d17c00640 1 --2- 172.21.15.162:0/3031225504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200adfa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009e50 tx=0x7f2d0802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a22e84532f2b6c8a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:47.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d1fe00640 1 -- 172.21.15.162:0/3031225504 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0802ca80 con 0x7f2d20070630 2024-01-20T11:08:47.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d1fe00640 1 -- 172.21.15.162:0/3031225504 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0802cbe0 con 0x7f2d20070630 2024-01-20T11:08:47.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d1fe00640 1 -- 172.21.15.162:0/3031225504 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080343f0 con 0x7f2d20070630 2024-01-20T11:08:47.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d27400640 1 -- 172.21.15.162:0/3031225504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 msgr2=0x7f2d200adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d27400640 1 --2- 172.21.15.162:0/3031225504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200adfa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009e50 tx=0x7f2d0802bee0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d27400640 1 -- 172.21.15.162:0/3031225504 shutdown_connections 2024-01-20T11:08:47.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d27400640 1 --2- 172.21.15.162:0/3031225504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200adfa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d27400640 1 --2- 172.21.15.162:0/3031225504 >> v2:172.21.15.179:3300/0 conn(0x7f2d20155a30 0x7f2d200ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.614+0000 7f2d27400640 1 -- 172.21.15.162:0/3031225504 >> 172.21.15.162:0/3031225504 conn(0x7f2d200b0cd0 msgr2=0x7f2d200b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:47.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.615+0000 7f2d27400640 1 -- 172.21.15.162:0/3031225504 shutdown_connections 2024-01-20T11:08:47.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.615+0000 7f2d27400640 1 -- 172.21.15.162:0/3031225504 wait complete. 2024-01-20T11:08:47.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.616+0000 7f2d27400640 1 Processor -- start 2024-01-20T11:08:47.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.617+0000 7f2d27400640 1 -- start start 2024-01-20T11:08:47.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.617+0000 7f2d27400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.617+0000 7f2d27400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d20155a30 0x7f2d2009c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.617+0000 7f2d27400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2015c6e0 0x7f2d2009c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.617+0000 7f2d27400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2009d180 con 0x7f2d2015c6e0 2024-01-20T11:08:47.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.617+0000 7f2d27400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2009cea0 con 0x7f2d20155a30 2024-01-20T11:08:47.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.617+0000 7f2d27400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d200c98c0 con 0x7f2d20070630 2024-01-20T11:08:47.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2015c6e0 0x7f2d2009c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2015c6e0 0x7f2d2009c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58126/0 (socket says 172.21.15.162:58126) 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 -- 172.21.15.162:0/602689101 learned_addr learned my addr 172.21.15.162:0/602689101 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d17c00640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d20155a30 0x7f2d2009c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d24a00640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 -- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 msgr2=0x7f2d200c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 -- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d20155a30 msgr2=0x7f2d2009c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d20155a30 0x7f2d2009c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d25400640 1 -- 172.21.15.162:0/602689101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08009b30 con 0x7f2d2015c6e0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.618+0000 7f2d24a00640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.619+0000 7f2d25400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2015c6e0 0x7f2d2009c8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d18001eb0 tx=0x7f2d1800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.619+0000 7f2d1d600640 1 -- 172.21.15.162:0/602689101 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180052d0 con 0x7f2d2015c6e0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.619+0000 7f2d1d600640 1 -- 172.21.15.162:0/602689101 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d18005430 con 0x7f2d2015c6e0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.619+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d200c9ba0 con 0x7f2d2015c6e0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.619+0000 7f2d1d600640 1 -- 172.21.15.162:0/602689101 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18003810 con 0x7f2d2015c6e0 2024-01-20T11:08:47.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.619+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d20099c10 con 0x7f2d2015c6e0 2024-01-20T11:08:47.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.620+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d20099da0 con 0x7f2d2015c6e0 2024-01-20T11:08:47.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.621+0000 7f2d1d600640 1 -- 172.21.15.162:0/602689101 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2d18003970 con 0x7f2d2015c6e0 2024-01-20T11:08:47.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.622+0000 7f2d1d600640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2cf806aed0 0x7f2cf806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:47.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.622+0000 7f2d1d600640 1 -- 172.21.15.162:0/602689101 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d18088c70 con 0x7f2d2015c6e0 2024-01-20T11:08:47.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.622+0000 7f2d24a00640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2cf806aed0 0x7f2cf806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:47.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.623+0000 7f2d24a00640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2cf806aed0 0x7f2cf806d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009ac0 tx=0x7f2d10008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:47.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.627+0000 7f2d1d600640 1 -- 172.21.15.162:0/602689101 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2d18053ab0 con 0x7f2d2015c6e0 2024-01-20T11:08:47.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.852+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d2004e970 con 0x7f2d2015c6e0 2024-01-20T11:08:47.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.853+0000 7f2d1d600640 1 -- 172.21.15.162:0/602689101 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f2d180570d0 con 0x7f2d2015c6e0 2024-01-20T11:08:47.854 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:47.854 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:08:47.854 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:08:47.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.855+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2cf806aed0 msgr2=0x7f2cf806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.855+0000 7f2d27400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2cf806aed0 0x7f2cf806d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009ac0 tx=0x7f2d10008040 comp rx=0 tx=0).stop 2024-01-20T11:08:47.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.855+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2015c6e0 msgr2=0x7f2d2009c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.855+0000 7f2d27400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2015c6e0 0x7f2d2009c8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d18001eb0 tx=0x7f2d1800c890 comp rx=0 tx=0).stop 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 shutdown_connections 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2015c6e0 0x7f2d2009c8b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2cf806aed0 0x7f2cf806d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d20155a30 0x7f2d2009c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 --2- 172.21.15.162:0/602689101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d20070630 0x7f2d200c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 >> 172.21.15.162:0/602689101 conn(0x7f2d200b0cd0 msgr2=0x7f2d200afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 shutdown_connections 2024-01-20T11:08:47.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:47.856+0000 7f2d27400640 1 -- 172.21.15.162:0/602689101 wait complete. 2024-01-20T11:08:48.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-20T11:08:41.042767+0000', 'modified': '2024-01-20T11:08:44.515516+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5097}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5097': {'gid': 5097, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.162:6837/1733739377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6835', 'nonce': 1733739377}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 1733739377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-20T11:08:48.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-20T11:08:48.278 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-20T11:08:48.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.490+0000 7f3b19000640 1 Processor -- start 2024-01-20T11:08:48.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.491+0000 7f3b19000640 1 -- start start 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b19000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b1413e1c0 0x7f3b1406ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b19000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b1415f3d0 0x7f3b1406f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b19000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1415fbf0 con 0x7f3b1415c350 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b19000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1415f910 con 0x7f3b1415f3d0 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b19000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1415b870 con 0x7f3b1413e1c0 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b13e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b1415f3d0 0x7f3b1406f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b13e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b1415f3d0 0x7f3b1406f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58132/0 (socket says 172.21.15.162:58132) 2024-01-20T11:08:48.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.492+0000 7f3b13e00640 1 -- 172.21.15.162:0/1097217485 learned_addr learned my addr 172.21.15.162:0/1097217485 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.493+0000 7f3b13400640 1 --2- 172.21.15.162:0/1097217485 >> v2:172.21.15.179:3300/0 conn(0x7f3b1413e1c0 0x7f3b1406ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.493+0000 7f3b13e00640 1 -- 172.21.15.162:0/1097217485 >> v2:172.21.15.179:3300/0 conn(0x7f3b1413e1c0 msgr2=0x7f3b1406ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.493+0000 7f3b13e00640 1 --2- 172.21.15.162:0/1097217485 >> v2:172.21.15.179:3300/0 conn(0x7f3b1413e1c0 0x7f3b1406ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.493+0000 7f3b13e00640 1 -- 172.21.15.162:0/1097217485 >> v1:172.21.15.179:6789/0 conn(0x7f3b1415c350 legacy=0x7f3b1415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.493+0000 7f3b13e00640 1 -- 172.21.15.162:0/1097217485 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1415bb50 con 0x7f3b1415f3d0 2024-01-20T11:08:48.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.494+0000 7f3b13e00640 1 --2- 172.21.15.162:0/1097217485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1415f3d0 0x7f3b1406f1d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3b140d1050 tx=0x7f3b0c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c841bd1686c689e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.494+0000 7f3b12000640 1 -- 172.21.15.162:0/1097217485 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c031750 con 0x7f3b1415f3d0 2024-01-20T11:08:48.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.494+0000 7f3b12000640 1 -- 172.21.15.162:0/1097217485 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c0318b0 con 0x7f3b1415f3d0 2024-01-20T11:08:48.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.494+0000 7f3b12000640 1 -- 172.21.15.162:0/1097217485 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c031c40 con 0x7f3b1415f3d0 2024-01-20T11:08:48.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 -- 172.21.15.162:0/1097217485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1415f3d0 msgr2=0x7f3b1406f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 --2- 172.21.15.162:0/1097217485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1415f3d0 0x7f3b1406f1d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3b140d1050 tx=0x7f3b0c02b7f0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 -- 172.21.15.162:0/1097217485 shutdown_connections 2024-01-20T11:08:48.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 --2- 172.21.15.162:0/1097217485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1415f3d0 0x7f3b1406f1d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 --2- 172.21.15.162:0/1097217485 >> v2:172.21.15.179:3300/0 conn(0x7f3b1413e1c0 0x7f3b1406ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 -- 172.21.15.162:0/1097217485 >> 172.21.15.162:0/1097217485 conn(0x7f3b14066520 msgr2=0x7f3b14066900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:48.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 -- 172.21.15.162:0/1097217485 shutdown_connections 2024-01-20T11:08:48.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.495+0000 7f3b19000640 1 -- 172.21.15.162:0/1097217485 wait complete. 2024-01-20T11:08:48.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.497+0000 7f3b19000640 1 Processor -- start 2024-01-20T11:08:48.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.497+0000 7f3b19000640 1 -- start start 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b19000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1413e1c0 0x7f3b14155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b19000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b1415c350 0x7f3b1413f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b19000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1415f3d0 0x7f3b141f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b19000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14155980 con 0x7f3b1413e1c0 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b19000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1406cca0 con 0x7f3b1415f3d0 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b19000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14150200 con 0x7f3b1415c350 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1413e1c0 0x7f3b14155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1413e1c0 0x7f3b14155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58144/0 (socket says 172.21.15.162:58144) 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 -- 172.21.15.162:0/2061134394 learned_addr learned my addr 172.21.15.162:0/2061134394 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13e00640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1415f3d0 0x7f3b141f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 -- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b1415c350 msgr2=0x7f3b1413f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b12a00640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b1415c350 0x7f3b1413f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b1415c350 0x7f3b1413f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 -- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1415f3d0 msgr2=0x7f3b141f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1415f3d0 0x7f3b141f3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13400640 1 -- 172.21.15.162:0/2061134394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0094d0 con 0x7f3b1413e1c0 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b13e00640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1415f3d0 0x7f3b141f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.498+0000 7f3b12a00640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b1415c350 0x7f3b1413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.499+0000 7f3b13400640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1413e1c0 0x7f3b14155440 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400ce10 tx=0x7f3b0400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.499+0000 7f3b0b400640 1 -- 172.21.15.162:0/2061134394 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04003b90 con 0x7f3b1413e1c0 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.499+0000 7f3b0b400640 1 -- 172.21.15.162:0/2061134394 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04003cf0 con 0x7f3b1413e1c0 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.499+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b141504e0 con 0x7f3b1413e1c0 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.499+0000 7f3b0b400640 1 -- 172.21.15.162:0/2061134394 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04004240 con 0x7f3b1413e1c0 2024-01-20T11:08:48.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.499+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1413c2b0 con 0x7f3b1413e1c0 2024-01-20T11:08:48.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.501+0000 7f3b0b400640 1 -- 172.21.15.162:0/2061134394 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3b040043a0 con 0x7f3b1413e1c0 2024-01-20T11:08:48.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.503+0000 7f3b0b400640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3aec06af00 0x7f3aec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.503+0000 7f3b0b400640 1 -- 172.21.15.162:0/2061134394 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b04012070 con 0x7f3b1413e1c0 2024-01-20T11:08:48.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.503+0000 7f3b12a00640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3aec06af00 0x7f3aec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.503+0000 7f3b1d37b740 1 Processor -- start 2024-01-20T11:08:48.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b1d37b740 1 -- start start 2024-01-20T11:08:48.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b12a00640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3aec06af00 0x7f3aec06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3b14067fe0 tx=0x7f3afc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x564373ffa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564374027b80 0x56437402a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564373ffaf10 0x56437402aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564373f6cd80 con 0x5643740277a0 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564373f6a470 con 0x564374027b80 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.504+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564373f65d60 con 0x564373ffaf10 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x564373ffa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x564373ffa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58160/0 (socket says 172.21.15.162:58160) 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 -- 172.21.15.162:0/2489149804 learned_addr learned my addr 172.21.15.162:0/2489149804 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 -- 172.21.15.162:0/2489149804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564373ffaf10 msgr2=0x56437402aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 --2- 172.21.15.162:0/2489149804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564373ffaf10 0x56437402aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 -- 172.21.15.162:0/2489149804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564374027b80 msgr2=0x56437402a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 --2- 172.21.15.162:0/2489149804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564374027b80 0x56437402a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 -- 172.21.15.162:0/2489149804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564373f1b280 con 0x5643740277a0 2024-01-20T11:08:48.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b13400640 1 --2- 172.21.15.162:0/2489149804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x564373ffa9d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3b04060a20 tx=0x7f3b04058650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24f524cc20e476a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b03e00640 1 -- 172.21.15.162:0/2489149804 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04014e10 con 0x5643740277a0 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b03e00640 1 -- 172.21.15.162:0/2489149804 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04058bc0 con 0x5643740277a0 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.505+0000 7f3b03e00640 1 -- 172.21.15.162:0/2489149804 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0405cd10 con 0x5643740277a0 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2489149804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 msgr2=0x564373ffa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2489149804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x564373ffa9d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3b04060a20 tx=0x7f3b04058650 comp rx=0 tx=0).stop 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2489149804 shutdown_connections 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2489149804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564373ffaf10 0x56437402aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2489149804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564374027b80 0x56437402a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2489149804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x564373ffa9d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2489149804 >> 172.21.15.162:0/2489149804 conn(0x564373ffcc40 msgr2=0x564374045530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2489149804 shutdown_connections 2024-01-20T11:08:48.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.506+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2489149804 wait complete. 2024-01-20T11:08:48.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.507+0000 7f3b1d37b740 1 -- start start 2024-01-20T11:08:48.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.507+0000 7f3b1d37b740 1 Processor -- start 2024-01-20T11:08:48.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x56437402c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x56437403c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x56437402d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564373f01740 con 0x564374027b80 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564373f1f0c0 con 0x56437403e3e0 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564373cc7f20 con 0x5643740277a0 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b1d37b740 10 client.0 _ll_register_callbacks cb 0x564373f5c200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b12a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x56437403c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b12a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x56437403c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58168/0 (socket says 172.21.15.162:58168) 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.508+0000 7f3b12a00640 1 -- 172.21.15.162:0/759965589 learned_addr learned my addr 172.21.15.162:0/759965589 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b13e00640 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x56437402d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b12a00640 1 -- 172.21.15.162:0/759965589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 msgr2=0x56437402c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b12a00640 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x56437402c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b12a00640 1 -- 172.21.15.162:0/759965589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 msgr2=0x56437402d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b12a00640 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x56437402d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b12a00640 1 -- 172.21.15.162:0/759965589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1413c2b0 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b12a00640 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x56437403c980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3b14140830 tx=0x7f3afc014850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc9b4d2e7d8ad70 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b00c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b00c00640 1 -- 172.21.15.162:0/759965589 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc01f600 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b00c00640 1 -- 172.21.15.162:0/759965589 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3afc005470 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564373f5ebf0 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b00c00640 1 -- 172.21.15.162:0/759965589 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3afc007020 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b1d37b740 10 client.5268 fetch_fsmap learned FSMap version 15 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.509+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x564373f643e0 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b00c00640 1 -- 172.21.15.162:0/759965589 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564373f5ebf0 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b00c00640 1 -- 172.21.15.162:0/759965589 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3afc007180 con 0x564374027b80 2024-01-20T11:08:48.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b1d37b740 10 client.5268 fetch_fsmap finished waiting for FSMap version 15 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b1d37b740 10 client.5268 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b1d37b740 20 client.5268 populate_metadata read hostname 'smithi162' 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x564374044d40 0x564374062d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b1d37b740 4 client.5268 mds_command: new command op to 5097 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 --> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564373f5e910 con 0x564374044d40 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.510+0000 7f3b13400640 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x564374044d40 0x564374062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.511+0000 7f3b13400640 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x564374044d40 0x564374062d90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fba05a97cab9cc2e server_cookie=cb8d429c9feeb805 in_seq=0 out_seq=0 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.511+0000 7f3b00c00640 10 client.5268 ms_handle_connect on v2:172.21.15.162:6835/1733739377 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.511+0000 7f3b00c00640 1 -- 172.21.15.162:0/759965589 <== mds.0 v2:172.21.15.162:6835/1733739377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564373f5e910 con 0x564374044d40 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.511+0000 7f3b00c00640 10 client.5268 handle_command_reply: tid=0 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.511+0000 7f3b1d37b740 1 client.5268 shutdown 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 msgr2=0x56437403c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x56437403c980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3b14140830 tx=0x7f3afc014850 comp rx=0 tx=0).stop 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 shutdown_connections 2024-01-20T11:08:48.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x564374044d40 0x564374062d90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x56437402d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x56437403c980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b00c00640 0 client.5268 ms_handle_reset on v2:172.21.15.162:6835/1733739377 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/759965589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x56437402c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 >> 172.21.15.162:0/759965589 conn(0x564373ffaf10 msgr2=0x564373ffe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 shutdown_connections 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 1 -- 172.21.15.162:0/759965589 wait complete. 2024-01-20T11:08:48.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.512+0000 7f3b1d37b740 20 client.5268 trim_cache size 0 max 16384 2024-01-20T11:08:48.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.529+0000 7f3b1d37b740 1 Processor -- start 2024-01-20T11:08:48.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.529+0000 7f3b1d37b740 1 -- start start 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.529+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x56437403dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.529+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564374027b80 0x564373ffbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x564374049370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643740498b0 con 0x5643740277a0 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564374048c90 con 0x56437403e3e0 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56437402daa0 con 0x564374027b80 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x56437403dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x56437403dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58176/0 (socket says 172.21.15.162:58176) 2024-01-20T11:08:48.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 -- 172.21.15.162:0/2576660977 learned_addr learned my addr 172.21.15.162:0/2576660977 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 -- 172.21.15.162:0/2576660977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564374027b80 msgr2=0x564373ffbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 --2- 172.21.15.162:0/2576660977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564374027b80 0x564373ffbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 -- 172.21.15.162:0/2576660977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 msgr2=0x564374049370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 --2- 172.21.15.162:0/2576660977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x564374049370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 -- 172.21.15.162:0/2576660977 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564373f00fd0 con 0x5643740277a0 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b13400640 1 --2- 172.21.15.162:0/2576660977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x56437403dbc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b0405b010 tx=0x7f3b0408a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33a7773ba09a891 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.530+0000 7f3b03400640 1 -- 172.21.15.162:0/2576660977 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0407b070 con 0x5643740277a0 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b03400640 1 -- 172.21.15.162:0/2576660977 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04014e10 con 0x5643740277a0 2024-01-20T11:08:48.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b03400640 1 -- 172.21.15.162:0/2576660977 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0405cd10 con 0x5643740277a0 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2576660977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 msgr2=0x56437403dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2576660977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x56437403dbc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b0405b010 tx=0x7f3b0408a050 comp rx=0 tx=0).stop 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2576660977 shutdown_connections 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2576660977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x564374049370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2576660977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564374027b80 0x564373ffbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/2576660977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643740277a0 0x56437403dbc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2576660977 >> 172.21.15.162:0/2576660977 conn(0x564373ffaf10 msgr2=0x564374057c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2576660977 shutdown_connections 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.531+0000 7f3b1d37b740 1 -- 172.21.15.162:0/2576660977 wait complete. 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.532+0000 7f3b1d37b740 1 -- start start 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.532+0000 7f3b1d37b740 1 Processor -- start 2024-01-20T11:08:48.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x564374066eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x5643740a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b1d37b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x564374045120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643740a67a0 con 0x564374027b80 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564374047830 con 0x56437403e3e0 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b1d37b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564374049480 con 0x5643740277a0 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b1d37b740 10 client.0 _ll_register_callbacks cb 0x7f3b04054f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b12a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x5643740a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b12a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x5643740a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58190/0 (socket says 172.21.15.162:58190) 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.533+0000 7f3b12a00640 1 -- 172.21.15.162:0/3631465316 learned_addr learned my addr 172.21.15.162:0/3631465316 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b13400640 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x564374066eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b12a00640 1 -- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 msgr2=0x564374066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b12a00640 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x564374066eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b12a00640 1 -- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 msgr2=0x564374045120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b12a00640 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x564374045120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b12a00640 1 -- 172.21.15.162:0/3631465316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564373f1b280 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b13400640 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x564374066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b12a00640 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x5643740a4710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3afc016000 tx=0x7f3afc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f979eb3580a6e81 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b00c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b00c00640 1 -- 172.21.15.162:0/3631465316 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc003be0 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b00c00640 1 -- 172.21.15.162:0/3631465316 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3afc007640 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.534+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b04058bc0 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b00c00640 1 -- 172.21.15.162:0/3631465316 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3afc006be0 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 10 client.5274 fetch_fsmap learned FSMap version 15 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x564373f265c0 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b00c00640 1 -- 172.21.15.162:0/3631465316 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04058bc0 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b00c00640 1 -- 172.21.15.162:0/3631465316 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3afc034070 con 0x564374027b80 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 10 client.5274 fetch_fsmap finished waiting for FSMap version 15 2024-01-20T11:08:48.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 10 client.5274 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-20T11:08:48.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 20 client.5274 populate_metadata read hostname 'smithi162' 2024-01-20T11:08:48.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x5643740a5b70 0x5643740a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 4 client.5274 mds_command: new command op to 5097 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-20T11:08:48.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 --> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564373c656c0 con 0x5643740a5b70 2024-01-20T11:08:48.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.535+0000 7f3b13400640 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x5643740a5b70 0x5643740a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b00c00640 10 client.5274 ms_handle_connect on v2:172.21.15.162:6835/1733739377 2024-01-20T11:08:48.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b13400640 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x5643740a5b70 0x5643740a5f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e308ede93256bb5e server_cookie=3ec285b22ea5c0c6 in_seq=0 out_seq=0 2024-01-20T11:08:48.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b00c00640 1 -- 172.21.15.162:0/3631465316 <== mds.0 v2:172.21.15.162:6835/1733739377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564373c656c0 con 0x5643740a5b70 2024-01-20T11:08:48.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b00c00640 10 client.5274 handle_command_reply: tid=0 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 client.5274 shutdown 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 msgr2=0x5643740a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x5643740a4710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3afc016000 tx=0x7f3afc012000 comp rx=0 tx=0).stop 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 shutdown_connections 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:6835/1733739377,v1:172.21.15.162:6837/1733739377] conn(0x5643740a5b70 0x5643740a5f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56437403e3e0 0x564374045120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564374027b80 0x5643740a4710 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b00c00640 0 client.5274 ms_handle_reset on v2:172.21.15.162:6835/1733739377 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 --2- 172.21.15.162:0/3631465316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5643740277a0 0x564374066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 >> 172.21.15.162:0/3631465316 conn(0x564373ffaf10 msgr2=0x564374000450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 shutdown_connections 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.536+0000 7f3b1d37b740 1 -- 172.21.15.162:0/3631465316 wait complete. 2024-01-20T11:08:48.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b1d37b740 20 client.5274 trim_cache size 0 max 16384 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "c5cb0dc2-b452-4376-8c48-87e4df6f2999", 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 0, 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 5097, 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 6.5645105700000004, 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 15, 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 36, 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 36, 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 16.403016878999999 2024-01-20T11:08:48.542 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:08:48.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3aec06af00 msgr2=0x7f3aec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3aec06af00 0x7f3aec06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3b14067fe0 tx=0x7f3afc009040 comp rx=0 tx=0).stop 2024-01-20T11:08:48.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1413e1c0 msgr2=0x7f3b14155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1413e1c0 0x7f3b14155440 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400ce10 tx=0x7f3b0400a660 comp rx=0 tx=0).stop 2024-01-20T11:08:48.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 shutdown_connections 2024-01-20T11:08:48.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3aec06af00 0x7f3aec06d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1415f3d0 0x7f3b141f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b1415c350 0x7f3b1413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 --2- 172.21.15.162:0/2061134394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1413e1c0 0x7f3b14155440 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 >> 172.21.15.162:0/2061134394 conn(0x7f3b14066520 msgr2=0x7f3b140b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:48.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 shutdown_connections 2024-01-20T11:08:48.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.537+0000 7f3b19000640 1 -- 172.21.15.162:0/2061134394 wait complete. 2024-01-20T11:08:48.555 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T11:08:48.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.758+0000 7f79caa00640 1 Processor -- start 2024-01-20T11:08:48.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.758+0000 7f79caa00640 1 -- start start 2024-01-20T11:08:48.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.759+0000 7f79caa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.759+0000 7f79caa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f79c415f520 0x7f79c406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.759+0000 7f79caa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c415f960 con 0x7f79c406cb10 2024-01-20T11:08:48.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.759+0000 7f79caa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c406d3a0 con 0x7f79c415f520 2024-01-20T11:08:48.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.759+0000 7f79caa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40ccc70 con 0x7f79c413e380 2024-01-20T11:08:48.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79bbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f79c415f520 0x7f79c406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79bbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f79c415f520 0x7f79c406c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58192/0 (socket says 172.21.15.162:58192) 2024-01-20T11:08:48.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79bbe00640 1 -- 172.21.15.162:0/2994608354 learned_addr learned my addr 172.21.15.162:0/2994608354 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79c3e00640 1 --2- 172.21.15.162:0/2994608354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79bbe00640 1 -- 172.21.15.162:0/2994608354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 msgr2=0x7f79c415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:48.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79bbe00640 1 --2- 172.21.15.162:0/2994608354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c415efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79bbe00640 1 -- 172.21.15.162:0/2994608354 >> v1:172.21.15.162:6789/0 conn(0x7f79c406cb10 legacy=0x7f79c4140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79bbe00640 1 -- 172.21.15.162:0/2994608354 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c413fa50 con 0x7f79c415f520 2024-01-20T11:08:48.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.760+0000 7f79c3e00640 1 --2- 172.21.15.162:0/2994608354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:48.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.761+0000 7f79bbe00640 1 --2- 172.21.15.162:0/2994608354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c406c5d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009870 tx=0x7f79ac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80d3155d411bcc8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.761+0000 7f79c3400640 1 -- 172.21.15.162:0/2994608354 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac030840 con 0x7f79c415f520 2024-01-20T11:08:48.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79c3400640 1 -- 172.21.15.162:0/2994608354 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac0309a0 con 0x7f79c415f520 2024-01-20T11:08:48.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79c3400640 1 -- 172.21.15.162:0/2994608354 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac030d30 con 0x7f79c415f520 2024-01-20T11:08:48.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 -- 172.21.15.162:0/2994608354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 msgr2=0x7f79c406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 --2- 172.21.15.162:0/2994608354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c406c5d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009870 tx=0x7f79ac02b980 comp rx=0 tx=0).stop 2024-01-20T11:08:48.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 -- 172.21.15.162:0/2994608354 shutdown_connections 2024-01-20T11:08:48.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 --2- 172.21.15.162:0/2994608354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c406c5d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 --2- 172.21.15.162:0/2994608354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 -- 172.21.15.162:0/2994608354 >> 172.21.15.162:0/2994608354 conn(0x7f79c406a600 msgr2=0x7f79c406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:48.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 -- 172.21.15.162:0/2994608354 shutdown_connections 2024-01-20T11:08:48.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.762+0000 7f79caa00640 1 -- 172.21.15.162:0/2994608354 wait complete. 2024-01-20T11:08:48.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.764+0000 7f79caa00640 1 Processor -- start 2024-01-20T11:08:48.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.764+0000 7f79caa00640 1 -- start start 2024-01-20T11:08:48.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.765+0000 7f79caa00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c406cb10 0x7f79c40a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.765+0000 7f79caa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.765+0000 7f79caa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c41512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.765+0000 7f79caa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4072610 con 0x7f79c415f520 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.765+0000 7f79caa00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4071570 con 0x7f79c406cb10 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.765+0000 7f79caa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4071850 con 0x7f79c413e380 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.765+0000 7f79c8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c41512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c41512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58202/0 (socket says 172.21.15.162:58202) 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 -- 172.21.15.162:0/4091583753 learned_addr learned my addr 172.21.15.162:0/4091583753 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:48.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c3e00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c406cb10 0x7f79c40a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79bbe00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 -- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 msgr2=0x7f79c40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c40ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 -- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c406cb10 msgr2=0x7f79c40a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:48.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c406cb10 0x7f79c40a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:48.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 -- 172.21.15.162:0/4091583753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0094d0 con 0x7f79c415f520 2024-01-20T11:08:48.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c3e00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c406cb10 0x7f79c40a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:48.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c8a00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c41512e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00c7a0 tx=0x7f79bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.766+0000 7f79c0c00640 1 -- 172.21.15.162:0/4091583753 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc003b70 con 0x7f79c415f520 2024-01-20T11:08:48.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.767+0000 7f79c0c00640 1 -- 172.21.15.162:0/4091583753 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc003cf0 con 0x7f79c415f520 2024-01-20T11:08:48.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.767+0000 7f79c0c00640 1 -- 172.21.15.162:0/4091583753 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc003ea0 con 0x7f79c415f520 2024-01-20T11:08:48.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.767+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c4071b30 con 0x7f79c415f520 2024-01-20T11:08:48.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.767+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c40720f0 con 0x7f79c415f520 2024-01-20T11:08:48.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.768+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c40cca40 con 0x7f79c415f520 2024-01-20T11:08:48.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.769+0000 7f79c0c00640 1 -- 172.21.15.162:0/4091583753 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f79bc00aa90 con 0x7f79c415f520 2024-01-20T11:08:48.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.769+0000 7f79c0c00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f799c06aed0 0x7f799c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:48.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.770+0000 7f79c0c00640 1 -- 172.21.15.162:0/4091583753 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79bc089510 con 0x7f79c415f520 2024-01-20T11:08:48.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.770+0000 7f79c3e00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f799c06aed0 0x7f799c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:48.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.770+0000 7f79c3e00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f799c06aed0 0x7f799c06d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79b4006fd0 tx=0x7f79b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:48.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:48.774+0000 7f79c0c00640 1 -- 172.21.15.162:0/4091583753 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f79bc054340 con 0x7f79c415f520 2024-01-20T11:08:49.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.009+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79c40b2c90 con 0x7f79c415f520 2024-01-20T11:08:49.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.009+0000 7f79c0c00640 1 -- 172.21.15.162:0/4091583753 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f79bc057960 con 0x7f79c415f520 2024-01-20T11:08:49.010 INFO:teuthology.orchestra.run.smithi162.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T11:08:49.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f799c06aed0 msgr2=0x7f799c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:49.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f799c06aed0 0x7f799c06d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79b4006fd0 tx=0x7f79b4008040 comp rx=0 tx=0).stop 2024-01-20T11:08:49.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 msgr2=0x7f79c41512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:49.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c41512e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00c7a0 tx=0x7f79bc00cc60 comp rx=0 tx=0).stop 2024-01-20T11:08:49.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 shutdown_connections 2024-01-20T11:08:49.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c415f520 0x7f79c41512e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:49.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c413e380 0x7f79c40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:49.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f799c06aed0 0x7f799c06d390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:49.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 --2- 172.21.15.162:0/4091583753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c406cb10 0x7f79c40a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:49.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.012+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 >> 172.21.15.162:0/4091583753 conn(0x7f79c406a600 msgr2=0x7f79c4154370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:49.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.013+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 shutdown_connections 2024-01-20T11:08:49.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:49.013+0000 7f79caa00640 1 -- 172.21.15.162:0/4091583753 wait complete. 2024-01-20T11:08:49.030 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T11:08:49.030 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T11:08:49.030 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-01-20T11:08:49.030 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-20T11:08:49.030 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T11:08:49.030 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T11:08:49.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T11:08:49.031 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T11:08:49.031 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:08:49.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.031 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-01-20T11:08:49.081 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:08:49.081 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:08:49.081 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:08:49.081 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:49.082 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-01-20T11:08:49.082 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:49.082 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:08:49.082 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:49.082 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-01-20T11:08:49.082 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:08:49.083 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:49.083 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-01-20T11:08:49.083 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:08:49.083 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:49.083 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T11:08:49.083 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:49.084 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T11:08:49.084 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42421sec preferred_lft 42421sec 2024-01-20T11:08:49.084 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-01-20T11:08:49.084 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:49.084 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:08:49.085 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 4a:ef:0d:fa:ff:04 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:08:49.085 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T11:08:49.085 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:49.085 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::f816:dfff:fe99:c645/64 scope link 2024-01-20T11:08:49.085 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:49.085 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T11:08:49.086 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 92:5b:34:cf:51:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T11:08:49.086 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::905b:34ff:fecf:51d2/64 scope link 2024-01-20T11:08:49.086 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:49.086 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T11:08:49.086 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 4a:ef:0d:fa:ff:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-20T11:08:49.086 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::48ef:dff:fefa:ff04/64 scope link 2024-01-20T11:08:49.087 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:08:49.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.087 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T11:08:49.174 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-01-20T11:08:49.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.178 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-01-20T11:08:49.230 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-01-20T11:08:49.230 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T11:08:49.230 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T11:08:49.230 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T11:08:49.230 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T11:08:49.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.231 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:08:49.231 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:08:49.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T11:08:49.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T11:08:49.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T11:08:49.232 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:08:49.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.409 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:08:49.459 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T11:08:49.460 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-20T11:08:49.461 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:08:49.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.461 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-01-20T11:08:49.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:08:49.549 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T11:08:49.601 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:08:49.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:08:49.601 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T11:08:49.649 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-20T11:08:49.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.649 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:08:49.784 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:08:49.784 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:08:49.784 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:08:49.807 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:08:49.807 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:08:49.807 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:08:49.807 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:08:49.807 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-01-20T11:08:49.833 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c5cb0dc2-b452-4376-8c48-87e4df6f2999" will pass to kernel 2024-01-20T11:08:49.836 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T11:08:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-01-20T11:08:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T11:08:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T11:08:49.836 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T11:08:49.840 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T11:08:49.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.841 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T11:08:49.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:49.917 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:08:49.978 INFO:teuthology.orchestra.run.smithi162.stdout:client4595 2024-01-20T11:08:49.979 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:08:49.979 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> stdin-killer -- python3 -c ' 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> import os 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> subdir = "delete_me" 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> size = 1024 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> file_count = 1000 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> os.mkdir(os.path.join(mountpoint, subdir)) 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> for i in range(0, file_count): 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> filename = "{0}_{1}.bin".format(i, size) 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> with open(os.path.join(mountpoint, subdir, filename), '"'"'w'"'"') as f: 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> f.write(size * '"'"'x'"'"') 2024-01-20T11:08:50.025 DEBUG:teuthology.orchestra.run.smithi162:> ' 2024-01-20T11:08:51.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-20T11:08:51.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:51.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.510+0000 7f9972c00640 1 Processor -- start 2024-01-20T11:08:51.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.510+0000 7f9972c00640 1 -- start start 2024-01-20T11:08:51.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f9972c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f996c0b51d0 0x7f996c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:51.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f9972c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b55b0 0x7f996c0ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:51.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f9972c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c06ce20 con 0x7f996c06d040 2024-01-20T11:08:51.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f9972c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996c06c210 con 0x7f996c0b51d0 2024-01-20T11:08:51.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f9972c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c06c4f0 con 0x7f996c0b55b0 2024-01-20T11:08:51.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f996be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f996c0b51d0 0x7f996c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:51.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f996be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f996c0b51d0 0x7f996c0cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58212/0 (socket says 172.21.15.162:58212) 2024-01-20T11:08:51.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f996be00640 1 -- 172.21.15.162:0/3409437135 learned_addr learned my addr 172.21.15.162:0/3409437135 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:51.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.512+0000 7f9970c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f996c06d040 0x7f996c161770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:38236/0 (socket says 172.21.15.162:38236) 2024-01-20T11:08:51.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.513+0000 7f9963200640 1 --2- 172.21.15.162:0/3409437135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b55b0 0x7f996c0ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:51.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.513+0000 7f996be00640 1 -- 172.21.15.162:0/3409437135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b55b0 msgr2=0x7f996c0ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:51.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.513+0000 7f996be00640 1 --2- 172.21.15.162:0/3409437135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b55b0 0x7f996c0ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.513+0000 7f996be00640 1 -- 172.21.15.162:0/3409437135 >> v1:172.21.15.162:6789/0 conn(0x7f996c06d040 legacy=0x7f996c161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:51.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.513+0000 7f996be00640 1 -- 172.21.15.162:0/3409437135 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c06c7d0 con 0x7f996c0b51d0 2024-01-20T11:08:51.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.514+0000 7f996be00640 1 --2- 172.21.15.162:0/3409437135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b51d0 0x7f996c0cde60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f995c009e50 tx=0x7f995c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec8da9b0deedfcf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:51.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.514+0000 7f996b400640 1 -- 172.21.15.162:0/3409437135 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c02ca80 con 0x7f996c0b51d0 2024-01-20T11:08:51.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.514+0000 7f996b400640 1 -- 172.21.15.162:0/3409437135 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c02cbe0 con 0x7f996c0b51d0 2024-01-20T11:08:51.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.514+0000 7f996b400640 1 -- 172.21.15.162:0/3409437135 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c0343f0 con 0x7f996c0b51d0 2024-01-20T11:08:51.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 -- 172.21.15.162:0/3409437135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b51d0 msgr2=0x7f996c0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:51.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 --2- 172.21.15.162:0/3409437135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b51d0 0x7f996c0cde60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f995c009e50 tx=0x7f995c02bee0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 -- 172.21.15.162:0/3409437135 shutdown_connections 2024-01-20T11:08:51.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 --2- 172.21.15.162:0/3409437135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b55b0 0x7f996c0ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 --2- 172.21.15.162:0/3409437135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b51d0 0x7f996c0cde60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 -- 172.21.15.162:0/3409437135 >> 172.21.15.162:0/3409437135 conn(0x7f996c09c790 msgr2=0x7f996c0d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 -- 172.21.15.162:0/3409437135 shutdown_connections 2024-01-20T11:08:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.515+0000 7f9972c00640 1 -- 172.21.15.162:0/3409437135 wait complete. 2024-01-20T11:08:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.517+0000 7f9972c00640 1 Processor -- start 2024-01-20T11:08:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.517+0000 7f9972c00640 1 -- start start 2024-01-20T11:08:51.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9972c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996c06d040 0x7f996c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:51.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9972c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b51d0 0x7f996c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:51.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9972c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b55b0 0x7f996c0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:51.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9972c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c150220 con 0x7f996c0b55b0 2024-01-20T11:08:51.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9972c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0b6940 con 0x7f996c06d040 2024-01-20T11:08:51.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9972c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c1e8690 con 0x7f996c0b51d0 2024-01-20T11:08:51.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9970c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b55b0 0x7f996c0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:51.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9970c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b55b0 0x7f996c0ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58224/0 (socket says 172.21.15.162:58224) 2024-01-20T11:08:51.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.518+0000 7f9970c00640 1 -- 172.21.15.162:0/1349843876 learned_addr learned my addr 172.21.15.162:0/1349843876 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:51.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9970c00640 1 -- 172.21.15.162:0/1349843876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b51d0 msgr2=0x7f996c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:51.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9970c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b51d0 0x7f996c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9970c00640 1 -- 172.21.15.162:0/1349843876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996c06d040 msgr2=0x7f996c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f996be00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996c06d040 0x7f996c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9970c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996c06d040 0x7f996c14fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9970c00640 1 -- 172.21.15.162:0/1349843876 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c009b30 con 0x7f996c0b55b0 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9970c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b55b0 0x7f996c0ca5b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f996400c430 tx=0x7f996400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9968c00640 1 -- 172.21.15.162:0/1349843876 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640074e0 con 0x7f996c0b55b0 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9968c00640 1 -- 172.21.15.162:0/1349843876 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964007640 con 0x7f996c0b55b0 2024-01-20T11:08:51.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9968c00640 1 -- 172.21.15.162:0/1349843876 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640049e0 con 0x7f996c0b55b0 2024-01-20T11:08:51.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.519+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996c1e8970 con 0x7f996c0b55b0 2024-01-20T11:08:51.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.520+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996c1e8f30 con 0x7f996c0b55b0 2024-01-20T11:08:51.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.520+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996c04e970 con 0x7f996c0b55b0 2024-01-20T11:08:51.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.521+0000 7f9968c00640 1 -- 172.21.15.162:0/1349843876 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9964004b40 con 0x7f996c0b55b0 2024-01-20T11:08:51.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.522+0000 7f9968c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f994406aed0 0x7f994406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:51.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.522+0000 7f9968c00640 1 -- 172.21.15.162:0/1349843876 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99640890c0 con 0x7f996c0b55b0 2024-01-20T11:08:51.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.523+0000 7f996be00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f994406aed0 0x7f994406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:51.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.523+0000 7f996be00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f994406aed0 0x7f994406d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f995c035000 tx=0x7f995c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:51.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.527+0000 7f9968c00640 1 -- 172.21.15.162:0/1349843876 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9964053ef0 con 0x7f996c0b55b0 2024-01-20T11:08:51.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.758+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f996c0b6a80 con 0x7f996c0b55b0 2024-01-20T11:08:51.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.759+0000 7f9968c00640 1 -- 172.21.15.162:0/1349843876 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f9964057510 con 0x7f996c0b55b0 2024-01-20T11:08:51.761 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:51.761 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:08:51.761 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f994406aed0 msgr2=0x7f994406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f994406aed0 0x7f994406d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f995c035000 tx=0x7f995c030000 comp rx=0 tx=0).stop 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b55b0 msgr2=0x7f996c0ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b55b0 0x7f996c0ca5b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f996400c430 tx=0x7f996400c8f0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 shutdown_connections 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996c0b55b0 0x7f996c0ca5b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996c0b51d0 0x7f996c0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f994406aed0 0x7f994406d390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 --2- 172.21.15.162:0/1349843876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996c06d040 0x7f996c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:51.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 >> 172.21.15.162:0/1349843876 conn(0x7f996c09c790 msgr2=0x7f996c0b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:51.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.762+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 shutdown_connections 2024-01-20T11:08:51.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:51.763+0000 7f9972c00640 1 -- 172.21.15.162:0/1349843876 wait complete. 2024-01-20T11:08:51.781 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-01-20T11:08:52.344 INFO:teuthology.orchestra.run.smithi162.stdout:{"message":"","return_code":0} 2024-01-20T11:08:52.344 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-01-20T11:08:52.345 DEBUG:teuthology.orchestra.run.smithi162:> stdin-killer -- python3 -c ' 2024-01-20T11:08:52.345 DEBUG:teuthology.orchestra.run.smithi162:> import os 2024-01-20T11:08:52.345 DEBUG:teuthology.orchestra.run.smithi162:> import stat 2024-01-20T11:08:52.345 DEBUG:teuthology.orchestra.run.smithi162:> 2024-01-20T11:08:52.345 DEBUG:teuthology.orchestra.run.smithi162:> print(os.stat("/home/ubuntu/cephtest/mnt.0/delete_me").st_ino) 2024-01-20T11:08:52.345 DEBUG:teuthology.orchestra.run.smithi162:> ' 2024-01-20T11:08:52.451 INFO:teuthology.orchestra.run.smithi162.stdout:1099511627776 2024-01-20T11:08:52.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-20T11:08:52.463 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-01-20T11:08:52.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.608+0000 7f6180a40f40 1 Processor -- start 2024-01-20T11:08:52.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.608+0000 7f6180a40f40 1 -- start start 2024-01-20T11:08:52.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.609+0000 7f6180a40f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa203620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.609+0000 7f6180a40f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 0x558baa322970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.609+0000 7f6180a40f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 0x558baa322eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.609+0000 7f6180a40f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baa1658a0 con 0x558baa1b6da0 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.609+0000 7f6180a40f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baa11bff0 con 0x558baa28ed80 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.609+0000 7f6180a40f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x558baa0fedf0 con 0x558baa1e9c30 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.609+0000 7f617d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa203620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa203620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58234/0 (socket says 172.21.15.162:58234) 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 -- 172.21.15.162:0/57862551 learned_addr learned my addr 172.21.15.162:0/57862551 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 -- 172.21.15.162:0/57862551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 msgr2=0x558baa322970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 --2- 172.21.15.162:0/57862551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 0x558baa322970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 -- 172.21.15.162:0/57862551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 msgr2=0x558baa322eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 --2- 172.21.15.162:0/57862551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 0x558baa322eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 -- 172.21.15.162:0/57862551 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617800a100 con 0x558baa1b6da0 2024-01-20T11:08:52.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f617d400640 1 --2- 172.21.15.162:0/57862551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa203620 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6170001c70 tx=0x7f617000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9c172e8efc3106 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.610+0000 7f6177400640 1 -- 172.21.15.162:0/57862551 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000e470 con 0x558baa1b6da0 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6177400640 1 -- 172.21.15.162:0/57862551 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000e5d0 con 0x558baa1b6da0 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6177400640 1 -- 172.21.15.162:0/57862551 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000ea00 con 0x558baa1b6da0 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 -- 172.21.15.162:0/57862551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 msgr2=0x558baa203620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 --2- 172.21.15.162:0/57862551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa203620 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6170001c70 tx=0x7f617000b6c0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 -- 172.21.15.162:0/57862551 shutdown_connections 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 --2- 172.21.15.162:0/57862551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 0x558baa322eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 --2- 172.21.15.162:0/57862551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 0x558baa322970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 --2- 172.21.15.162:0/57862551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa203620 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 -- 172.21.15.162:0/57862551 >> 172.21.15.162:0/57862551 conn(0x558baa204f40 msgr2=0x558baa1b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:52.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 -- 172.21.15.162:0/57862551 shutdown_connections 2024-01-20T11:08:52.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.611+0000 7f6180a40f40 1 -- 172.21.15.162:0/57862551 wait complete. 2024-01-20T11:08:52.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.612+0000 7f6180a40f40 1 Processor -- start 2024-01-20T11:08:52.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.612+0000 7f6180a40f40 1 -- start start 2024-01-20T11:08:52.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f6180a40f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa275cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f6180a40f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 0x558baa3216b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f6180a40f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 0x558baa321bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f6180a40f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baa0f2950 con 0x558baa1b6da0 2024-01-20T11:08:52.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f6180a40f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baa28e3f0 con 0x558baa28ed80 2024-01-20T11:08:52.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f6180a40f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x558baa3225c0 con 0x558baa1e9c30 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f617d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa275cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f617d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa275cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58236/0 (socket says 172.21.15.162:58236) 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.613+0000 7f617d400640 1 -- 172.21.15.162:0/1580067413 learned_addr learned my addr 172.21.15.162:0/1580067413 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617de00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 0x558baa321bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617ca00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 0x558baa3216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617d400640 1 -- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 msgr2=0x558baa3216b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617d400640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 0x558baa3216b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617d400640 1 -- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 msgr2=0x558baa321bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617d400640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 0x558baa321bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617d400640 1 -- 172.21.15.162:0/1580067413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558baa0fd8d0 con 0x558baa1b6da0 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617de00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558baa28ed80 0x558baa321bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:52.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617ca00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558baa1e9c30 0x558baa3216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:08:52.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f617d400640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa275cc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f617000bbc0 tx=0x7f6170000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:52.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f6176000640 1 -- 172.21.15.162:0/1580067413 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617001e070 con 0x558baa1b6da0 2024-01-20T11:08:52.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.614+0000 7f6176000640 1 -- 172.21.15.162:0/1580067413 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6170023420 con 0x558baa1b6da0 2024-01-20T11:08:52.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.615+0000 7f6176000640 1 -- 172.21.15.162:0/1580067413 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700237d0 con 0x558baa1b6da0 2024-01-20T11:08:52.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.615+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558baa10aab0 con 0x558baa1b6da0 2024-01-20T11:08:52.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.615+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558baa0fdc60 con 0x558baa1b6da0 2024-01-20T11:08:52.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.617+0000 7f6176000640 1 -- 172.21.15.162:0/1580067413 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f617002c440 con 0x558baa1b6da0 2024-01-20T11:08:52.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.617+0000 7f6176000640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f61580698b0 0x7f615806bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.618+0000 7f6176000640 1 -- 172.21.15.162:0/1580067413 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6170089dd0 con 0x558baa1b6da0 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.618+0000 7f617ca00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f61580698b0 0x7f615806bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.618+0000 7f6180a40f40 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x558baa322130 0x558baa289670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.618+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 --> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x558baa276200 con 0x558baa322130 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.618+0000 7f617de00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x558baa322130 0x558baa289670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.618+0000 7f617ca00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f61580698b0 0x7f615806bd70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x558baa28f3f0 tx=0x7f6168005820 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f617de00640 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x558baa322130 0x558baa289670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f617de00640 1 -- 172.21.15.162:0/1580067413 <== osd.3 v2:172.21.15.162:6807/6791816 1 ==== osd_op_reply(1 10000000000.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x7f61780525a0 con 0x558baa322130 2024-01-20T11:08:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:cephfs_metadata/10000000000.00000000 mtime 2024-01-20T11:08:52.000000+0000, size 0 2024-01-20T11:08:52.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x558baa322130 msgr2=0x558baa289670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:52.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f6180a40f40 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x558baa322130 0x558baa289670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f61580698b0 msgr2=0x7f615806bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:52.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f6180a40f40 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f61580698b0 0x7f615806bd70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x558baa28f3f0 tx=0x7f6168005820 comp rx=0 tx=0).stop 2024-01-20T11:08:52.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 msgr2=0x558baa275cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:52.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f6180a40f40 1 --2- 172.21.15.162:0/1580067413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558baa1b6da0 0x558baa275cc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f617000bbc0 tx=0x7f6170000bc0 comp rx=0 tx=0).stop 2024-01-20T11:08:52.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f617de00640 1 -- 172.21.15.162:0/1580067413 reap_dead start 2024-01-20T11:08:52.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.619+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 shutdown_connections 2024-01-20T11:08:52.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.620+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 >> 172.21.15.162:0/1580067413 conn(0x558baa204f40 msgr2=0x558baa1e4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:52.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.620+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 shutdown_connections 2024-01-20T11:08:52.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:52.620+0000 7f6180a40f40 1 -- 172.21.15.162:0/1580067413 wait complete. 2024-01-20T11:08:52.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:08:52.626 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf delete_me) 2024-01-20T11:08:55.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:56.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.118+0000 7fa5cf200640 1 Processor -- start 2024-01-20T11:08:56.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.118+0000 7fa5cf200640 1 -- start start 2024-01-20T11:08:56.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.119+0000 7fa5cf200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d015d420 0x7fa5d00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:56.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.119+0000 7fa5cf200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa5d015d800 0x7fa5d00d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:56.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.119+0000 7fa5cf200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00b2880 con 0x7fa5d00d1dc0 2024-01-20T11:08:56.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.119+0000 7fa5cf200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00d2250 con 0x7fa5d015d800 2024-01-20T11:08:56.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.119+0000 7fa5cf200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0161110 con 0x7fa5d015d420 2024-01-20T11:08:56.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.120+0000 7fa5ce800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa5d00d1dc0 0x7fa5d00cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:38244/0 (socket says 172.21.15.162:38244) 2024-01-20T11:08:56.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.120+0000 7fa5ce800640 1 -- 172.21.15.162:0/3803304001 learned_addr learned my addr 172.21.15.162:0/3803304001 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:56.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.120+0000 7fa5cd400640 1 --2- 172.21.15.162:0/3803304001 >> v2:172.21.15.179:3300/0 conn(0x7fa5d015d800 0x7fa5d00d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:56.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.120+0000 7fa5cde00640 1 --2- 172.21.15.162:0/3803304001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d015d420 0x7fa5d00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:56.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.120+0000 7fa5cca00640 1 -- 172.21.15.162:0/3803304001 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505700854 0 0) 0x7fa5d00b2880 con 0x7fa5d00d1dc0 2024-01-20T11:08:56.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.120+0000 7fa5cca00640 1 -- 172.21.15.162:0/3803304001 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b0003520 con 0x7fa5d00d1dc0 2024-01-20T11:08:56.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.121+0000 7fa5cde00640 1 -- 172.21.15.162:0/3803304001 >> v2:172.21.15.179:3300/0 conn(0x7fa5d015d800 msgr2=0x7fa5d00d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:56.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.121+0000 7fa5cde00640 1 --2- 172.21.15.162:0/3803304001 >> v2:172.21.15.179:3300/0 conn(0x7fa5d015d800 0x7fa5d00d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.121+0000 7fa5cde00640 1 -- 172.21.15.162:0/3803304001 >> v1:172.21.15.162:6789/0 conn(0x7fa5d00d1dc0 legacy=0x7fa5d00cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:56.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.121+0000 7fa5cde00640 1 -- 172.21.15.162:0/3803304001 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d01613f0 con 0x7fa5d015d420 2024-01-20T11:08:56.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.121+0000 7fa5cd400640 1 --2- 172.21.15.162:0/3803304001 >> v2:172.21.15.179:3300/0 conn(0x7fa5d015d800 0x7fa5d00d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:08:56.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.123+0000 7fa5cde00640 1 --2- 172.21.15.162:0/3803304001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d015d420 0x7fa5d00d0fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00097a0 tx=0x7fa5c002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f3f860c09f79402 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:56.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.123+0000 7fa5cca00640 1 -- 172.21.15.162:0/3803304001 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0030800 con 0x7fa5d015d420 2024-01-20T11:08:56.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.123+0000 7fa5cca00640 1 -- 172.21.15.162:0/3803304001 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c0030960 con 0x7fa5d015d420 2024-01-20T11:08:56.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.123+0000 7fa5cca00640 1 -- 172.21.15.162:0/3803304001 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0030cd0 con 0x7fa5d015d420 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 -- 172.21.15.162:0/3803304001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d015d420 msgr2=0x7fa5d00d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3803304001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d015d420 0x7fa5d00d0fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00097a0 tx=0x7fa5c002b940 comp rx=0 tx=0).stop 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 -- 172.21.15.162:0/3803304001 shutdown_connections 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3803304001 >> v2:172.21.15.179:3300/0 conn(0x7fa5d015d800 0x7fa5d00d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3803304001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d015d420 0x7fa5d00d0fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 -- 172.21.15.162:0/3803304001 >> 172.21.15.162:0/3803304001 conn(0x7fa5d008cc50 msgr2=0x7fa5d009c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 -- 172.21.15.162:0/3803304001 shutdown_connections 2024-01-20T11:08:56.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.124+0000 7fa5cf200640 1 -- 172.21.15.162:0/3803304001 wait complete. 2024-01-20T11:08:56.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.126+0000 7fa5cf200640 1 Processor -- start 2024-01-20T11:08:56.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.126+0000 7fa5cf200640 1 -- start start 2024-01-20T11:08:56.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.127+0000 7fa5cf200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d00d1dc0 0x7fa5d00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:56.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.127+0000 7fa5cf200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d015d420 0x7fa5d00c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:56.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.127+0000 7fa5cf200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5d015d800 0x7fa5d015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:56.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.127+0000 7fa5cf200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00cad60 con 0x7fa5d015d800 2024-01-20T11:08:56.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.127+0000 7fa5cf200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00cb870 con 0x7fa5d015d420 2024-01-20T11:08:56.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.127+0000 7fa5cf200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00caf40 con 0x7fa5d00d1dc0 2024-01-20T11:08:56.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5d015d800 0x7fa5d015dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5d015d800 0x7fa5d015dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58246/0 (socket says 172.21.15.162:58246) 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 -- 172.21.15.162:0/3848348083 learned_addr learned my addr 172.21.15.162:0/3848348083 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5cde00640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d00d1dc0 0x7fa5d00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5cd400640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d015d420 0x7fa5d00c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 -- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d00d1dc0 msgr2=0x7fa5d00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d00d1dc0 0x7fa5d00cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 -- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d015d420 msgr2=0x7fa5d00c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d015d420 0x7fa5d00c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.128+0000 7fa5ce800640 1 -- 172.21.15.162:0/3848348083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009400 con 0x7fa5d015d800 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.129+0000 7fa5ce800640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5d015d800 0x7fa5d015dc10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800caa0 tx=0x7fa5c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.129+0000 7fa5c6000640 1 -- 172.21.15.162:0/3848348083 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800ac00 con 0x7fa5d015d800 2024-01-20T11:08:56.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.129+0000 7fa5c6000640 1 -- 172.21.15.162:0/3848348083 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c800ad60 con 0x7fa5d015d800 2024-01-20T11:08:56.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.129+0000 7fa5c6000640 1 -- 172.21.15.162:0/3848348083 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8012620 con 0x7fa5d015d800 2024-01-20T11:08:56.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.129+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c0009400 con 0x7fa5d015d800 2024-01-20T11:08:56.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.129+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d00cb500 con 0x7fa5d015d800 2024-01-20T11:08:56.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.130+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d0074a30 con 0x7fa5d015d800 2024-01-20T11:08:56.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.132+0000 7fa5c6000640 1 -- 172.21.15.162:0/3848348083 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa5c8007070 con 0x7fa5d015d800 2024-01-20T11:08:56.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.133+0000 7fa5c6000640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa5a806aed0 0x7fa5a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:56.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.133+0000 7fa5c6000640 1 -- 172.21.15.162:0/3848348083 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5c80896f0 con 0x7fa5d015d800 2024-01-20T11:08:56.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.133+0000 7fa5cde00640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa5a806aed0 0x7fa5a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:56.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.134+0000 7fa5cde00640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa5a806aed0 0x7fa5a806d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0036000 tx=0x7fa5c0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:56.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.141+0000 7fa5c6000640 1 -- 172.21.15.162:0/3848348083 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa5c8054490 con 0x7fa5d015d800 2024-01-20T11:08:56.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.498+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5d00cb9b0 con 0x7fa5d015d800 2024-01-20T11:08:56.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.498+0000 7fa5c6000640 1 -- 172.21.15.162:0/3848348083 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fa5c8017090 con 0x7fa5d015d800 2024-01-20T11:08:56.500 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:56.500 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:08:56.500 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa5a806aed0 msgr2=0x7fa5a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa5a806aed0 0x7fa5a806d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0036000 tx=0x7fa5c0008030 comp rx=0 tx=0).stop 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5d015d800 msgr2=0x7fa5d015dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5d015d800 0x7fa5d015dc10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800caa0 tx=0x7fa5c800cf60 comp rx=0 tx=0).stop 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 shutdown_connections 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5d015d800 0x7fa5d015dc10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa5a806aed0 0x7fa5a806d390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d015d420 0x7fa5d00c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 --2- 172.21.15.162:0/3848348083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d00d1dc0 0x7fa5d00cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:56.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.501+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 >> 172.21.15.162:0/3848348083 conn(0x7fa5d008cc50 msgr2=0x7fa5d00b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:56.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.502+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 shutdown_connections 2024-01-20T11:08:56.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:56.502+0000 7fa5cf200640 1 -- 172.21.15.162:0/3848348083 wait complete. 2024-01-20T11:08:56.521 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-01-20T11:08:56.895 INFO:teuthology.orchestra.run.smithi162.stdout:{"message":"","return_code":0} 2024-01-20T11:08:56.895 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-01-20T11:08:56.896 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:57.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.087+0000 7f9d8fe00640 1 Processor -- start 2024-01-20T11:08:57.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.087+0000 7f9d8fe00640 1 -- start start 2024-01-20T11:08:57.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.089+0000 7f9d8fe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9d88070630 0x7f9d880adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.089+0000 7f9d8fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d88070b60 con 0x7f9d8815c6e0 2024-01-20T11:08:57.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.089+0000 7f9d8fe00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8815bc00 con 0x7f9d88155a30 2024-01-20T11:08:57.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.090+0000 7f9d8fe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8815ba10 con 0x7f9d88070630 2024-01-20T11:08:57.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.090+0000 7f9d8d400640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9d88155a30 0x7f9d880ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:48302/0 (socket says 172.21.15.162:48302) 2024-01-20T11:08:57.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.090+0000 7f9d8d400640 1 -- 172.21.15.162:0/1065875491 learned_addr learned my addr 172.21.15.162:0/1065875491 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:57.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.090+0000 7f9d8ca00640 1 --2- 172.21.15.162:0/1065875491 >> v2:172.21.15.179:3300/0 conn(0x7f9d88070630 0x7f9d880adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.091+0000 7f9d87e00640 1 -- 172.21.15.162:0/1065875491 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848407970 0 0) 0x7f9d88070b60 con 0x7f9d8815c6e0 2024-01-20T11:08:57.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.091+0000 7f9d87e00640 1 -- 172.21.15.162:0/1065875491 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d68003520 con 0x7f9d8815c6e0 2024-01-20T11:08:57.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.091+0000 7f9d87e00640 1 -- 172.21.15.162:0/1065875491 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292881724 0 0) 0x7f9d8815bc00 con 0x7f9d88155a30 2024-01-20T11:08:57.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.091+0000 7f9d87e00640 1 -- 172.21.15.162:0/1065875491 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d88070b60 con 0x7f9d88155a30 2024-01-20T11:08:57.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.092+0000 7f9d8ca00640 1 -- 172.21.15.162:0/1065875491 >> v1:172.21.15.179:6789/0 conn(0x7f9d88155a30 legacy=0x7f9d880ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.092+0000 7f9d8ca00640 1 -- 172.21.15.162:0/1065875491 >> v1:172.21.15.162:6789/0 conn(0x7f9d8815c6e0 legacy=0x7f9d8806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.092+0000 7f9d8ca00640 1 -- 172.21.15.162:0/1065875491 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8815bee0 con 0x7f9d88070630 2024-01-20T11:08:57.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.093+0000 7f9d8ca00640 1 --2- 172.21.15.162:0/1065875491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88070630 0x7f9d880adfa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d700097a0 tx=0x7f9d7002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cc8019baaa4b0dd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:57.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.093+0000 7f9d87e00640 1 -- 172.21.15.162:0/1065875491 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70030610 con 0x7f9d88070630 2024-01-20T11:08:57.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.094+0000 7f9d87e00640 1 -- 172.21.15.162:0/1065875491 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70030770 con 0x7f9d88070630 2024-01-20T11:08:57.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.094+0000 7f9d87e00640 1 -- 172.21.15.162:0/1065875491 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70030ae0 con 0x7f9d88070630 2024-01-20T11:08:57.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.094+0000 7f9d8fe00640 1 -- 172.21.15.162:0/1065875491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88070630 msgr2=0x7f9d880adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.094+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/1065875491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88070630 0x7f9d880adfa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d700097a0 tx=0x7f9d7002b960 comp rx=0 tx=0).stop 2024-01-20T11:08:57.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.094+0000 7f9d8fe00640 1 -- 172.21.15.162:0/1065875491 shutdown_connections 2024-01-20T11:08:57.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.094+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/1065875491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88070630 0x7f9d880adfa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.094+0000 7f9d8fe00640 1 -- 172.21.15.162:0/1065875491 >> 172.21.15.162:0/1065875491 conn(0x7f9d880b0cd0 msgr2=0x7f9d880b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:57.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.095+0000 7f9d8fe00640 1 -- 172.21.15.162:0/1065875491 shutdown_connections 2024-01-20T11:08:57.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.095+0000 7f9d8fe00640 1 -- 172.21.15.162:0/1065875491 wait complete. 2024-01-20T11:08:57.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.096+0000 7f9d8fe00640 1 Processor -- start 2024-01-20T11:08:57.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.097+0000 7f9d8fe00640 1 -- start start 2024-01-20T11:08:57.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.097+0000 7f9d8fe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d88070630 0x7f9d881484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.097+0000 7f9d8fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88155a30 0x7f9d8814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.097+0000 7f9d8fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d8815c6e0 0x7f9d880afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.097+0000 7f9d8fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880aec70 con 0x7f9d8815c6e0 2024-01-20T11:08:57.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.097+0000 7f9d8fe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880aef50 con 0x7f9d88155a30 2024-01-20T11:08:57.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.097+0000 7f9d8fe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880af230 con 0x7f9d88070630 2024-01-20T11:08:57.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d8815c6e0 0x7f9d880afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d8815c6e0 0x7f9d880afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41394/0 (socket says 172.21.15.162:41394) 2024-01-20T11:08:57.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 -- 172.21.15.162:0/2506344761 learned_addr learned my addr 172.21.15.162:0/2506344761 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8ca00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88155a30 0x7f9d8814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 -- 172.21.15.162:0/2506344761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d88070630 msgr2=0x7f9d881484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d88070630 0x7f9d881484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 -- 172.21.15.162:0/2506344761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88155a30 msgr2=0x7f9d8814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88155a30 0x7f9d8814b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 -- 172.21.15.162:0/2506344761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70009400 con 0x7f9d8815c6e0 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.098+0000 7f9d8de00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d8815c6e0 0x7f9d880afd10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c6b0 tx=0x7f9d8000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.099+0000 7f9d85600640 1 -- 172.21.15.162:0/2506344761 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80003b70 con 0x7f9d8815c6e0 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.099+0000 7f9d85600640 1 -- 172.21.15.162:0/2506344761 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80003cd0 con 0x7f9d8815c6e0 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.099+0000 7f9d85600640 1 -- 172.21.15.162:0/2506344761 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d800052f0 con 0x7f9d8815c6e0 2024-01-20T11:08:57.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.099+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d88155f90 con 0x7f9d8815c6e0 2024-01-20T11:08:57.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.099+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d880af7f0 con 0x7f9d8815c6e0 2024-01-20T11:08:57.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.100+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8804e970 con 0x7f9d8815c6e0 2024-01-20T11:08:57.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.101+0000 7f9d85600640 1 -- 172.21.15.162:0/2506344761 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9d80005450 con 0x7f9d8815c6e0 2024-01-20T11:08:57.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.102+0000 7f9d85600640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9d6006aed0 0x7f9d6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.102+0000 7f9d85600640 1 -- 172.21.15.162:0/2506344761 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d80089460 con 0x7f9d8815c6e0 2024-01-20T11:08:57.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.102+0000 7f9d8d400640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9d6006aed0 0x7f9d6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.103+0000 7f9d8d400640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9d6006aed0 0x7f9d6006d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d780015c0 tx=0x7f9d780079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:57.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.106+0000 7f9d85600640 1 -- 172.21.15.162:0/2506344761 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9d80054320 con 0x7f9d8815c6e0 2024-01-20T11:08:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.338+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d8806db40 con 0x7f9d8815c6e0 2024-01-20T11:08:57.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.339+0000 7f9d85600640 1 -- 172.21.15.162:0/2506344761 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f9d80057940 con 0x7f9d8815c6e0 2024-01-20T11:08:57.341 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:57.341 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:08:57.341 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:08:57.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9d6006aed0 msgr2=0x7f9d6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9d6006aed0 0x7f9d6006d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d780015c0 tx=0x7f9d780079b0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d8815c6e0 msgr2=0x7f9d880afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d8815c6e0 0x7f9d880afd10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c6b0 tx=0x7f9d8000cb70 comp rx=0 tx=0).stop 2024-01-20T11:08:57.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 shutdown_connections 2024-01-20T11:08:57.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d8815c6e0 0x7f9d880afd10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9d6006aed0 0x7f9d6006d390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d88155a30 0x7f9d8814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.341+0000 7f9d8fe00640 1 --2- 172.21.15.162:0/2506344761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d88070630 0x7f9d881484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.342+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 >> 172.21.15.162:0/2506344761 conn(0x7f9d880b0cd0 msgr2=0x7f9d8806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:57.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.342+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 shutdown_connections 2024-01-20T11:08:57.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.342+0000 7f9d8fe00640 1 -- 172.21.15.162:0/2506344761 wait complete. 2024-01-20T11:08:57.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache strays_created 2024-01-20T11:08:57.450 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:08:57.456 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:08:57.586 INFO:teuthology.orchestra.run.smithi162.stdout:{"mds_cache":{"strays_created":1001}} 2024-01-20T11:08:57.587 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_created": 1001 } } 2024-01-20T11:08:57.587 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:08:57.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.839+0000 7ff947600640 1 Processor -- start 2024-01-20T11:08:57.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.839+0000 7ff947600640 1 -- start start 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.840+0000 7ff947600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 0x7ff9400cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.840+0000 7ff947600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff940071260 0x7ff9400716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff947600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94015a910 con 0x7ff94006d7a0 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff947600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9400ca390 con 0x7ff940071260 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff947600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff940072960 con 0x7ff94015a530 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff945600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff94006d7a0 0x7ff9400ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:35476/0 (socket says 172.21.15.162:35476) 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff945600640 1 -- 172.21.15.162:0/2098616207 learned_addr learned my addr 172.21.15.162:0/2098616207 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff937c00640 1 --2- 172.21.15.162:0/2098616207 >> v2:172.21.15.179:3300/0 conn(0x7ff940071260 0x7ff9400716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff944c00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 0x7ff9400cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.841+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612353437 0 0) 0x7ff94015a910 con 0x7ff94006d7a0 2024-01-20T11:08:57.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff920003520 con 0x7ff94006d7a0 2024-01-20T11:08:57.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333627150 0 0) 0x7ff920003520 con 0x7ff94006d7a0 2024-01-20T11:08:57.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 msgr2=0x7ff9400cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:57.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 0x7ff9400cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 >> v2:172.21.15.179:3300/0 conn(0x7ff940071260 msgr2=0x7ff9400716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:57.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 --2- 172.21.15.162:0/2098616207 >> v2:172.21.15.179:3300/0 conn(0x7ff940071260 0x7ff9400716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400ce730 con 0x7ff94006d7a0 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7ff9380019f0 con 0x7ff94006d7a0 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 >> v1:172.21.15.162:6789/0 conn(0x7ff94006d7a0 legacy=0x7ff9400ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 0x7ff920003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff920003f40 0x7ff9200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff920004d00 0x7ff920005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400ca390 con 0x7ff920003f40 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940072960 con 0x7ff920004d00 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92000ba30 con 0x7ff94015a530 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.842+0000 7ff937c00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff920003f40 0x7ff9200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.843+0000 7ff944c00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 0x7ff920003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.843+0000 7ff945600640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff920004d00 0x7ff920005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.843+0000 7ff937c00640 1 -- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 msgr2=0x7ff920003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.843+0000 7ff937c00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94015a530 0x7ff920003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.843+0000 7ff937c00640 1 -- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff920004d00 msgr2=0x7ff920005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:08:57.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.843+0000 7ff937c00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff920004d00 0x7ff920005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.843+0000 7ff937c00640 1 -- 172.21.15.162:0/2098616207 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920003520 con 0x7ff920003f40 2024-01-20T11:08:57.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.844+0000 7ff937c00640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff920003f40 0x7ff9200047c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff930009650 tx=0x7ff9200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5e243afdc37b8a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.844+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93002e920 con 0x7ff920003f40 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.844+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93002ea80 con 0x7ff920003f40 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.844+0000 7ff93fe00640 1 -- 172.21.15.162:0/2098616207 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93002ee10 con 0x7ff920003f40 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.845+0000 7ff947600640 1 -- 172.21.15.162:0/2098616207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff920003f40 msgr2=0x7ff9200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.845+0000 7ff947600640 1 --2- 172.21.15.162:0/2098616207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff920003f40 0x7ff9200047c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff930009650 tx=0x7ff9200057f0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.845+0000 7ff945600640 1 -- 172.21.15.162:0/2098616207 reap_dead start 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.845+0000 7ff947600640 1 -- 172.21.15.162:0/2098616207 shutdown_connections 2024-01-20T11:08:57.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.845+0000 7ff947600640 1 -- 172.21.15.162:0/2098616207 >> 172.21.15.162:0/2098616207 conn(0x7ff9400b0cd0 msgr2=0x7ff9400b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:57.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.845+0000 7ff947600640 1 -- 172.21.15.162:0/2098616207 shutdown_connections 2024-01-20T11:08:57.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.845+0000 7ff947600640 1 -- 172.21.15.162:0/2098616207 wait complete. 2024-01-20T11:08:57.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.847+0000 7ff947600640 1 Processor -- start 2024-01-20T11:08:57.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.847+0000 7ff947600640 1 -- start start 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff947600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff920003f40 0x7ff9400b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff947600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9401f3150 0x7ff9400afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff947600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9400c3f40 0x7ff9400c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff947600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400b21a0 con 0x7ff9400c3f40 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff947600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401f39b0 con 0x7ff9401f3150 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff947600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401f3c90 con 0x7ff920003f40 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff945600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9400c3f40 0x7ff9400c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff945600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9400c3f40 0x7ff9400c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41418/0 (socket says 172.21.15.162:41418) 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff945600640 1 -- 172.21.15.162:0/2071712467 learned_addr learned my addr 172.21.15.162:0/2071712467 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:08:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff944c00640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff920003f40 0x7ff9400b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.848+0000 7ff937c00640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9401f3150 0x7ff9400afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff945600640 1 -- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff920003f40 msgr2=0x7ff9400b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff945600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff920003f40 0x7ff9400b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff945600640 1 -- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9401f3150 msgr2=0x7ff9400afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff945600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9401f3150 0x7ff9400afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff945600640 1 -- 172.21.15.162:0/2071712467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9401f3f70 con 0x7ff9400c3f40 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff945600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9400c3f40 0x7ff9400c43c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff94006fa50 tx=0x7ff93800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff93d600640 1 -- 172.21.15.162:0/2071712467 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800ec10 con 0x7ff9400c3f40 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff93d600640 1 -- 172.21.15.162:0/2071712467 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800ed90 con 0x7ff9400c3f40 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9400b1dc0 con 0x7ff9400c3f40 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff93d600640 1 -- 172.21.15.162:0/2071712467 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938013660 con 0x7ff9400c3f40 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.849+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9401f3770 con 0x7ff9400c3f40 2024-01-20T11:08:57.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.850+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9400ce4b0 con 0x7ff9400c3f40 2024-01-20T11:08:57.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.851+0000 7ff93d600640 1 -- 172.21.15.162:0/2071712467 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff9380137c0 con 0x7ff9400c3f40 2024-01-20T11:08:57.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.853+0000 7ff93d600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff91806aed0 0x7ff91806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:08:57.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.853+0000 7ff93d600640 1 -- 172.21.15.162:0/2071712467 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff938089910 con 0x7ff9400c3f40 2024-01-20T11:08:57.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.853+0000 7ff944c00640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff91806aed0 0x7ff91806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:08:57.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.854+0000 7ff944c00640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff91806aed0 0x7ff91806d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff928009930 tx=0x7ff928008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:08:57.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:57.858+0000 7ff93d600640 1 -- 172.21.15.162:0/2071712467 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff9380547d0 con 0x7ff9400c3f40 2024-01-20T11:08:58.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.099+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9401f3770 con 0x7ff9400c3f40 2024-01-20T11:08:58.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.100+0000 7ff93d600640 1 -- 172.21.15.162:0/2071712467 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7ff9401f3770 con 0x7ff9400c3f40 2024-01-20T11:08:58.100 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:08:58.101 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:08:58.101 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:08:58.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff91806aed0 msgr2=0x7ff91806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:58.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff91806aed0 0x7ff91806d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff928009930 tx=0x7ff928008040 comp rx=0 tx=0).stop 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9400c3f40 msgr2=0x7ff9400c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9400c3f40 0x7ff9400c43c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff94006fa50 tx=0x7ff93800e530 comp rx=0 tx=0).stop 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 shutdown_connections 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9400c3f40 0x7ff9400c43c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff91806aed0 0x7ff91806d390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9401f3150 0x7ff9400afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 --2- 172.21.15.162:0/2071712467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff920003f40 0x7ff9400b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 >> 172.21.15.162:0/2071712467 conn(0x7ff9400b0cd0 msgr2=0x7ff9400ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 shutdown_connections 2024-01-20T11:08:58.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:08:58.103+0000 7ff947600640 1 -- 172.21.15.162:0/2071712467 wait complete. 2024-01-20T11:08:58.122 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache strays_enqueued 2024-01-20T11:08:58.343 INFO:teuthology.orchestra.run.smithi162.stdout:{"mds_cache":{"strays_enqueued":1000}} 2024-01-20T11:08:58.343 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 1000 } } 2024-01-20T11:08:58.343 DEBUG:tasks.ceph_test_case:wait_until_equal: 1000 != 1001, waiting (timeout=600)... 2024-01-20T11:09:03.344 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:03.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.562+0000 7f2d0d200640 1 Processor -- start 2024-01-20T11:09:03.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.562+0000 7f2d0d200640 1 -- start start 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d0d200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2d08155a30 0x7f2d080ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d0d200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2d080ae6b0 0x7f2d0806c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d0d200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d08070b60 con 0x7f2d08070630 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d0d200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0815ba10 con 0x7f2d08155a30 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d0d200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0815bc00 con 0x7f2d080ae6b0 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d05e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2d08155a30 0x7f2d080ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d05e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2d08155a30 0x7f2d080ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41426/0 (socket says 172.21.15.162:41426) 2024-01-20T11:09:03.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d05e00640 1 -- 172.21.15.162:0/2551047936 learned_addr learned my addr 172.21.15.162:0/2551047936 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:03.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.564+0000 7f2d06800640 1 --2- 172.21.15.162:0/2551047936 >> v2:172.21.15.179:3300/0 conn(0x7f2d080ae6b0 0x7f2d0806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:03.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.565+0000 7f2d05e00640 1 -- 172.21.15.162:0/2551047936 >> v2:172.21.15.179:3300/0 conn(0x7f2d080ae6b0 msgr2=0x7f2d0806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:03.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.565+0000 7f2d05e00640 1 --2- 172.21.15.162:0/2551047936 >> v2:172.21.15.179:3300/0 conn(0x7f2d080ae6b0 0x7f2d0806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.565+0000 7f2d05e00640 1 -- 172.21.15.162:0/2551047936 >> v1:172.21.15.162:6789/0 conn(0x7f2d08070630 legacy=0x7f2d080adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:03.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.565+0000 7f2d05e00640 1 -- 172.21.15.162:0/2551047936 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0815bee0 con 0x7f2d08155a30 2024-01-20T11:09:03.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.565+0000 7f2d06800640 1 --2- 172.21.15.162:0/2551047936 >> v2:172.21.15.179:3300/0 conn(0x7f2d080ae6b0 0x7f2d0806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:03.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.566+0000 7f2d05e00640 1 --2- 172.21.15.162:0/2551047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08155a30 0x7f2d080ce800 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2d08071ba0 tx=0x7f2cf802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96ced23b6d871bd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:03.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.566+0000 7f2d04a00640 1 -- 172.21.15.162:0/2551047936 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8031870 con 0x7f2d08155a30 2024-01-20T11:09:03.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.566+0000 7f2d04a00640 1 -- 172.21.15.162:0/2551047936 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf80319d0 con 0x7f2d08155a30 2024-01-20T11:09:03.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.566+0000 7f2d04a00640 1 -- 172.21.15.162:0/2551047936 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8031d60 con 0x7f2d08155a30 2024-01-20T11:09:03.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.566+0000 7f2d0d200640 1 -- 172.21.15.162:0/2551047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08155a30 msgr2=0x7f2d080ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:03.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.566+0000 7f2d0d200640 1 --2- 172.21.15.162:0/2551047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08155a30 0x7f2d080ce800 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2d08071ba0 tx=0x7f2cf802b910 comp rx=0 tx=0).stop 2024-01-20T11:09:03.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.567+0000 7f2d0d200640 1 -- 172.21.15.162:0/2551047936 shutdown_connections 2024-01-20T11:09:03.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.567+0000 7f2d0d200640 1 --2- 172.21.15.162:0/2551047936 >> v2:172.21.15.179:3300/0 conn(0x7f2d080ae6b0 0x7f2d0806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.567+0000 7f2d0d200640 1 --2- 172.21.15.162:0/2551047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08155a30 0x7f2d080ce800 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.567+0000 7f2d0d200640 1 -- 172.21.15.162:0/2551047936 >> 172.21.15.162:0/2551047936 conn(0x7f2d080b0cd0 msgr2=0x7f2d080b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:03.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.567+0000 7f2d0d200640 1 -- 172.21.15.162:0/2551047936 shutdown_connections 2024-01-20T11:09:03.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.567+0000 7f2d0d200640 1 -- 172.21.15.162:0/2551047936 wait complete. 2024-01-20T11:09:03.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.568+0000 7f2d0d200640 1 Processor -- start 2024-01-20T11:09:03.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.568+0000 7f2d0d200640 1 -- start start 2024-01-20T11:09:03.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.569+0000 7f2d0d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08070630 0x7f2d08151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:03.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.569+0000 7f2d0d200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080ae6b0 0x7f2d080b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.569+0000 7f2d0d200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d08155a30 0x7f2d080b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.569+0000 7f2d0d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08152160 con 0x7f2d08070630 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.569+0000 7f2d0d200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080b33b0 con 0x7f2d080ae6b0 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.569+0000 7f2d0d200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080b27a0 con 0x7f2d08155a30 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08070630 0x7f2d08151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08070630 0x7f2d08151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41436/0 (socket says 172.21.15.162:41436) 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 -- 172.21.15.162:0/702264204 learned_addr learned my addr 172.21.15.162:0/702264204 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 -- 172.21.15.162:0/702264204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d08155a30 msgr2=0x7f2d080b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d08155a30 0x7f2d080b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 -- 172.21.15.162:0/702264204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080ae6b0 msgr2=0x7f2d080b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080ae6b0 0x7f2d080b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 -- 172.21.15.162:0/702264204 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80094d0 con 0x7f2d08070630 2024-01-20T11:09:03.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.570+0000 7f2d05e00640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08070630 0x7f2d08151c20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2cf802b950 tx=0x7f2cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:03.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.571+0000 7f2cfe000640 1 -- 172.21.15.162:0/702264204 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8031860 con 0x7f2d08070630 2024-01-20T11:09:03.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.571+0000 7f2cfe000640 1 -- 172.21.15.162:0/702264204 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf80443f0 con 0x7f2d08070630 2024-01-20T11:09:03.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.571+0000 7f2cfe000640 1 -- 172.21.15.162:0/702264204 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80447a0 con 0x7f2d08070630 2024-01-20T11:09:03.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.571+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d080b2a80 con 0x7f2d08070630 2024-01-20T11:09:03.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.571+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d080b3040 con 0x7f2d08070630 2024-01-20T11:09:03.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.572+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0804e970 con 0x7f2d08070630 2024-01-20T11:09:03.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.573+0000 7f2cfe000640 1 -- 172.21.15.162:0/702264204 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2cf8044900 con 0x7f2d08070630 2024-01-20T11:09:03.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.574+0000 7f2cfe000640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ce006aed0 0x7f2ce006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:03.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.574+0000 7f2cfe000640 1 -- 172.21.15.162:0/702264204 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cf802d040 con 0x7f2d08070630 2024-01-20T11:09:03.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.574+0000 7f2d05400640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ce006aed0 0x7f2ce006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:03.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.574+0000 7f2d05400640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ce006aed0 0x7f2ce006d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0000f60 tx=0x7f2cf00079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:03.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.578+0000 7f2cfe000640 1 -- 172.21.15.162:0/702264204 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2cf8077090 con 0x7f2d08070630 2024-01-20T11:09:03.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.806+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d08154500 con 0x7f2d08070630 2024-01-20T11:09:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.807+0000 7f2cfe000640 1 -- 172.21.15.162:0/702264204 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f2cf8035020 con 0x7f2d08070630 2024-01-20T11:09:03.808 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:03.808 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:09:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ce006aed0 msgr2=0x7f2ce006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ce006aed0 0x7f2ce006d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0000f60 tx=0x7f2cf00079d0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08070630 msgr2=0x7f2d08151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08070630 0x7f2d08151c20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2cf802b950 tx=0x7f2cf80046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 shutdown_connections 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d08155a30 0x7f2d080b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ce006aed0 0x7f2ce006d390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080ae6b0 0x7f2d080b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 --2- 172.21.15.162:0/702264204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d08070630 0x7f2d08151c20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 >> 172.21.15.162:0/702264204 conn(0x7f2d080b0cd0 msgr2=0x7f2d080abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 shutdown_connections 2024-01-20T11:09:03.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:03.810+0000 7f2d0d200640 1 -- 172.21.15.162:0/702264204 wait complete. 2024-01-20T11:09:03.830 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache strays_enqueued 2024-01-20T11:09:04.055 INFO:teuthology.orchestra.run.smithi162.stdout:{"mds_cache":{"strays_enqueued":1001}} 2024-01-20T11:09:04.056 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 1001 } } 2024-01-20T11:09:04.056 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:04.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.262+0000 7fc0ffa00640 1 Processor -- start 2024-01-20T11:09:04.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.262+0000 7fc0ffa00640 1 -- start start 2024-01-20T11:09:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0ffa00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc0f80c8350 0x7fc0f80c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0ffa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f815b6e0 con 0x7fc0f815b300 2024-01-20T11:09:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0ffa00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80ce580 con 0x7fc0f806cf00 2024-01-20T11:09:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0ffa00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f80c8d40 con 0x7fc0f80c8350 2024-01-20T11:09:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0fd000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc0f815b300 0x7fc0f80ae4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:35494/0 (socket says 172.21.15.162:35494) 2024-01-20T11:09:04.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0fd000640 1 -- 172.21.15.162:0/1057801038 learned_addr learned my addr 172.21.15.162:0/1057801038 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489531276 0 0) 0x7fc0f815b6e0 con 0x7fc0f815b300 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.264+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d8003520 con 0x7fc0f815b300 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7e00640 1 --2- 172.21.15.162:0/1057801038 >> v2:172.21.15.179:3300/0 conn(0x7fc0f80c8350 0x7fc0f80c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1710318144 0 0) 0x7fc0d8003520 con 0x7fc0f815b300 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 >> v2:172.21.15.179:3300/0 conn(0x7fc0f80c8350 msgr2=0x7fc0f80c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 --2- 172.21.15.162:0/1057801038 >> v2:172.21.15.179:3300/0 conn(0x7fc0f80c8350 0x7fc0f80c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 >> v1:172.21.15.179:6789/0 conn(0x7fc0f806cf00 legacy=0x7fc0f806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80cd6d0 con 0x7fc0f815b300 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fc0e0001670 con 0x7fc0f815b300 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 >> v1:172.21.15.162:6789/0 conn(0x7fc0f815b300 legacy=0x7fc0f80ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d80039c0 0x7fc0d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d80047c0 0x7fc0d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d80052a0 0x7fc0d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80c8d40 con 0x7fc0d80039c0 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d800c1c0 con 0x7fc0d80047c0 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d800c380 con 0x7fc0d80052a0 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.265+0000 7fc0fd000640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d80039c0 0x7fc0d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.266+0000 7fc0f7e00640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d80047c0 0x7fc0d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.266+0000 7fc0fd000640 1 -- 172.21.15.162:0/1057801038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d80052a0 msgr2=0x7fc0d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.266+0000 7fc0fd000640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d80052a0 0x7fc0d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.266+0000 7fc0fd000640 1 -- 172.21.15.162:0/1057801038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d80047c0 msgr2=0x7fc0d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.266+0000 7fc0fd000640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d80047c0 0x7fc0d8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.266+0000 7fc0fd000640 1 -- 172.21.15.162:0/1057801038 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8003520 con 0x7fc0d80039c0 2024-01-20T11:09:04.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.266+0000 7fc0fda00640 1 -- 172.21.15.162:0/1057801038 reap_dead start 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.267+0000 7fc0fd000640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d80039c0 0x7fc0d8003de0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c0e0 tx=0x7fc0d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63feda10d1432915 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.267+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0005ad0 con 0x7fc0d80039c0 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.267+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0005c50 con 0x7fc0d80039c0 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.267+0000 7fc0f7400640 1 -- 172.21.15.162:0/1057801038 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e002c7d0 con 0x7fc0d80039c0 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.267+0000 7fc0ffa00640 1 -- 172.21.15.162:0/1057801038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d80039c0 msgr2=0x7fc0d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.267+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d80039c0 0x7fc0d8003de0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c0e0 tx=0x7fc0d80057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.268+0000 7fc0ffa00640 1 -- 172.21.15.162:0/1057801038 shutdown_connections 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.268+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/1057801038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d80039c0 0x7fc0d8003de0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.268+0000 7fc0ffa00640 1 -- 172.21.15.162:0/1057801038 >> 172.21.15.162:0/1057801038 conn(0x7fc0f80b0cd0 msgr2=0x7fc0f80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.268+0000 7fc0ffa00640 1 -- 172.21.15.162:0/1057801038 shutdown_connections 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.268+0000 7fc0ffa00640 1 -- 172.21.15.162:0/1057801038 wait complete. 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.269+0000 7fc0ffa00640 1 Processor -- start 2024-01-20T11:09:04.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.269+0000 7fc0ffa00640 1 -- start start 2024-01-20T11:09:04.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.270+0000 7fc0ffa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d80039c0 0x7fc0f81f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.270+0000 7fc0ffa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0f80b4ae0 0x7fc0f814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.270+0000 7fc0ffa00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f81599f0 0x7fc0f8157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.270+0000 7fc0ffa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8150140 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.270+0000 7fc0ffa00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80b4f60 con 0x7fc0f81599f0 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.270+0000 7fc0ffa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f81f3200 con 0x7fc0d80039c0 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0f80b4ae0 0x7fc0f814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0f80b4ae0 0x7fc0f814fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41458/0 (socket says 172.21.15.162:41458) 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 -- 172.21.15.162:0/3345255701 learned_addr learned my addr 172.21.15.162:0/3345255701 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 -- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d80039c0 msgr2=0x7fc0f81f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d80039c0 0x7fc0f81f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 -- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f81599f0 msgr2=0x7fc0f8157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0fda00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f81599f0 0x7fc0f8157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f81599f0 0x7fc0f8157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 -- 172.21.15.162:0/3345255701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f815a240 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0fda00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f81599f0 0x7fc0f8157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:04.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.271+0000 7fc0f7e00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0f80b4ae0 0x7fc0f814fc00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8007ef0 tx=0x7fc0e800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:04.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.272+0000 7fc0f4c00640 1 -- 172.21.15.162:0/3345255701 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80145f0 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.272+0000 7fc0f4c00640 1 -- 172.21.15.162:0/3345255701 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e8014750 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.272+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f815a520 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.272+0000 7fc0f4c00640 1 -- 172.21.15.162:0/3345255701 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8014ae0 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.272+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f81f37a0 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.273+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f804e970 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.274+0000 7fc0f4c00640 1 -- 172.21.15.162:0/3345255701 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc0e8014c40 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.275+0000 7fc0f4c00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0d006af00 0x7fc0d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.275+0000 7fc0f4c00640 1 -- 172.21.15.162:0/3345255701 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0e808a3c0 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.275+0000 7fc0fd000640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0d006af00 0x7fc0d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.276+0000 7fc0fd000640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0d006af00 0x7fc0d006d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0034000 tx=0x7fc0e0039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:04.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.280+0000 7fc0f4c00640 1 -- 172.21.15.162:0/3345255701 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc0e80551f0 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.516+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0f806caa0 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.517+0000 7fc0f4c00640 1 -- 172.21.15.162:0/3345255701 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fc0e8058810 con 0x7fc0f80b4ae0 2024-01-20T11:09:04.518 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:04.518 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:09:04.518 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0d006af00 msgr2=0x7fc0d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0d006af00 0x7fc0d006d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0034000 tx=0x7fc0e0039040 comp rx=0 tx=0).stop 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0f80b4ae0 msgr2=0x7fc0f814fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0f80b4ae0 0x7fc0f814fc00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8007ef0 tx=0x7fc0e800f520 comp rx=0 tx=0).stop 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 shutdown_connections 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc0d006af00 0x7fc0d006d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f81599f0 0x7fc0f8157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0f80b4ae0 0x7fc0f814fc00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 --2- 172.21.15.162:0/3345255701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d80039c0 0x7fc0f81f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.520+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 >> 172.21.15.162:0/3345255701 conn(0x7fc0f80b0cd0 msgr2=0x7fc0f80ad510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.521+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 shutdown_connections 2024-01-20T11:09:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.521+0000 7fc0ffa00640 1 -- 172.21.15.162:0/3345255701 wait complete. 2024-01-20T11:09:04.540 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump purge_queue pq_executed 2024-01-20T11:09:04.770 INFO:teuthology.orchestra.run.smithi162.stdout:{"purge_queue":{"pq_executed":1001}} 2024-01-20T11:09:04.771 DEBUG:tasks.cephfs.filesystem:_json_asok output { "purge_queue": { "pq_executed": 1001 } } 2024-01-20T11:09:04.771 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-01-20T11:09:04.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.877+0000 7f96a5c39f40 1 Processor -- start 2024-01-20T11:09:04.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.878+0000 7f96a5c39f40 1 -- start start 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.878+0000 7f96a5c39f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86717dda0 0x55d8671ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.878+0000 7f96a5c39f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d8671b0c30 0x55d86717bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.878+0000 7f96a5c39f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867240420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a5c39f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d867130fb0 con 0x55d86717dda0 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a5c39f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86712c8a0 con 0x55d8671b0c30 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a5c39f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8670e2ff0 con 0x55d867255d80 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86717dda0 0x55d8671ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86717dda0 0x55d8671ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41464/0 (socket says 172.21.15.162:41464) 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 -- 172.21.15.162:0/3762134650 learned_addr learned my addr 172.21.15.162:0/3762134650 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 -- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 msgr2=0x55d867240420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a3000640 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867240420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a1c00640 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d8671b0c30 0x55d86717bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867240420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 -- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d8671b0c30 msgr2=0x55d86717bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:04.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d8671b0c30 0x55d86717bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a2600640 1 -- 172.21.15.162:0/3762134650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c005de0 con 0x55d86717dda0 2024-01-20T11:09:04.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.879+0000 7f96a3000640 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867240420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:04.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a2600640 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86717dda0 0x55d8671ac2b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f96940014d0 tx=0x7f9694001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb56acc7017b9a78 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f969be00640 1 -- 172.21.15.162:0/3762134650 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400f710 con 0x55d86717dda0 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f969be00640 1 -- 172.21.15.162:0/3762134650 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969400f890 con 0x55d86717dda0 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f969be00640 1 -- 172.21.15.162:0/3762134650 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400fc40 con 0x55d86717dda0 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a5c39f40 1 -- 172.21.15.162:0/3762134650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86717dda0 msgr2=0x55d8671ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86717dda0 0x55d8671ac2b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f96940014d0 tx=0x7f9694001990 comp rx=0 tx=0).stop 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a5c39f40 1 -- 172.21.15.162:0/3762134650 shutdown_connections 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867240420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d8671b0c30 0x55d86717bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/3762134650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d86717dda0 0x55d8671ac2b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.880+0000 7f96a5c39f40 1 -- 172.21.15.162:0/3762134650 >> 172.21.15.162:0/3762134650 conn(0x55d8671cbf40 msgr2=0x55d8671cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:04.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.881+0000 7f96a5c39f40 1 -- 172.21.15.162:0/3762134650 shutdown_connections 2024-01-20T11:09:04.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.881+0000 7f96a5c39f40 1 -- 172.21.15.162:0/3762134650 wait complete. 2024-01-20T11:09:04.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.881+0000 7f96a5c39f40 1 Processor -- start 2024-01-20T11:09:04.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.881+0000 7f96a5c39f40 1 -- start start 2024-01-20T11:09:04.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.882+0000 7f96a5c39f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d86717dda0 0x55d867251830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.882+0000 7f96a5c39f40 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8671b0c30 0x55d8671ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.882+0000 7f96a5c39f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867249340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.882+0000 7f96a5c39f40 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8670c5df0 con 0x55d8671b0c30 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.882+0000 7f96a5c39f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8670b9950 con 0x55d86717dda0 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.882+0000 7f96a5c39f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d867252e00 con 0x55d867255d80 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8671b0c30 0x55d8671ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8671b0c30 0x55d8671ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41474/0 (socket says 172.21.15.162:41474) 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 -- 172.21.15.162:0/2990711455 learned_addr learned my addr 172.21.15.162:0/2990711455 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a3000640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867249340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 -- 172.21.15.162:0/2990711455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 msgr2=0x55d867249340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d867255d80 0x55d867249340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 -- 172.21.15.162:0/2990711455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d86717dda0 msgr2=0x55d867251830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d86717dda0 0x55d867251830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 -- 172.21.15.162:0/2990711455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8670c48d0 con 0x55d8671b0c30 2024-01-20T11:09:04.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.883+0000 7f96a1c00640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8671b0c30 0x55d8671ca590 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f968c00a4f0 tx=0x7f968c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:04.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.884+0000 7f969aa00640 1 -- 172.21.15.162:0/2990711455 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c052e60 con 0x55d8671b0c30 2024-01-20T11:09:04.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.884+0000 7f969aa00640 1 -- 172.21.15.162:0/2990711455 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c05d480 con 0x55d8671b0c30 2024-01-20T11:09:04.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.884+0000 7f969aa00640 1 -- 172.21.15.162:0/2990711455 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c05d7f0 con 0x55d8671b0c30 2024-01-20T11:09:04.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.884+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d8670c4c60 con 0x55d8671b0c30 2024-01-20T11:09:04.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.884+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8670c46c0 con 0x55d8671b0c30 2024-01-20T11:09:04.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.886+0000 7f969aa00640 1 -- 172.21.15.162:0/2990711455 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f968c059040 con 0x55d8671b0c30 2024-01-20T11:09:04.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.887+0000 7f969aa00640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f967c0698b0 0x7f967c06bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.887+0000 7f969aa00640 1 -- 172.21.15.162:0/2990711455 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f968c0ca380 con 0x55d8671b0c30 2024-01-20T11:09:04.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.887+0000 7f96a2600640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f967c0698b0 0x7f967c06bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.887+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x55d867252970 0x55d8672edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:04.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.887+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 --> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55d867251d70 con 0x55d867252970 2024-01-20T11:09:04.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.888+0000 7f96a3000640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x55d867252970 0x55d8672edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:04.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.888+0000 7f96a2600640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f967c0698b0 0x7f967c06bd70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9694001350 tx=0x7f969400f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:04.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.888+0000 7f96a3000640 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x55d867252970 0x55d8672edfe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a3000640 1 -- 172.21.15.162:0/2990711455 <== osd.3 v2:172.21.15.162:6807/6791816 1 ==== osd_op_reply(1 10000000000.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f969c00f3a0 con 0x55d867252970 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr: error stat-ing cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x55d867252970 msgr2=0x55d8672edfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x55d867252970 0x55d8672edfe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f967c0698b0 msgr2=0x7f967c06bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f967c0698b0 0x7f967c06bd70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9694001350 tx=0x7f969400f000 comp rx=0 tx=0).stop 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8671b0c30 msgr2=0x55d8671ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 --2- 172.21.15.162:0/2990711455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8671b0c30 0x55d8671ca590 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f968c00a4f0 tx=0x7f968c002fb0 comp rx=0 tx=0).stop 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a3000640 1 -- 172.21.15.162:0/2990711455 reap_dead start 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 shutdown_connections 2024-01-20T11:09:04.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 >> 172.21.15.162:0/2990711455 conn(0x55d8671cbf40 msgr2=0x55d86717c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:04.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 shutdown_connections 2024-01-20T11:09:04.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:04.889+0000 7f96a5c39f40 1 -- 172.21.15.162:0/2990711455 wait complete. 2024-01-20T11:09:04.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:09:04.894 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-01-20T11:09:05.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.093+0000 7f6929600640 1 Processor -- start 2024-01-20T11:09:05.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.093+0000 7f6929600640 1 -- start start 2024-01-20T11:09:05.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.094+0000 7f6929600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f692415a320 0x7f692415b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.094+0000 7f6929600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6924071260 con 0x7f69240b4180 2024-01-20T11:09:05.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.094+0000 7f6929600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240709f0 con 0x7f692415e930 2024-01-20T11:09:05.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.094+0000 7f6929600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6924070cd0 con 0x7f692415a320 2024-01-20T11:09:05.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6923400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f69240b4180 0x7f69240cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:35512/0 (socket says 172.21.15.162:35512) 2024-01-20T11:09:05.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6923400640 1 -- 172.21.15.162:0/2815986 learned_addr learned my addr 172.21.15.162:0/2815986 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:05.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858250974 0 0) 0x7f6924071260 con 0x7f69240b4180 2024-01-20T11:09:05.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6922a00640 1 --2- 172.21.15.162:0/2815986 >> v2:172.21.15.179:3300/0 conn(0x7f692415a320 0x7f692415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6904005730 con 0x7f69240b4180 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690408027 0 0) 0x7f6904005730 con 0x7f69240b4180 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 >> v2:172.21.15.179:3300/0 conn(0x7f692415a320 msgr2=0x7f692415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6921600640 1 --2- 172.21.15.162:0/2815986 >> v2:172.21.15.179:3300/0 conn(0x7f692415a320 0x7f692415b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 >> v1:172.21.15.179:6789/0 conn(0x7f692415e930 legacy=0x7f69240b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.095+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692415aa40 con 0x7f69240b4180 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f691c0019f0 con 0x7f69240b4180 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 >> v1:172.21.15.162:6789/0 conn(0x7f69240b4180 legacy=0x7f69240cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6904005b80 0x7f6904005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69040069d0 0x7f6904006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6904007390 0x7f690400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6924070cd0 con 0x7f6904007390 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690400e230 con 0x7f69040069d0 2024-01-20T11:09:05.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690400e3f0 con 0x7f6904005b80 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6923400640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6904007390 0x7f690400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6922a00640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6904005b80 0x7f6904005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6923400640 1 -- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6904005b80 msgr2=0x7f6904005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6922000640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69040069d0 0x7f6904006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6923400640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6904005b80 0x7f6904005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.096+0000 7f6923400640 1 -- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69040069d0 msgr2=0x7f6904006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.097+0000 7f6923400640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69040069d0 0x7f6904006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.097+0000 7f6923400640 1 -- 172.21.15.162:0/2815986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904005730 con 0x7f6904007390 2024-01-20T11:09:05.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.097+0000 7f6923400640 1 -- 172.21.15.162:0/2815986 reap_dead start 2024-01-20T11:09:05.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6923400640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6904007390 0x7f690400db90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a830 tx=0x7f6904007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e456314b9c279ead server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0072d0 con 0x7f6904007390 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c02f070 con 0x7f6904007390 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6921600640 1 -- 172.21.15.162:0/2815986 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0076b0 con 0x7f6904007390 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6929600640 1 -- 172.21.15.162:0/2815986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6904007390 msgr2=0x7f690400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6929600640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6904007390 0x7f690400db90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a830 tx=0x7f6904007a00 comp rx=0 tx=0).stop 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6929600640 1 -- 172.21.15.162:0/2815986 shutdown_connections 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6929600640 1 --2- 172.21.15.162:0/2815986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6904007390 0x7f690400db90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.098+0000 7f6929600640 1 -- 172.21.15.162:0/2815986 >> 172.21.15.162:0/2815986 conn(0x7f692406a600 msgr2=0x7f692406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.099+0000 7f6929600640 1 -- 172.21.15.162:0/2815986 shutdown_connections 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.099+0000 7f6929600640 1 -- 172.21.15.162:0/2815986 wait complete. 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.100+0000 7f6929600640 1 Processor -- start 2024-01-20T11:09:05.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.100+0000 7f6929600640 1 -- start start 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.101+0000 7f6929600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6904007390 0x7f69241ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.101+0000 7f6929600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240b2850 0x7f69240b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.101+0000 7f6929600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69240c9f70 0x7f69240ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.101+0000 7f6929600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241f4210 con 0x7f69240c9f70 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.101+0000 7f6929600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240b3210 con 0x7f6904007390 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.101+0000 7f6929600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692414f670 con 0x7f69240b2850 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69240c9f70 0x7f69240ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69240c9f70 0x7f69240ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41482/0 (socket says 172.21.15.162:41482) 2024-01-20T11:09:05.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 -- 172.21.15.162:0/2482141626 learned_addr learned my addr 172.21.15.162:0/2482141626 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6922a00640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6904007390 0x7f69241ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6922000640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240b2850 0x7f69240b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 -- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240b2850 msgr2=0x7f69240b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240b2850 0x7f69240b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 -- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6904007390 msgr2=0x7f69241ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6904007390 0x7f69241ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 -- 172.21.15.162:0/2482141626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69241f3870 con 0x7f69240c9f70 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6922000640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240b2850 0x7f69240b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.102+0000 7f6923400640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69240c9f70 0x7f69240ca420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f691c000f80 tx=0x7f691c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.103+0000 7f691aa00640 1 -- 172.21.15.162:0/2482141626 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0019b0 con 0x7f69240c9f70 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.103+0000 7f691aa00640 1 -- 172.21.15.162:0/2482141626 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c004b60 con 0x7f69240c9f70 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.103+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241f3b50 con 0x7f69240c9f70 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.103+0000 7f691aa00640 1 -- 172.21.15.162:0/2482141626 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c007400 con 0x7f69240c9f70 2024-01-20T11:09:05.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.103+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69240ca960 con 0x7f69240c9f70 2024-01-20T11:09:05.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.104+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69241f4350 con 0x7f69240c9f70 2024-01-20T11:09:05.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.105+0000 7f691aa00640 1 -- 172.21.15.162:0/2482141626 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f691c031030 con 0x7f69240c9f70 2024-01-20T11:09:05.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.106+0000 7f691aa00640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f68fc06af00 0x7f68fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.106+0000 7f691aa00640 1 -- 172.21.15.162:0/2482141626 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f691c0ab170 con 0x7f69240c9f70 2024-01-20T11:09:05.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.106+0000 7f6922a00640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f68fc06af00 0x7f68fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.107+0000 7f6922a00640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f68fc06af00 0x7f68fc06d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6914009990 tx=0x7f6914008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:05.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.110+0000 7f691aa00640 1 -- 172.21.15.162:0/2482141626 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f69241f4350 con 0x7f69240c9f70 2024-01-20T11:09:05.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.374+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f69241f4350 con 0x7f69240c9f70 2024-01-20T11:09:05.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.375+0000 7f691aa00640 1 -- 172.21.15.162:0/2482141626 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1656 (secure 0 0 0) 0x7f69241f4350 con 0x7f69240c9f70 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "stats": { 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "total_bytes": 773094113280, 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "total_avail_bytes": 772841357312, 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "total_used_bytes": 252755968, 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "total_used_raw_bytes": 252755968, 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "total_used_raw_ratio": 0.00032694076071493328, 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "num_osds": 8, 2024-01-20T11:09:05.376 INFO:teuthology.orchestra.run.smithi162.stdout: "num_per_pool_osds": 8, 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "num_per_pool_omap_osds": 8 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "stats_by_class": { 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "ssd": { 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "total_bytes": 773094113280, 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "total_avail_bytes": 772841357312, 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "total_used_bytes": 252755968, 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "total_used_raw_bytes": 252755968, 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "total_used_raw_ratio": 0.00032694076071493328 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "pools": [ 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "name": ".mgr", 2024-01-20T11:09:05.377 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 1, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "stats": { 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "stored": 590368, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "objects": 2, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "kb_used": 1160, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "bytes_used": 1187840, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "percent_used": 1.6179825479412102e-06, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "max_avail": 367073820672 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "name": "cephfs_metadata", 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4, 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "stats": { 2024-01-20T11:09:05.378 INFO:teuthology.orchestra.run.smithi162.stdout: "stored": 758749, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "objects": 24, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "kb_used": 1544, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "bytes_used": 1581056, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "percent_used": 2.153589548470336e-06, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "max_avail": 367073820672 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "name": "cephfs_data", 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 5, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "stats": { 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "stored": 0, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "objects": 0, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "kb_used": 0, 2024-01-20T11:09:05.379 INFO:teuthology.orchestra.run.smithi162.stdout: "bytes_used": 0, 2024-01-20T11:09:05.380 INFO:teuthology.orchestra.run.smithi162.stdout: "percent_used": 0, 2024-01-20T11:09:05.380 INFO:teuthology.orchestra.run.smithi162.stdout: "max_avail": 367073820672 2024-01-20T11:09:05.380 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:05.380 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:05.380 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-01-20T11:09:05.380 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f68fc06af00 msgr2=0x7f68fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f68fc06af00 0x7f68fc06d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6914009990 tx=0x7f6914008040 comp rx=0 tx=0).stop 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69240c9f70 msgr2=0x7f69240ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69240c9f70 0x7f69240ca420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f691c000f80 tx=0x7f691c001d80 comp rx=0 tx=0).stop 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 shutdown_connections 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69240c9f70 0x7f69240ca420 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240b2850 0x7f69240b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f68fc06af00 0x7f68fc06d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 --2- 172.21.15.162:0/2482141626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6904007390 0x7f69241ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 >> 172.21.15.162:0/2482141626 conn(0x7f692406a600 msgr2=0x7f69240b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:05.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 shutdown_connections 2024-01-20T11:09:05.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.378+0000 7f6929600640 1 -- 172.21.15.162:0/2482141626 wait complete. 2024-01-20T11:09:05.397 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-01-20T11:09:05.398 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T11:09:05.398 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:09:05.507 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:09:05.625 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T11:09:05.625 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:05.625 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:05.679 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:05.679 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:05.728 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:05.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.985+0000 7f632b400640 1 Processor -- start 2024-01-20T11:09:05.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.985+0000 7f632b400640 1 -- start start 2024-01-20T11:09:05.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f632b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63240cfa80 0x7f63240cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f632b400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632415b910 con 0x7f632413e040 2024-01-20T11:09:05.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f632b400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632415bbf0 con 0x7f63240cd9c0 2024-01-20T11:09:05.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f632b400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632415fe00 con 0x7f63240cfa80 2024-01-20T11:09:05.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f632a000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f632413e040 0x7f63240cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:35522/0 (socket says 172.21.15.162:35522) 2024-01-20T11:09:05.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f632a000640 1 -- 172.21.15.162:0/1213141306 learned_addr learned my addr 172.21.15.162:0/1213141306 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f6329600640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63240cfa80 0x7f63240cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.987+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636882833 0 0) 0x7f632415b910 con 0x7f632413e040 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6304003520 con 0x7f632413e040 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4092115745 0 0) 0x7f6304003520 con 0x7f632413e040 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63240cfa80 msgr2=0x7f63240cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63240cfa80 0x7f63240cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 >> v1:172.21.15.179:6789/0 conn(0x7f63240cd9c0 legacy=0x7f63240cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632415bed0 con 0x7f632413e040 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f6314001670 con 0x7f632413e040 2024-01-20T11:09:05.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 >> v1:172.21.15.162:6789/0 conn(0x7f632413e040 legacy=0x7f63240cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6304003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63040047c0 0x7f6304004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6304005250 0x7f630400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632415fe00 con 0x7f63040039a0 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630400c120 con 0x7f63040047c0 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630400c2e0 con 0x7f6304005250 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f6329600640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63240cfa80 0x7f63240cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.988+0000 7f632a000640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6304003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.989+0000 7f632a000640 1 -- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6304005250 msgr2=0x7f630400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.989+0000 7f632a000640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6304005250 0x7f630400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.989+0000 7f632a000640 1 -- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63040047c0 msgr2=0x7f6304004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.989+0000 7f632a000640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63040047c0 0x7f6304004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.989+0000 7f632a000640 1 -- 172.21.15.162:0/1213141306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304003520 con 0x7f63040039a0 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.990+0000 7f632a000640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6304003dc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f631400c0e0 tx=0x7f63040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afd816a8681459f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.990+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314005ad0 con 0x7f63040039a0 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.990+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314005c30 con 0x7f63040039a0 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.990+0000 7f6328c00640 1 -- 172.21.15.162:0/1213141306 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631402c7d0 con 0x7f63040039a0 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.991+0000 7f632b400640 1 -- 172.21.15.162:0/1213141306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 msgr2=0x7f6304003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.991+0000 7f632b400640 1 --2- 172.21.15.162:0/1213141306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6304003dc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f631400c0e0 tx=0x7f63040057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.991+0000 7f632aa00640 1 -- 172.21.15.162:0/1213141306 reap_dead start 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.991+0000 7f632b400640 1 -- 172.21.15.162:0/1213141306 shutdown_connections 2024-01-20T11:09:05.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.991+0000 7f632b400640 1 -- 172.21.15.162:0/1213141306 >> 172.21.15.162:0/1213141306 conn(0x7f632406aa20 msgr2=0x7f632406ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:05.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.991+0000 7f632b400640 1 -- 172.21.15.162:0/1213141306 shutdown_connections 2024-01-20T11:09:05.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.991+0000 7f632b400640 1 -- 172.21.15.162:0/1213141306 wait complete. 2024-01-20T11:09:05.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.993+0000 7f632b400640 1 Processor -- start 2024-01-20T11:09:05.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.993+0000 7f632b400640 1 -- start start 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.994+0000 7f632b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6324141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.994+0000 7f632b400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63240718c0 0x7f6324070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.994+0000 7f632b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632413c500 0x7f6324144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.994+0000 7f632b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324143e60 con 0x7f63040039a0 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.994+0000 7f632b400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324141f90 con 0x7f63240718c0 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.994+0000 7f632b400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632413e7c0 con 0x7f632413c500 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6324141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6324141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41488/0 (socket says 172.21.15.162:41488) 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 -- 172.21.15.162:0/2263777548 learned_addr learned my addr 172.21.15.162:0/2263777548 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:05.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 -- 172.21.15.162:0/2263777548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632413c500 msgr2=0x7f6324144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632413c500 0x7f6324144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 -- 172.21.15.162:0/2263777548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63240718c0 msgr2=0x7f6324070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:05.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63240718c0 0x7f6324070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:05.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 -- 172.21.15.162:0/2263777548 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632413eaa0 con 0x7f63040039a0 2024-01-20T11:09:05.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.995+0000 7f632a000640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6324141a50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f631400c0e0 tx=0x7f632415c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:05.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.996+0000 7f6322000640 1 -- 172.21.15.162:0/2263777548 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631402cbe0 con 0x7f63040039a0 2024-01-20T11:09:05.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.996+0000 7f6322000640 1 -- 172.21.15.162:0/2263777548 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631402cd40 con 0x7f63040039a0 2024-01-20T11:09:05.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.996+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632413ed80 con 0x7f63040039a0 2024-01-20T11:09:05.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.996+0000 7f6322000640 1 -- 172.21.15.162:0/2263777548 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314007270 con 0x7f63040039a0 2024-01-20T11:09:05.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.996+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632413f340 con 0x7f63040039a0 2024-01-20T11:09:05.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.997+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6324074a30 con 0x7f63040039a0 2024-01-20T11:09:05.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.998+0000 7f6322000640 1 -- 172.21.15.162:0/2263777548 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6314032070 con 0x7f63040039a0 2024-01-20T11:09:06.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.999+0000 7f6322000640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f62fc06af00 0x7f62fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:05.999+0000 7f6322000640 1 -- 172.21.15.162:0/2263777548 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63140aa8e0 con 0x7f63040039a0 2024-01-20T11:09:06.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.000+0000 7f6329600640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f62fc06af00 0x7f62fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.000+0000 7f6329600640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f62fc06af00 0x7f62fc06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f630c006fd0 tx=0x7f630c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:06.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.004+0000 7f6322000640 1 -- 172.21.15.162:0/2263777548 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6314075850 con 0x7f63040039a0 2024-01-20T11:09:06.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.197+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f632406dff0 con 0x7f63040039a0 2024-01-20T11:09:06.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.199+0000 7f6322000640 1 -- 172.21.15.162:0/2263777548 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f6314045020 con 0x7f63040039a0 2024-01-20T11:09:06.201 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:06.201 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":36,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:42.965160+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:08:38.930132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T11:08:40.039032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:06.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f62fc06af00 msgr2=0x7f62fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f62fc06af00 0x7f62fc06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f630c006fd0 tx=0x7f630c008040 comp rx=0 tx=0).stop 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 msgr2=0x7f6324141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6324141a50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f631400c0e0 tx=0x7f632415c490 comp rx=0 tx=0).stop 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 shutdown_connections 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632413c500 0x7f6324144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f62fc06af00 0x7f62fc06d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63240718c0 0x7f6324070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 --2- 172.21.15.162:0/2263777548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63040039a0 0x7f6324141a50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 >> 172.21.15.162:0/2263777548 conn(0x7f632406aa20 msgr2=0x7f632415dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 shutdown_connections 2024-01-20T11:09:06.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.203+0000 7f632b400640 1 -- 172.21.15.162:0/2263777548 wait complete. 2024-01-20T11:09:06.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:08:38.930132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:08:40.039032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:09:06.222 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:09:06.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.427+0000 7f0a88e00640 1 Processor -- start 2024-01-20T11:09:06.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.427+0000 7f0a88e00640 1 -- start start 2024-01-20T11:09:06.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.429+0000 7f0a88e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a84141bb0 0x7f0a840ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.429+0000 7f0a88e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a840ce6a0 0x7f0a8406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.429+0000 7f0a88e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840cee70 con 0x7f0a840cdc30 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.429+0000 7f0a88e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840cd7a0 con 0x7f0a84141bb0 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.429+0000 7f0a88e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840ceb90 con 0x7f0a840ce6a0 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.429+0000 7f0a81e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a84141bb0 0x7f0a840ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a81e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a84141bb0 0x7f0a840ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41490/0 (socket says 172.21.15.162:41490) 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a81e00640 1 -- 172.21.15.162:0/3382263791 learned_addr learned my addr 172.21.15.162:0/3382263791 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a7be00640 1 --2- 172.21.15.162:0/3382263791 >> v2:172.21.15.179:3300/0 conn(0x7f0a840ce6a0 0x7f0a8406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a81e00640 1 -- 172.21.15.162:0/3382263791 >> v2:172.21.15.179:3300/0 conn(0x7f0a840ce6a0 msgr2=0x7f0a8406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a81e00640 1 --2- 172.21.15.162:0/3382263791 >> v2:172.21.15.179:3300/0 conn(0x7f0a840ce6a0 0x7f0a8406c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a81e00640 1 -- 172.21.15.162:0/3382263791 >> v1:172.21.15.179:6789/0 conn(0x7f0a840cdc30 legacy=0x7f0a8415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a81e00640 1 -- 172.21.15.162:0/3382263791 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840cd150 con 0x7f0a84141bb0 2024-01-20T11:09:06.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.430+0000 7f0a7be00640 1 --2- 172.21.15.162:0/3382263791 >> v2:172.21.15.179:3300/0 conn(0x7f0a840ce6a0 0x7f0a8406c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:06.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.431+0000 7f0a81e00640 1 --2- 172.21.15.162:0/3382263791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840ce160 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0a8406e8c0 tx=0x7f0a7402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48942534ca05af4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:06.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.432+0000 7f0a81400640 1 -- 172.21.15.162:0/3382263791 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740317e0 con 0x7f0a84141bb0 2024-01-20T11:09:06.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.432+0000 7f0a81400640 1 -- 172.21.15.162:0/3382263791 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74031940 con 0x7f0a84141bb0 2024-01-20T11:09:06.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.432+0000 7f0a81400640 1 -- 172.21.15.162:0/3382263791 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74031cd0 con 0x7f0a84141bb0 2024-01-20T11:09:06.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.432+0000 7f0a88e00640 1 -- 172.21.15.162:0/3382263791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 msgr2=0x7f0a840ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.432+0000 7f0a88e00640 1 --2- 172.21.15.162:0/3382263791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840ce160 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0a8406e8c0 tx=0x7f0a7402b880 comp rx=0 tx=0).stop 2024-01-20T11:09:06.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.433+0000 7f0a88e00640 1 -- 172.21.15.162:0/3382263791 shutdown_connections 2024-01-20T11:09:06.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.433+0000 7f0a88e00640 1 --2- 172.21.15.162:0/3382263791 >> v2:172.21.15.179:3300/0 conn(0x7f0a840ce6a0 0x7f0a8406c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.433+0000 7f0a88e00640 1 --2- 172.21.15.162:0/3382263791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840ce160 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.433+0000 7f0a88e00640 1 -- 172.21.15.162:0/3382263791 >> 172.21.15.162:0/3382263791 conn(0x7f0a8406a600 msgr2=0x7f0a8406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:06.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.433+0000 7f0a88e00640 1 -- 172.21.15.162:0/3382263791 shutdown_connections 2024-01-20T11:09:06.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.433+0000 7f0a88e00640 1 -- 172.21.15.162:0/3382263791 wait complete. 2024-01-20T11:09:06.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.434+0000 7f0a88e00640 1 Processor -- start 2024-01-20T11:09:06.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.434+0000 7f0a88e00640 1 -- start start 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.435+0000 7f0a88e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a840cdc30 0x7f0a8415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.435+0000 7f0a88e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a840ce6a0 0x7f0a840b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.435+0000 7f0a88e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.435+0000 7f0a88e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8415b390 con 0x7f0a84141bb0 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.435+0000 7f0a88e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8413b5c0 con 0x7f0a840cdc30 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.435+0000 7f0a88e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8413b810 con 0x7f0a840ce6a0 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41506/0 (socket says 172.21.15.162:41506) 2024-01-20T11:09:06.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 -- 172.21.15.162:0/2701346034 learned_addr learned my addr 172.21.15.162:0/2701346034 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a81e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a840cdc30 0x7f0a8415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a7be00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a840ce6a0 0x7f0a840b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 -- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a840ce6a0 msgr2=0x7f0a840b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a840ce6a0 0x7f0a840b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 -- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a840cdc30 msgr2=0x7f0a8415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a840cdc30 0x7f0a8415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a82800640 1 -- 172.21.15.162:0/2701346034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740094d0 con 0x7f0a84141bb0 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.436+0000 7f0a7be00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a840ce6a0 0x7f0a840b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.437+0000 7f0a82800640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840b2680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c780 tx=0x7f0a7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.437+0000 7f0a7a000640 1 -- 172.21.15.162:0/2701346034 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004b60 con 0x7f0a84141bb0 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.437+0000 7f0a7a000640 1 -- 172.21.15.162:0/2701346034 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c00ce90 con 0x7f0a84141bb0 2024-01-20T11:09:06.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.437+0000 7f0a7a000640 1 -- 172.21.15.162:0/2701346034 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00a850 con 0x7f0a84141bb0 2024-01-20T11:09:06.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.437+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8413baf0 con 0x7f0a84141bb0 2024-01-20T11:09:06.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.437+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8413c0b0 con 0x7f0a84141bb0 2024-01-20T11:09:06.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.438+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8404e970 con 0x7f0a84141bb0 2024-01-20T11:09:06.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.439+0000 7f0a7a000640 1 -- 172.21.15.162:0/2701346034 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0a7c00a9b0 con 0x7f0a84141bb0 2024-01-20T11:09:06.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.440+0000 7f0a7a000640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0a5c06aed0 0x7f0a5c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.440+0000 7f0a7a000640 1 -- 172.21.15.162:0/2701346034 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a7c0897c0 con 0x7f0a84141bb0 2024-01-20T11:09:06.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.440+0000 7f0a81e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0a5c06aed0 0x7f0a5c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.441+0000 7f0a81e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0a5c06aed0 0x7f0a5c06d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a74036000 tx=0x7f0a7403d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:06.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.444+0000 7f0a7a000640 1 -- 172.21.15.162:0/2701346034 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0a7c054690 con 0x7f0a84141bb0 2024-01-20T11:09:06.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.637+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a840cff80 con 0x7f0a84141bb0 2024-01-20T11:09:06.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.638+0000 7f0a7a000640 1 -- 172.21.15.162:0/2701346034 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a7c057cb0 con 0x7f0a84141bb0 2024-01-20T11:09:06.639 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:09:06.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.640+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0a5c06aed0 msgr2=0x7f0a5c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.640+0000 7f0a88e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0a5c06aed0 0x7f0a5c06d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a74036000 tx=0x7f0a7403d040 comp rx=0 tx=0).stop 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 msgr2=0x7f0a840b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840b2680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c780 tx=0x7f0a7c00cc40 comp rx=0 tx=0).stop 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 shutdown_connections 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a84141bb0 0x7f0a840b2680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a840ce6a0 0x7f0a840b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0a5c06aed0 0x7f0a5c06d390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 --2- 172.21.15.162:0/2701346034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a840cdc30 0x7f0a8415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 >> 172.21.15.162:0/2701346034 conn(0x7f0a8406a600 msgr2=0x7f0a84071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 shutdown_connections 2024-01-20T11:09:06.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.641+0000 7f0a88e00640 1 -- 172.21.15.162:0/2701346034 wait complete. 2024-01-20T11:09:06.659 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:09:06.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.870+0000 7f6be2a00640 1 Processor -- start 2024-01-20T11:09:06.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.871+0000 7f6be2a00640 1 -- start start 2024-01-20T11:09:06.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.872+0000 7f6be2a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 0x7f6bdc15efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.872+0000 7f6be2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6bdc06cce0 0x7f6bdc140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.872+0000 7f6be2a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc15f960 con 0x7f6bdc15f520 2024-01-20T11:09:06.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.872+0000 7f6be2a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc06d3a0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.872+0000 7f6be2a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0ccc70 con 0x7f6bdc13e380 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.872+0000 7f6be0a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6bdc06cce0 0x7f6bdc140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.873+0000 7f6be0a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6bdc06cce0 0x7f6bdc140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51536/0 (socket says 172.21.15.162:51536) 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.873+0000 7f6be0a00640 1 -- 172.21.15.162:0/173265138 learned_addr learned my addr 172.21.15.162:0/173265138 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.873+0000 7f6bdbe00640 1 --2- 172.21.15.162:0/173265138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 0x7f6bdc15efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.873+0000 7f6be0a00640 1 -- 172.21.15.162:0/173265138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 msgr2=0x7f6bdc15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.873+0000 7f6be0a00640 1 --2- 172.21.15.162:0/173265138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 0x7f6bdc15efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.873+0000 7f6be0a00640 1 -- 172.21.15.162:0/173265138 >> v1:172.21.15.179:6789/0 conn(0x7f6bdc15f520 legacy=0x7f6bdc06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:06.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.873+0000 7f6be0a00640 1 -- 172.21.15.162:0/173265138 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc06d150 con 0x7f6bdc06cce0 2024-01-20T11:09:06.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.874+0000 7f6be0a00640 1 --2- 172.21.15.162:0/173265138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc140c10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009e50 tx=0x7f6bd402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468333a98560495 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:06.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.874+0000 7f6bdb400640 1 -- 172.21.15.162:0/173265138 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd402ca70 con 0x7f6bdc06cce0 2024-01-20T11:09:06.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.874+0000 7f6bdb400640 1 -- 172.21.15.162:0/173265138 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd402cbd0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.874+0000 7f6bdb400640 1 -- 172.21.15.162:0/173265138 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40343f0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 -- 172.21.15.162:0/173265138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 msgr2=0x7f6bdc140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 --2- 172.21.15.162:0/173265138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc140c10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009e50 tx=0x7f6bd402bed0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 -- 172.21.15.162:0/173265138 shutdown_connections 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 --2- 172.21.15.162:0/173265138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc140c10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 --2- 172.21.15.162:0/173265138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 0x7f6bdc15efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 -- 172.21.15.162:0/173265138 >> 172.21.15.162:0/173265138 conn(0x7f6bdc06a600 msgr2=0x7f6bdc06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 -- 172.21.15.162:0/173265138 shutdown_connections 2024-01-20T11:09:06.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.875+0000 7f6be2a00640 1 -- 172.21.15.162:0/173265138 wait complete. 2024-01-20T11:09:06.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.877+0000 7f6be2a00640 1 Processor -- start 2024-01-20T11:09:06.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.877+0000 7f6be2a00640 1 -- start start 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6be2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6be2a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 0x7f6bdc151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6be2a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bdc15f520 0x7f6bdc071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6be2a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0705a0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6be2a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc071120 con 0x7f6bdc15f520 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6be2a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc072070 con 0x7f6bdc13e380 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51550/0 (socket says 172.21.15.162:51550) 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.878+0000 7f6bdbe00640 1 -- 172.21.15.162:0/3437665437 learned_addr learned my addr 172.21.15.162:0/3437665437 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6be0a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bdc15f520 0x7f6bdc071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bdbe00640 1 -- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 msgr2=0x7f6bdc151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bdbe00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 0x7f6bdc151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bdbe00640 1 -- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bdc15f520 msgr2=0x7f6bdc071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bdbe00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bdc15f520 0x7f6bdc071b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bdbe00640 1 -- 172.21.15.162:0/3437665437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009b30 con 0x7f6bdc06cce0 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6be0a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bdc15f520 0x7f6bdc071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bdbe00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc154e90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00c820 tx=0x7f6bcc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bd8c00640 1 -- 172.21.15.162:0/3437665437 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc004220 con 0x7f6bdc06cce0 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bd8c00640 1 -- 172.21.15.162:0/3437665437 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc0043a0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc0707f0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6bd8c00640 1 -- 172.21.15.162:0/3437665437 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc007a70 con 0x7f6bdc06cce0 2024-01-20T11:09:06.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.879+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc070db0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.881+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc04e970 con 0x7f6bdc06cce0 2024-01-20T11:09:06.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.882+0000 7f6bd8c00640 1 -- 172.21.15.162:0/3437665437 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6bcc007bd0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.883+0000 7f6bd8c00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6bb406aed0 0x7f6bb406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:06.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.883+0000 7f6bd8c00640 1 -- 172.21.15.162:0/3437665437 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bcc0893d0 con 0x7f6bdc06cce0 2024-01-20T11:09:06.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.883+0000 7f6bd3200640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6bb406aed0 0x7f6bb406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:06.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.884+0000 7f6bd3200640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6bb406aed0 0x7f6bb406d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4006fd0 tx=0x7f6bc4006bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:06.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:06.887+0000 7f6bd8c00640 1 -- 172.21.15.162:0/3437665437 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6bcc054290 con 0x7f6bdc06cce0 2024-01-20T11:09:07.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.076+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bdc15e790 con 0x7f6bdc06cce0 2024-01-20T11:09:07.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.076+0000 7f6bd8c00640 1 -- 172.21.15.162:0/3437665437 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bcc0578b0 con 0x7f6bdc06cce0 2024-01-20T11:09:07.077 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:09:07.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6bb406aed0 msgr2=0x7f6bb406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6bb406aed0 0x7f6bb406d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4006fd0 tx=0x7f6bc4006bc0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 msgr2=0x7f6bdc154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc154e90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00c820 tx=0x7f6bcc00cce0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 shutdown_connections 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f6bb406aed0 0x7f6bb406d390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bdc15f520 0x7f6bdc071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bdc13e380 0x7f6bdc151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 --2- 172.21.15.162:0/3437665437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bdc06cce0 0x7f6bdc154e90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.079+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 >> 172.21.15.162:0/3437665437 conn(0x7f6bdc06a600 msgr2=0x7f6bdc0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.080+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 shutdown_connections 2024-01-20T11:09:07.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.080+0000 7f6be2a00640 1 -- 172.21.15.162:0/3437665437 wait complete. 2024-01-20T11:09:07.099 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:09:07.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.317+0000 7f10e6200640 1 Processor -- start 2024-01-20T11:09:07.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.317+0000 7f10e6200640 1 -- start start 2024-01-20T11:09:07.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.319+0000 7f10e6200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10e006dfe0 0x7f10e0071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.319+0000 7f10e6200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e015ea60 con 0x7f10e0143bd0 2024-01-20T11:09:07.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.319+0000 7f10e6200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e015de50 con 0x7f10e0071ac0 2024-01-20T11:09:07.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.319+0000 7f10e6200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e0071f50 con 0x7f10e006dfe0 2024-01-20T11:09:07.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.319+0000 7f10e4e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f10e0143bd0 0x7f10e015b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52576/0 (socket says 172.21.15.162:52576) 2024-01-20T11:09:07.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.319+0000 7f10e4e00640 1 -- 172.21.15.162:0/3061478989 learned_addr learned my addr 172.21.15.162:0/3061478989 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126753177 0 0) 0x7f10e015ea60 con 0x7f10e0143bd0 2024-01-20T11:09:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c0003520 con 0x7f10e0143bd0 2024-01-20T11:09:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10d7c00640 1 --2- 172.21.15.162:0/3061478989 >> v2:172.21.15.179:3300/0 conn(0x7f10e006dfe0 0x7f10e0071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1201909174 0 0) 0x7f10c0003520 con 0x7f10e0143bd0 2024-01-20T11:09:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 >> v2:172.21.15.179:3300/0 conn(0x7f10e006dfe0 msgr2=0x7f10e0071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 --2- 172.21.15.162:0/3061478989 >> v2:172.21.15.179:3300/0 conn(0x7f10e006dfe0 0x7f10e0071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 >> v1:172.21.15.179:6789/0 conn(0x7f10e0071ac0 legacy=0x7f10e015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e015e130 con 0x7f10e0143bd0 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f10d00019f0 con 0x7f10e0143bd0 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 >> v1:172.21.15.162:6789/0 conn(0x7f10e0143bd0 legacy=0x7f10e015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0003970 0x7f10c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00047c0 0x7f10c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c00052a0 0x7f10c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0071f50 con 0x7f10c00052a0 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c000c170 con 0x7f10c0003970 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.320+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c000e540 con 0x7f10c00047c0 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e5800640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c00052a0 0x7f10c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e4e00640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0003970 0x7f10c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10d7c00640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00047c0 0x7f10c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e5800640 1 -- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00047c0 msgr2=0x7f10c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e5800640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00047c0 0x7f10c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e5800640 1 -- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0003970 msgr2=0x7f10c0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e5800640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0003970 0x7f10c0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e5800640 1 -- 172.21.15.162:0/3061478989 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0003520 con 0x7f10c00052a0 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10e4e00640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0003970 0x7f10c0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.321+0000 7f10d7c00640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00047c0 0x7f10c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.322+0000 7f10e5800640 1 -- 172.21.15.162:0/3061478989 reap_dead start 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.322+0000 7f10e5800640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c00052a0 0x7f10c000b980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f10d8001720 tx=0x7f10c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37da485a581ff640 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.322+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80052d0 con 0x7f10c00052a0 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.322+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d802e050 con 0x7f10c00052a0 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.322+0000 7f10dfe00640 1 -- 172.21.15.162:0/3061478989 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80035f0 con 0x7f10c00052a0 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.323+0000 7f10e6200640 1 -- 172.21.15.162:0/3061478989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c00052a0 msgr2=0x7f10c000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.323+0000 7f10e6200640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c00052a0 0x7f10c000b980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f10d8001720 tx=0x7f10c00057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.323+0000 7f10e6200640 1 -- 172.21.15.162:0/3061478989 shutdown_connections 2024-01-20T11:09:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.323+0000 7f10e6200640 1 --2- 172.21.15.162:0/3061478989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10c00052a0 0x7f10c000b980 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.323+0000 7f10e6200640 1 -- 172.21.15.162:0/3061478989 >> 172.21.15.162:0/3061478989 conn(0x7f10e00b0c40 msgr2=0x7f10e00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:07.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.323+0000 7f10e6200640 1 -- 172.21.15.162:0/3061478989 shutdown_connections 2024-01-20T11:09:07.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.323+0000 7f10e6200640 1 -- 172.21.15.162:0/3061478989 wait complete. 2024-01-20T11:09:07.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.325+0000 7f10e6200640 1 Processor -- start 2024-01-20T11:09:07.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.325+0000 7f10e6200640 1 -- start start 2024-01-20T11:09:07.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10e6200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00052a0 0x7f10e01ee870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10e6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0142410 0x7f10e01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10e6200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10e01efa30 0x7f10e006d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10e6200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0157920 con 0x7f10e0142410 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10e6200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e01ef7f0 con 0x7f10e01efa30 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10e6200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e01eef50 con 0x7f10c00052a0 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10d7c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0142410 0x7f10e01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10d7c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0142410 0x7f10e01573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51568/0 (socket says 172.21.15.162:51568) 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10d7c00640 1 -- 172.21.15.162:0/4087225423 learned_addr learned my addr 172.21.15.162:0/4087225423 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.326+0000 7f10e4e00640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00052a0 0x7f10e01ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10d7c00640 1 -- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00052a0 msgr2=0x7f10e01ee870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10e5800640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10e01efa30 0x7f10e006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10d7c00640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00052a0 0x7f10e01ee870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10d7c00640 1 -- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10e01efa30 msgr2=0x7f10e006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10d7c00640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10e01efa30 0x7f10e006d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10d7c00640 1 -- 172.21.15.162:0/4087225423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e01ef230 con 0x7f10e0142410 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10d7c00640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0142410 0x7f10e01573e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f10c800e810 tx=0x7f10c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10dd600640 1 -- 172.21.15.162:0/4087225423 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800c6d0 con 0x7f10e0142410 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10dd600640 1 -- 172.21.15.162:0/4087225423 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c800c830 con 0x7f10e0142410 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10dd600640 1 -- 172.21.15.162:0/4087225423 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800cbe0 con 0x7f10e0142410 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e01ef510 con 0x7f10e0142410 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.327+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e0142890 con 0x7f10e0142410 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.328+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e0074a30 con 0x7f10e0142410 2024-01-20T11:09:07.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.329+0000 7f10dd600640 1 -- 172.21.15.162:0/4087225423 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f10c800cd40 con 0x7f10e0142410 2024-01-20T11:09:07.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.331+0000 7f10dd600640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f10b806aed0 0x7f10b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.331+0000 7f10dd600640 1 -- 172.21.15.162:0/4087225423 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c80893a0 con 0x7f10e0142410 2024-01-20T11:09:07.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.331+0000 7f10e4e00640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f10b806aed0 0x7f10b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.332+0000 7f10e4e00640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f10b806aed0 0x7f10b806d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10d0002230 tx=0x7f10d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:07.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.335+0000 7f10dd600640 1 -- 172.21.15.162:0/4087225423 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f10c8054300 con 0x7f10e0142410 2024-01-20T11:09:07.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.529+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10e006cb50 con 0x7f10e0142410 2024-01-20T11:09:07.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.530+0000 7f10dd600640 1 -- 172.21.15.162:0/4087225423 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10c8057920 con 0x7f10e0142410 2024-01-20T11:09:07.531 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f10b806aed0 msgr2=0x7f10b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f10b806aed0 0x7f10b806d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10d0002230 tx=0x7f10d0009040 comp rx=0 tx=0).stop 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0142410 msgr2=0x7f10e01573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0142410 0x7f10e01573e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f10c800e810 tx=0x7f10c800ecd0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 shutdown_connections 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f10b806aed0 0x7f10b806d390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10e01efa30 0x7f10e006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e0142410 0x7f10e01573e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 --2- 172.21.15.162:0/4087225423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00052a0 0x7f10e01ee870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 >> 172.21.15.162:0/4087225423 conn(0x7f10e00b0c40 msgr2=0x7f10e015c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:07.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 shutdown_connections 2024-01-20T11:09:07.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.533+0000 7f10e6200640 1 -- 172.21.15.162:0/4087225423 wait complete. 2024-01-20T11:09:07.551 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T11:09:07.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.759+0000 7fc3e0e00640 1 Processor -- start 2024-01-20T11:09:07.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.759+0000 7fc3e0e00640 1 -- start start 2024-01-20T11:09:07.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.760+0000 7fc3e0e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3dc141bb0 0x7fc3dc0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.760+0000 7fc3e0e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3dc06cdf0 0x7fc3dc0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.760+0000 7fc3e0e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc0cee70 con 0x7fc3dc0ce6a0 2024-01-20T11:09:07.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.760+0000 7fc3e0e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0cd7a0 con 0x7fc3dc141bb0 2024-01-20T11:09:07.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.760+0000 7fc3e0e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0ceb90 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3d9e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3dc141bb0 0x7fc3dc0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3d9e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3dc141bb0 0x7fc3dc0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51580/0 (socket says 172.21.15.162:51580) 2024-01-20T11:09:07.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3d9e00640 1 -- 172.21.15.162:0/971007322 learned_addr learned my addr 172.21.15.162:0/971007322 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:07.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3da800640 1 --2- 172.21.15.162:0/971007322 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc06cdf0 0x7fc3dc0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3d9e00640 1 -- 172.21.15.162:0/971007322 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc06cdf0 msgr2=0x7fc3dc0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:07.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3d9e00640 1 --2- 172.21.15.162:0/971007322 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc06cdf0 0x7fc3dc0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3d9e00640 1 -- 172.21.15.162:0/971007322 >> v1:172.21.15.162:6789/0 conn(0x7fc3dc0ce6a0 legacy=0x7fc3dc06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3d9e00640 1 -- 172.21.15.162:0/971007322 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0cd150 con 0x7fc3dc141bb0 2024-01-20T11:09:07.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.761+0000 7fc3da800640 1 --2- 172.21.15.162:0/971007322 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc06cdf0 0x7fc3dc0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:07.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.762+0000 7fc3d9e00640 1 --2- 172.21.15.162:0/971007322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc141bb0 0x7fc3dc0ce160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0704c0 tx=0x7fc3cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d85ca0d9f120265 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:07.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.763+0000 7fc3d8a00640 1 -- 172.21.15.162:0/971007322 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc031870 con 0x7fc3dc141bb0 2024-01-20T11:09:07.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.763+0000 7fc3d8a00640 1 -- 172.21.15.162:0/971007322 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc0319d0 con 0x7fc3dc141bb0 2024-01-20T11:09:07.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.763+0000 7fc3d8a00640 1 -- 172.21.15.162:0/971007322 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc031d60 con 0x7fc3dc141bb0 2024-01-20T11:09:07.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.763+0000 7fc3e0e00640 1 -- 172.21.15.162:0/971007322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc141bb0 msgr2=0x7fc3dc0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.763+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/971007322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc141bb0 0x7fc3dc0ce160 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0704c0 tx=0x7fc3cc02b910 comp rx=0 tx=0).stop 2024-01-20T11:09:07.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.764+0000 7fc3e0e00640 1 -- 172.21.15.162:0/971007322 shutdown_connections 2024-01-20T11:09:07.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.764+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/971007322 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc06cdf0 0x7fc3dc0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.764+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/971007322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc141bb0 0x7fc3dc0ce160 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.764+0000 7fc3e0e00640 1 -- 172.21.15.162:0/971007322 >> 172.21.15.162:0/971007322 conn(0x7fc3dc06a600 msgr2=0x7fc3dc06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:07.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.764+0000 7fc3e0e00640 1 -- 172.21.15.162:0/971007322 shutdown_connections 2024-01-20T11:09:07.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.764+0000 7fc3e0e00640 1 -- 172.21.15.162:0/971007322 wait complete. 2024-01-20T11:09:07.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.765+0000 7fc3e0e00640 1 Processor -- start 2024-01-20T11:09:07.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.765+0000 7fc3e0e00640 1 -- start start 2024-01-20T11:09:07.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.766+0000 7fc3e0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc06cdf0 0x7fc3dc15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.766+0000 7fc3e0e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc0ce6a0 0x7fc3dc0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.766+0000 7fc3e0e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc141bb0 0x7fc3dc0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.766+0000 7fc3e0e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0b0860 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.766+0000 7fc3e0e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc12e2a0 con 0x7fc3dc141bb0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.766+0000 7fc3e0e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc12e580 con 0x7fc3dc0ce6a0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc06cdf0 0x7fc3dc15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc06cdf0 0x7fc3dc15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51582/0 (socket says 172.21.15.162:51582) 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 -- 172.21.15.162:0/3421152928 learned_addr learned my addr 172.21.15.162:0/3421152928 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 -- 172.21.15.162:0/3421152928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc0ce6a0 msgr2=0x7fc3dc0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc0ce6a0 0x7fc3dc0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 -- 172.21.15.162:0/3421152928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc141bb0 msgr2=0x7fc3dc0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc141bb0 0x7fc3dc0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 -- 172.21.15.162:0/3421152928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc0094d0 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.767+0000 7fc3d9e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc06cdf0 0x7fc3dc15b070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc02b950 tx=0x7fc3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.768+0000 7fc3d2000640 1 -- 172.21.15.162:0/3421152928 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc031860 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.768+0000 7fc3d2000640 1 -- 172.21.15.162:0/3421152928 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc0443f0 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.768+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc12e860 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.768+0000 7fc3d2000640 1 -- 172.21.15.162:0/3421152928 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0447a0 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.768+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc15bcd0 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.769+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc12ed80 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.770+0000 7fc3d2000640 1 -- 172.21.15.162:0/3421152928 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc3cc04d450 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.770+0000 7fc3d2000640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:07.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.771+0000 7fc3d2000640 1 -- 172.21.15.162:0/3421152928 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3cc02d040 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.771+0000 7fc3d9400640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:07.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.771+0000 7fc3d9400640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000f60 tx=0x7fc3c40079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:07.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.775+0000 7fc3d2000640 1 -- 172.21.15.162:0/3421152928 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc3dc12ed80 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.964+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc3dc12ed80 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.965+0000 7fc3d2000640 1 -- 172.21.15.162:0/3421152928 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc3dc12ed80 con 0x7fc3dc06cdf0 2024-01-20T11:09:07.966 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.967+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 msgr2=0x7fc3b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.967+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000f60 tx=0x7fc3c40079d0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.967+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc06cdf0 msgr2=0x7fc3dc15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.967+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc06cdf0 0x7fc3dc15b070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc02b950 tx=0x7fc3cc0046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 shutdown_connections 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc141bb0 0x7fc3dc0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc0ce6a0 0x7fc3dc0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 --2- 172.21.15.162:0/3421152928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc06cdf0 0x7fc3dc15b070 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:07.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 >> 172.21.15.162:0/3421152928 conn(0x7fc3dc06a600 msgr2=0x7fc3dc1429b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:07.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 shutdown_connections 2024-01-20T11:09:07.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:07.968+0000 7fc3e0e00640 1 -- 172.21.15.162:0/3421152928 wait complete. 2024-01-20T11:09:07.987 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-20T11:09:07.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:07.987 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-20T11:09:08.105 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:09:08.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:08.106 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T11:09:08.150 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:09:08.150 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:08.191 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:09:08.191 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:08.191 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:08.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053860,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-20T11:09:08.231 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:09:08.231 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:08.282 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:09:08.283 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:08.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.496+0000 7f1d98800640 1 Processor -- start 2024-01-20T11:09:08.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.496+0000 7f1d98800640 1 -- start start 2024-01-20T11:09:08.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.497+0000 7f1d98800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 0x7f1d900ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d98800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1d90070630 0x7f1d900adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d98800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d90070b60 con 0x7f1d9015c6e0 2024-01-20T11:09:08.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d98800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9015ba10 con 0x7f1d90070630 2024-01-20T11:09:08.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d98800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9015bc00 con 0x7f1d90155a30 2024-01-20T11:09:08.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d96800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1d9015c6e0 0x7f1d9006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52592/0 (socket says 172.21.15.162:52592) 2024-01-20T11:09:08.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d96800640 1 -- 172.21.15.162:0/4185883019 learned_addr learned my addr 172.21.15.162:0/4185883019 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135948330 0 0) 0x7f1d90070b60 con 0x7f1d9015c6e0 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d95400640 1 --2- 172.21.15.162:0/4185883019 >> v2:172.21.15.179:3300/0 conn(0x7f1d90070630 0x7f1d900adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d70003520 con 0x7f1d9015c6e0 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.498+0000 7f1d95e00640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 0x7f1d900ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3475746431 0 0) 0x7f1d70003520 con 0x7f1d9015c6e0 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 msgr2=0x7f1d900ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 0x7f1d900ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 >> v2:172.21.15.179:3300/0 conn(0x7f1d90070630 msgr2=0x7f1d900adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 --2- 172.21.15.162:0/4185883019 >> v2:172.21.15.179:3300/0 conn(0x7f1d90070630 0x7f1d900adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9015bee0 con 0x7f1d9015c6e0 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f1d880019f0 con 0x7f1d9015c6e0 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 >> v1:172.21.15.162:6789/0 conn(0x7f1d9015c6e0 legacy=0x7f1d9006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 0x7f1d70003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d70003fa0 0x7f1d700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9015bc00 con 0x7f1d70004d00 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7000bac0 con 0x7f1d70003fa0 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7000bc80 con 0x7f1d90155a30 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.499+0000 7f1d96800640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.500+0000 7f1d95400640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d70003fa0 0x7f1d700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.500+0000 7f1d95e00640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 0x7f1d70003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.500+0000 7f1d96800640 1 -- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 msgr2=0x7f1d70003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.500+0000 7f1d96800640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90155a30 0x7f1d70003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.500+0000 7f1d96800640 1 -- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d70003fa0 msgr2=0x7f1d700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.500+0000 7f1d96800640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d70003fa0 0x7f1d700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.500+0000 7f1d96800640 1 -- 172.21.15.162:0/4185883019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70003520 con 0x7f1d70004d00 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.501+0000 7f1d96800640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d70005180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800a830 tx=0x7f1d700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08cfabb0d11e386 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.501+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88034630 con 0x7f1d70004d00 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.501+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8802f070 con 0x7f1d70004d00 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.501+0000 7f1d94a00640 1 -- 172.21.15.162:0/4185883019 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88034a30 con 0x7f1d70004d00 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.502+0000 7f1d98800640 1 -- 172.21.15.162:0/4185883019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 msgr2=0x7f1d70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.502+0000 7f1d98800640 1 --2- 172.21.15.162:0/4185883019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d70005180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800a830 tx=0x7f1d700057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.502+0000 7f1d96800640 1 -- 172.21.15.162:0/4185883019 reap_dead start 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.502+0000 7f1d98800640 1 -- 172.21.15.162:0/4185883019 shutdown_connections 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.502+0000 7f1d98800640 1 -- 172.21.15.162:0/4185883019 >> 172.21.15.162:0/4185883019 conn(0x7f1d900b0cd0 msgr2=0x7f1d900b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.502+0000 7f1d98800640 1 -- 172.21.15.162:0/4185883019 shutdown_connections 2024-01-20T11:09:08.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.502+0000 7f1d98800640 1 -- 172.21.15.162:0/4185883019 wait complete. 2024-01-20T11:09:08.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.504+0000 7f1d98800640 1 Processor -- start 2024-01-20T11:09:08.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.504+0000 7f1d98800640 1 -- start start 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d98800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d9014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d98800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90153cc0 0x7f1d9009bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d98800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d9009c0d0 0x7f1d900c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d98800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9014cee0 con 0x7f1d70004d00 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d98800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9009c5c0 con 0x7f1d9009c0d0 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d98800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9009c8a0 con 0x7f1d90153cc0 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d95e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d9014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d95e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d9014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51590/0 (socket says 172.21.15.162:51590) 2024-01-20T11:09:08.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.505+0000 7f1d95e00640 1 -- 172.21.15.162:0/2619483609 learned_addr learned my addr 172.21.15.162:0/2619483609 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:08.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d96800640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d9009c0d0 0x7f1d900c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d95400640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90153cc0 0x7f1d9009bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d95e00640 1 -- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90153cc0 msgr2=0x7f1d9009bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d95e00640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90153cc0 0x7f1d9009bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d95e00640 1 -- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d9009c0d0 msgr2=0x7f1d900c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d95e00640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d9009c0d0 0x7f1d900c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d95e00640 1 -- 172.21.15.162:0/2619483609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d90155f90 con 0x7f1d70004d00 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d95e00640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d9014c9a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800f580 tx=0x7f1d7800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d8e000640 1 -- 172.21.15.162:0/2619483609 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78014870 con 0x7f1d70004d00 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d8e000640 1 -- 172.21.15.162:0/2619483609 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780149d0 con 0x7f1d70004d00 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d8e000640 1 -- 172.21.15.162:0/2619483609 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78014d80 con 0x7f1d70004d00 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9009cb80 con 0x7f1d70004d00 2024-01-20T11:09:08.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.506+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d900c88c0 con 0x7f1d70004d00 2024-01-20T11:09:08.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.507+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d900b2760 con 0x7f1d70004d00 2024-01-20T11:09:08.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.508+0000 7f1d8e000640 1 -- 172.21.15.162:0/2619483609 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1d78015410 con 0x7f1d70004d00 2024-01-20T11:09:08.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.509+0000 7f1d8e000640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1d6806aed0 0x7f1d6806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.509+0000 7f1d8e000640 1 -- 172.21.15.162:0/2619483609 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d78089fe0 con 0x7f1d70004d00 2024-01-20T11:09:08.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.510+0000 7f1d95400640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1d6806aed0 0x7f1d6806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.510+0000 7f1d95400640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1d6806aed0 0x7f1d6806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d901f6710 tx=0x7f1d80008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:08.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.514+0000 7f1d8e000640 1 -- 172.21.15.162:0/2619483609 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1d78054ec0 con 0x7f1d70004d00 2024-01-20T11:09:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.746+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d9004e970 con 0x7f1d70004d00 2024-01-20T11:09:08.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.748+0000 7f1d8e000640 1 -- 172.21.15.162:0/2619483609 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f1d780584e0 con 0x7f1d70004d00 2024-01-20T11:09:08.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:08.748 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:09:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:09:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1d6806aed0 msgr2=0x7f1d6806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1d6806aed0 0x7f1d6806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d901f6710 tx=0x7f1d80008040 comp rx=0 tx=0).stop 2024-01-20T11:09:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 msgr2=0x7f1d9014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d9014c9a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800f580 tx=0x7f1d7800fa40 comp rx=0 tx=0).stop 2024-01-20T11:09:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 shutdown_connections 2024-01-20T11:09:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1d6806aed0 0x7f1d6806d390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d9009c0d0 0x7f1d900c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d90153cc0 0x7f1d9009bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 --2- 172.21.15.162:0/2619483609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d70004d00 0x7f1d9014c9a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.750+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 >> 172.21.15.162:0/2619483609 conn(0x7f1d900b0cd0 msgr2=0x7f1d9015cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.751+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 shutdown_connections 2024-01-20T11:09:08.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.751+0000 7f1d98800640 1 -- 172.21.15.162:0/2619483609 wait complete. 2024-01-20T11:09:08.770 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:08.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.974+0000 7f8fc4c00640 1 Processor -- start 2024-01-20T11:09:08.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.975+0000 7f8fc4c00640 1 -- start start 2024-01-20T11:09:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.976+0000 7f8fc4c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8fc0155a30 0x7f8fc00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.976+0000 7f8fc4c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.976+0000 7f8fc4c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc0070b60 con 0x7f8fc0070630 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.976+0000 7f8fc4c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc015ba10 con 0x7f8fc0155a30 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.976+0000 7f8fc4c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc015bc00 con 0x7f8fc00ae6b0 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.976+0000 7f8fbde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8fc0155a30 0x7f8fc00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.977+0000 7f8fbde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8fc0155a30 0x7f8fc00ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51592/0 (socket says 172.21.15.162:51592) 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.977+0000 7f8fbde00640 1 -- 172.21.15.162:0/3587350864 learned_addr learned my addr 172.21.15.162:0/3587350864 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.977+0000 7f8fbe800640 1 --2- 172.21.15.162:0/3587350864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.977+0000 7f8fbde00640 1 -- 172.21.15.162:0/3587350864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 msgr2=0x7f8fc006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.977+0000 7f8fbde00640 1 --2- 172.21.15.162:0/3587350864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc006c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.977+0000 7f8fbde00640 1 -- 172.21.15.162:0/3587350864 >> v1:172.21.15.179:6789/0 conn(0x7f8fc0070630 legacy=0x7f8fc00adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:08.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.977+0000 7f8fbde00640 1 -- 172.21.15.162:0/3587350864 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc015bee0 con 0x7f8fc0155a30 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.978+0000 7f8fbde00640 1 --2- 172.21.15.162:0/3587350864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00ce800 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009870 tx=0x7f8fb002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df81e6059445057d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.978+0000 7f8fbd400640 1 -- 172.21.15.162:0/3587350864 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00317c0 con 0x7f8fc0155a30 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.978+0000 7f8fbd400640 1 -- 172.21.15.162:0/3587350864 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0031920 con 0x7f8fc0155a30 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.978+0000 7f8fbd400640 1 -- 172.21.15.162:0/3587350864 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0031cb0 con 0x7f8fc0155a30 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3587350864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 msgr2=0x7f8fc00ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3587350864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00ce800 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009870 tx=0x7f8fb002b860 comp rx=0 tx=0).stop 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3587350864 shutdown_connections 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3587350864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3587350864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00ce800 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3587350864 >> 172.21.15.162:0/3587350864 conn(0x7f8fc00b0cd0 msgr2=0x7f8fc00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:08.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3587350864 shutdown_connections 2024-01-20T11:09:08.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.979+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3587350864 wait complete. 2024-01-20T11:09:08.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.981+0000 7f8fc4c00640 1 Processor -- start 2024-01-20T11:09:08.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.981+0000 7f8fc4c00640 1 -- start start 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fc4c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc0070630 0x7f8fc014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fc4c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc00b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fc4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fc4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b3a30 con 0x7f8fc0155a30 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fc4c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b2450 con 0x7f8fc0070630 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fc4c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b2730 con 0x7f8fc00ae6b0 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fbe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fbe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51606/0 (socket says 172.21.15.162:51606) 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.982+0000 7f8fbe800640 1 -- 172.21.15.162:0/3113700578 learned_addr learned my addr 172.21.15.162:0/3113700578 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fb7e00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc00b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbde00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc0070630 0x7f8fc014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbe800640 1 -- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 msgr2=0x7f8fc00b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbe800640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc00b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbe800640 1 -- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc0070630 msgr2=0x7f8fc014add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbe800640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc0070630 0x7f8fc014add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbe800640 1 -- 172.21.15.162:0/3113700578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00094d0 con 0x7f8fc0155a30 2024-01-20T11:09:08.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbde00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc0070630 0x7f8fc014add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fbe800640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00b34f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cd70 tx=0x7f8fb800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fb6000640 1 -- 172.21.15.162:0/3113700578 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8003b90 con 0x7f8fc0155a30 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fb6000640 1 -- 172.21.15.162:0/3113700578 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8003cf0 con 0x7f8fc0155a30 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fb6000640 1 -- 172.21.15.162:0/3113700578 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8004240 con 0x7f8fc0155a30 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.983+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc00b2a10 con 0x7f8fc0155a30 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.984+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc00b2fd0 con 0x7f8fc0155a30 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.985+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc00b31f0 con 0x7f8fc0155a30 2024-01-20T11:09:08.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.986+0000 7f8fb6000640 1 -- 172.21.15.162:0/3113700578 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8fb80043a0 con 0x7f8fc0155a30 2024-01-20T11:09:08.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.987+0000 7f8fb6000640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f9806af00 0x7f8f9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:08.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.987+0000 7f8fb6000640 1 -- 172.21.15.162:0/3113700578 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fb8012070 con 0x7f8fc0155a30 2024-01-20T11:09:08.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.987+0000 7f8fbde00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f9806af00 0x7f8f9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:08.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.987+0000 7f8fbde00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f9806af00 0x7f8f9806d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0036000 tx=0x7f8fb003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:08.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:08.991+0000 7f8fb6000640 1 -- 172.21.15.162:0/3113700578 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8fb8054ef0 con 0x7f8fc0155a30 2024-01-20T11:09:09.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.184+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fc004e970 con 0x7f8fc0155a30 2024-01-20T11:09:09.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.185+0000 7f8fb6000640 1 -- 172.21.15.162:0/3113700578 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f8fb808b090 con 0x7f8fc0155a30 2024-01-20T11:09:09.186 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:09.186 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":36,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:42.965160+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:08:38.930132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T11:08:40.039032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:09.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f9806af00 msgr2=0x7f8f9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f9806af00 0x7f8f9806d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0036000 tx=0x7f8fb003d040 comp rx=0 tx=0).stop 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 msgr2=0x7f8fc00b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00b34f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cd70 tx=0x7f8fb800a660 comp rx=0 tx=0).stop 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 shutdown_connections 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fc0155a30 0x7f8fc00b34f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00ae6b0 0x7f8fc00b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f9806af00 0x7f8f9806d3c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 --2- 172.21.15.162:0/3113700578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc0070630 0x7f8fc014add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 >> 172.21.15.162:0/3113700578 conn(0x7f8fc00b0cd0 msgr2=0x7f8fc00cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 shutdown_connections 2024-01-20T11:09:09.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.188+0000 7f8fc4c00640 1 -- 172.21.15.162:0/3113700578 wait complete. 2024-01-20T11:09:09.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:08:38.930132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:08:40.039032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:09:09.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:09:09.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.412+0000 7f20ff200640 1 Processor -- start 2024-01-20T11:09:09.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.412+0000 7f20ff200640 1 -- start start 2024-01-20T11:09:09.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20ff200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2100071cc0 0x7f21000ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20ff200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21000cd880 0x7f21000cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20ff200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2100071830 con 0x7f2100144a10 2024-01-20T11:09:09.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20ff200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2100070c20 con 0x7f2100071cc0 2024-01-20T11:09:09.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20ff200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2100070f00 con 0x7f21000cd880 2024-01-20T11:09:09.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20f5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2100071cc0 0x7f21000ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20fde00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2100144a10 0x7f21000703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52608/0 (socket says 172.21.15.162:52608) 2024-01-20T11:09:09.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.413+0000 7f20fde00640 1 -- 172.21.15.162:0/1431867295 learned_addr learned my addr 172.21.15.162:0/1431867295 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:09.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.414+0000 7f20fe800640 1 --2- 172.21.15.162:0/1431867295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21000cd880 0x7f21000cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.414+0000 7f20f5200640 1 -- 172.21.15.162:0/1431867295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21000cd880 msgr2=0x7f21000cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:09.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.414+0000 7f20f5200640 1 --2- 172.21.15.162:0/1431867295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21000cd880 0x7f21000cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.414+0000 7f20f5200640 1 -- 172.21.15.162:0/1431867295 >> v1:172.21.15.162:6789/0 conn(0x7f2100144a10 legacy=0x7f21000703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.414+0000 7f20f5200640 1 -- 172.21.15.162:0/1431867295 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21000711e0 con 0x7f2100071cc0 2024-01-20T11:09:09.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.415+0000 7f20f5200640 1 --2- 172.21.15.162:0/1431867295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100071cc0 0x7f21000ce950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f20e80097a0 tx=0x7f20e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea1d0c1e89b6837 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:09.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.415+0000 7f20fd400640 1 -- 172.21.15.162:0/1431867295 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8031830 con 0x7f2100071cc0 2024-01-20T11:09:09.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.415+0000 7f20fd400640 1 -- 172.21.15.162:0/1431867295 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e8031990 con 0x7f2100071cc0 2024-01-20T11:09:09.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.415+0000 7f20fd400640 1 -- 172.21.15.162:0/1431867295 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8031d20 con 0x7f2100071cc0 2024-01-20T11:09:09.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 -- 172.21.15.162:0/1431867295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100071cc0 msgr2=0x7f21000ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 --2- 172.21.15.162:0/1431867295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100071cc0 0x7f21000ce950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f20e80097a0 tx=0x7f20e802b8d0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 -- 172.21.15.162:0/1431867295 shutdown_connections 2024-01-20T11:09:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 --2- 172.21.15.162:0/1431867295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21000cd880 0x7f21000cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 --2- 172.21.15.162:0/1431867295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100071cc0 0x7f21000ce950 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 -- 172.21.15.162:0/1431867295 >> 172.21.15.162:0/1431867295 conn(0x7f21000b0c40 msgr2=0x7f21000b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 -- 172.21.15.162:0/1431867295 shutdown_connections 2024-01-20T11:09:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.416+0000 7f20ff200640 1 -- 172.21.15.162:0/1431867295 wait complete. 2024-01-20T11:09:09.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.418+0000 7f20ff200640 1 Processor -- start 2024-01-20T11:09:09.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.418+0000 7f20ff200640 1 -- start start 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20ff200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2100071cc0 0x7f210006c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20ff200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21000cd880 0x7f210015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20ff200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100144a10 0x7f210015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20ff200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21001f3e00 con 0x7f2100144a10 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20ff200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210013f3e0 con 0x7f21000cd880 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20ff200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21000ac960 con 0x7f2100071cc0 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100144a10 0x7f210015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100144a10 0x7f210015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51622/0 (socket says 172.21.15.162:51622) 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fe800640 1 -- 172.21.15.162:0/575085490 learned_addr learned my addr 172.21.15.162:0/575085490 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fde00640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2100071cc0 0x7f210006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fe800640 1 -- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2100071cc0 msgr2=0x7f210006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fe800640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2100071cc0 0x7f210006c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fe800640 1 -- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21000cd880 msgr2=0x7f210015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.419+0000 7f20fe800640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21000cd880 0x7f210015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20fe800640 1 -- 172.21.15.162:0/575085490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009400 con 0x7f2100144a10 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20fde00640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2100071cc0 0x7f210006c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20fe800640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100144a10 0x7f210015aac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f20f800d800 tx=0x7f20f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20f6a00640 1 -- 172.21.15.162:0/575085490 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f800b6c0 con 0x7f2100144a10 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20f6a00640 1 -- 172.21.15.162:0/575085490 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f800b840 con 0x7f2100144a10 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20f6a00640 1 -- 172.21.15.162:0/575085490 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f800bbf0 con 0x7f2100144a10 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21000acc40 con 0x7f2100144a10 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.420+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21000ad200 con 0x7f2100144a10 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.421+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2100074a30 con 0x7f2100144a10 2024-01-20T11:09:09.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.422+0000 7f20f6a00640 1 -- 172.21.15.162:0/575085490 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f20f800bd50 con 0x7f2100144a10 2024-01-20T11:09:09.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.423+0000 7f20f6a00640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f20d806af00 0x7f20d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.424+0000 7f20f6a00640 1 -- 172.21.15.162:0/575085490 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20f8089af0 con 0x7f2100144a10 2024-01-20T11:09:09.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.424+0000 7f20fde00640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f20d806af00 0x7f20d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.424+0000 7f20fde00640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f20d806af00 0x7f20d806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f20f00012e0 tx=0x7f20f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:09.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.428+0000 7f20f6a00640 1 -- 172.21.15.162:0/575085490 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f20f8054a30 con 0x7f2100144a10 2024-01-20T11:09:09.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.622+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21000ad3c0 con 0x7f2100144a10 2024-01-20T11:09:09.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.623+0000 7f20f6a00640 1 -- 172.21.15.162:0/575085490 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20f8089e60 con 0x7f2100144a10 2024-01-20T11:09:09.624 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f20d806af00 msgr2=0x7f20d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f20d806af00 0x7f20d806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f20f00012e0 tx=0x7f20f0009040 comp rx=0 tx=0).stop 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100144a10 msgr2=0x7f210015aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100144a10 0x7f210015aac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f20f800d800 tx=0x7f20f800dcc0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 shutdown_connections 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2100144a10 0x7f210015aac0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f20d806af00 0x7f20d806d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21000cd880 0x7f210015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 --2- 172.21.15.162:0/575085490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2100071cc0 0x7f210006c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 >> 172.21.15.162:0/575085490 conn(0x7f21000b0c40 msgr2=0x7f21000ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 shutdown_connections 2024-01-20T11:09:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.626+0000 7f20ff200640 1 -- 172.21.15.162:0/575085490 wait complete. 2024-01-20T11:09:09.645 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:09:09.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.852+0000 7f234c600640 1 Processor -- start 2024-01-20T11:09:09.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.853+0000 7f234c600640 1 -- start start 2024-01-20T11:09:09.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.854+0000 7f234c600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 0x7f234406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.854+0000 7f234c600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f234406cb10 0x7f2344140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.854+0000 7f234c600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234413e760 con 0x7f234413e380 2024-01-20T11:09:09.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.854+0000 7f234c600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234406d3a0 con 0x7f234406cb10 2024-01-20T11:09:09.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.854+0000 7f234c600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440ccc70 con 0x7f234415f6f0 2024-01-20T11:09:09.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.855+0000 7f2349c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f234413e380 0x7f234415efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52620/0 (socket says 172.21.15.162:52620) 2024-01-20T11:09:09.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.855+0000 7f2349c00640 1 -- 172.21.15.162:0/2265660311 learned_addr learned my addr 172.21.15.162:0/2265660311 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.855+0000 7f234a600640 1 --2- 172.21.15.162:0/2265660311 >> v2:172.21.15.179:3300/0 conn(0x7f234406cb10 0x7f2344140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.855+0000 7f2349200640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 0x7f234406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.855+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910410902 0 0) 0x7f234413e760 con 0x7f234413e380 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.855+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2324003520 con 0x7f234413e380 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2739741928 0 0) 0x7f2324003520 con 0x7f234413e380 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 msgr2=0x7f234406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 0x7f234406c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 >> v2:172.21.15.179:3300/0 conn(0x7f234406cb10 msgr2=0x7f2344140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 --2- 172.21.15.162:0/2265660311 >> v2:172.21.15.179:3300/0 conn(0x7f234406cb10 0x7f2344140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234413fa50 con 0x7f234413e380 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f2334001670 con 0x7f234413e380 2024-01-20T11:09:09.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2349200640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 0x7f234406c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 >> v1:172.21.15.162:6789/0 conn(0x7f234413e380 legacy=0x7f234415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 0x7f2324003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f23240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324004d00 0x7f2324005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234406d3a0 con 0x7f2324003f00 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440ccc70 con 0x7f2324004d00 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232400ba00 con 0x7f234415f6f0 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2349200640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f23240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2349200640 1 -- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 msgr2=0x7f2324003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2349200640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234415f6f0 0x7f2324003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2349200640 1 -- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324004d00 msgr2=0x7f2324005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:09.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2349200640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324004d00 0x7f2324005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.856+0000 7f2349200640 1 -- 172.21.15.162:0/2265660311 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324003520 con 0x7f2324003f00 2024-01-20T11:09:09.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.857+0000 7f2349200640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f23240047c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f232c0098a0 tx=0x7f23240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c448c7ca7b49b9dd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:09.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c004230 con 0x7f2324003f00 2024-01-20T11:09:09.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c004390 con 0x7f2324003f00 2024-01-20T11:09:09.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f2343e00640 1 -- 172.21.15.162:0/2265660311 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c003830 con 0x7f2324003f00 2024-01-20T11:09:09.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f234c600640 1 -- 172.21.15.162:0/2265660311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 msgr2=0x7f23240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f234c600640 1 --2- 172.21.15.162:0/2265660311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f23240047c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f232c0098a0 tx=0x7f23240057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f234a600640 1 -- 172.21.15.162:0/2265660311 reap_dead start 2024-01-20T11:09:09.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f234c600640 1 -- 172.21.15.162:0/2265660311 shutdown_connections 2024-01-20T11:09:09.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f234c600640 1 -- 172.21.15.162:0/2265660311 >> 172.21.15.162:0/2265660311 conn(0x7f234406a600 msgr2=0x7f234406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:09.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f234c600640 1 -- 172.21.15.162:0/2265660311 shutdown_connections 2024-01-20T11:09:09.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.858+0000 7f234c600640 1 -- 172.21.15.162:0/2265660311 wait complete. 2024-01-20T11:09:09.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.860+0000 7f234c600640 1 Processor -- start 2024-01-20T11:09:09.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.860+0000 7f234c600640 1 -- start start 2024-01-20T11:09:09.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f234c600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f234413d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f234c600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234413c590 0x7f23441571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f234c600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f234415e790 0x7f2344158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f234c600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234413dd70 con 0x7f2324003f00 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f234c600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234413d3a0 con 0x7f234415e790 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f234c600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2344157a60 con 0x7f234413c590 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f234413d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f234413d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51638/0 (socket says 172.21.15.162:51638) 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 -- 172.21.15.162:0/4173794144 learned_addr learned my addr 172.21.15.162:0/4173794144 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349200640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234413c590 0x7f23441571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 -- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234413c590 msgr2=0x7f23441571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234413c590 0x7f23441571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 -- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f234415e790 msgr2=0x7f2344158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f234415e790 0x7f2344158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349c00640 1 -- 172.21.15.162:0/4173794144 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234413ca70 con 0x7f2324003f00 2024-01-20T11:09:09.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.862+0000 7f2349200640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234413c590 0x7f23441571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:09.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.863+0000 7f2349c00640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f234413d830 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f233400c730 tx=0x7f233400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:09.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.863+0000 7f2341600640 1 -- 172.21.15.162:0/4173794144 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340072d0 con 0x7f2324003f00 2024-01-20T11:09:09.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.863+0000 7f2341600640 1 -- 172.21.15.162:0/4173794144 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334007450 con 0x7f2324003f00 2024-01-20T11:09:09.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.863+0000 7f2341600640 1 -- 172.21.15.162:0/4173794144 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340047e0 con 0x7f2324003f00 2024-01-20T11:09:09.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.863+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234413cd50 con 0x7f2324003f00 2024-01-20T11:09:09.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.863+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23441576e0 con 0x7f2324003f00 2024-01-20T11:09:09.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.864+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234404e970 con 0x7f2324003f00 2024-01-20T11:09:09.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.865+0000 7f2341600640 1 -- 172.21.15.162:0/4173794144 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2334004b70 con 0x7f2324003f00 2024-01-20T11:09:09.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.866+0000 7f2341600640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f231c06aed0 0x7f231c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:09.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.866+0000 7f2341600640 1 -- 172.21.15.162:0/4173794144 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2334088b00 con 0x7f2324003f00 2024-01-20T11:09:09.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.866+0000 7f2349200640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f231c06aed0 0x7f231c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:09.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.867+0000 7f2349200640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f231c06aed0 0x7f231c06d390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f232c035000 tx=0x7f232c03a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:09.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:09.871+0000 7f2341600640 1 -- 172.21.15.162:0/4173794144 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f233408ae60 con 0x7f2324003f00 2024-01-20T11:09:10.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.066+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2344073920 con 0x7f2324003f00 2024-01-20T11:09:10.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.067+0000 7f2341600640 1 -- 172.21.15.162:0/4173794144 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23340180a0 con 0x7f2324003f00 2024-01-20T11:09:10.068 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:09:10.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f231c06aed0 msgr2=0x7f231c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f231c06aed0 0x7f231c06d390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f232c035000 tx=0x7f232c03a040 comp rx=0 tx=0).stop 2024-01-20T11:09:10.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 msgr2=0x7f234413d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f234413d830 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f233400c730 tx=0x7f233400cbf0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 shutdown_connections 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f231c06aed0 0x7f231c06d390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f234415e790 0x7f2344158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f234413c590 0x7f23441571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 --2- 172.21.15.162:0/4173794144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2324003f00 0x7f234413d830 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 >> 172.21.15.162:0/4173794144 conn(0x7f234406a600 msgr2=0x7f2344071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.070+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 shutdown_connections 2024-01-20T11:09:10.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.071+0000 7f234c600640 1 -- 172.21.15.162:0/4173794144 wait complete. 2024-01-20T11:09:10.089 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:09:10.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.298+0000 7f0730a00640 1 Processor -- start 2024-01-20T11:09:10.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.299+0000 7f0730a00640 1 -- start start 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.300+0000 7f0730a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f072c15dda0 0x7f072c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.300+0000 7f0730a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.300+0000 7f0730a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c0cf550 con 0x7f072c143c30 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.300+0000 7f0730a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c06f4b0 con 0x7f072c15dda0 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.300+0000 7f0730a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0cf830 con 0x7f072c06f040 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f072c15dda0 0x7f072c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f072c15dda0 0x7f072c06eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51650/0 (socket says 172.21.15.162:51650) 2024-01-20T11:09:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072aa00640 1 -- 172.21.15.162:0/94074126 learned_addr learned my addr 172.21.15.162:0/94074126 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072be00640 1 --2- 172.21.15.162:0/94074126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072aa00640 1 -- 172.21.15.162:0/94074126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 msgr2=0x7f072c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072aa00640 1 --2- 172.21.15.162:0/94074126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072aa00640 1 -- 172.21.15.162:0/94074126 >> v1:172.21.15.179:6789/0 conn(0x7f072c143c30 legacy=0x7f072c0ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.301+0000 7f072aa00640 1 -- 172.21.15.162:0/94074126 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c0cfb10 con 0x7f072c15dda0 2024-01-20T11:09:10.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.302+0000 7f072aa00640 1 --2- 172.21.15.162:0/94074126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c06eb00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f071c009e50 tx=0x7f071c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d29fda58b070a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:10.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f072a000640 1 -- 172.21.15.162:0/94074126 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c02cb00 con 0x7f072c15dda0 2024-01-20T11:09:10.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f072a000640 1 -- 172.21.15.162:0/94074126 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c02cc60 con 0x7f072c15dda0 2024-01-20T11:09:10.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f072a000640 1 -- 172.21.15.162:0/94074126 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0343f0 con 0x7f072c15dda0 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 -- 172.21.15.162:0/94074126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 msgr2=0x7f072c06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 --2- 172.21.15.162:0/94074126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c06eb00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f071c009e50 tx=0x7f071c02bf60 comp rx=0 tx=0).stop 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 -- 172.21.15.162:0/94074126 shutdown_connections 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 --2- 172.21.15.162:0/94074126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 --2- 172.21.15.162:0/94074126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c06eb00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 -- 172.21.15.162:0/94074126 >> 172.21.15.162:0/94074126 conn(0x7f072c06d5a0 msgr2=0x7f072c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 -- 172.21.15.162:0/94074126 shutdown_connections 2024-01-20T11:09:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.303+0000 7f0730a00640 1 -- 172.21.15.162:0/94074126 wait complete. 2024-01-20T11:09:10.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.305+0000 7f0730a00640 1 Processor -- start 2024-01-20T11:09:10.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.305+0000 7f0730a00640 1 -- start start 2024-01-20T11:09:10.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.306+0000 7f0730a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c1634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.306+0000 7f0730a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c143c30 0x7f072c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.306+0000 7f0730a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.306+0000 7f0730a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c13a810 con 0x7f072c15dda0 2024-01-20T11:09:10.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.306+0000 7f0730a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c140420 con 0x7f072c143c30 2024-01-20T11:09:10.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.306+0000 7f0730a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c140700 con 0x7f072c06f040 2024-01-20T11:09:10.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51652/0 (socket says 172.21.15.162:51652) 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 -- 172.21.15.162:0/3287455665 learned_addr learned my addr 172.21.15.162:0/3287455665 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072aa00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c143c30 0x7f072c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072b400640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c1634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 -- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 msgr2=0x7f072c1634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c1634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 -- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c143c30 msgr2=0x7f072c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c143c30 0x7f072c159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 -- 172.21.15.162:0/3287455665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009b30 con 0x7f072c15dda0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f072be00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c159eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f072400d800 tx=0x7f072400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.307+0000 7f0723400640 1 -- 172.21.15.162:0/3287455665 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400b6c0 con 0x7f072c15dda0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.308+0000 7f0723400640 1 -- 172.21.15.162:0/3287455665 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400b840 con 0x7f072c15dda0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.308+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c1409e0 con 0x7f072c15dda0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.308+0000 7f0723400640 1 -- 172.21.15.162:0/3287455665 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400bbf0 con 0x7f072c15dda0 2024-01-20T11:09:10.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.308+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c163a00 con 0x7f072c15dda0 2024-01-20T11:09:10.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.309+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c13a980 con 0x7f072c15dda0 2024-01-20T11:09:10.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.310+0000 7f0723400640 1 -- 172.21.15.162:0/3287455665 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f072400bd50 con 0x7f072c15dda0 2024-01-20T11:09:10.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.310+0000 7f0723400640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070406aed0 0x7f070406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.311+0000 7f0723400640 1 -- 172.21.15.162:0/3287455665 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0724089b60 con 0x7f072c15dda0 2024-01-20T11:09:10.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.311+0000 7f072b400640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070406aed0 0x7f070406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.311+0000 7f072b400640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070406aed0 0x7f070406d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f07140015a0 tx=0x7f0714009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:10.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.315+0000 7f0723400640 1 -- 172.21.15.162:0/3287455665 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0724054a10 con 0x7f072c15dda0 2024-01-20T11:09:10.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.506+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f072c163bf0 con 0x7f072c15dda0 2024-01-20T11:09:10.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.506+0000 7f0723400640 1 -- 172.21.15.162:0/3287455665 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0724058030 con 0x7f072c15dda0 2024-01-20T11:09:10.507 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:09:10.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070406aed0 msgr2=0x7f070406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070406aed0 0x7f070406d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f07140015a0 tx=0x7f0714009040 comp rx=0 tx=0).stop 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 msgr2=0x7f072c159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c159eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f072400d800 tx=0x7f072400dcc0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 shutdown_connections 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f072c15dda0 0x7f072c159eb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f070406aed0 0x7f070406d390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c143c30 0x7f072c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 --2- 172.21.15.162:0/3287455665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f072c06f040 0x7f072c1634c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 >> 172.21.15.162:0/3287455665 conn(0x7f072c06d5a0 msgr2=0x7f072c0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 shutdown_connections 2024-01-20T11:09:10.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.509+0000 7f0730a00640 1 -- 172.21.15.162:0/3287455665 wait complete. 2024-01-20T11:09:10.528 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:10.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.725+0000 7f2e70000640 1 Processor -- start 2024-01-20T11:09:10.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.725+0000 7f2e70000640 1 -- start start 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.726+0000 7f2e70000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e680ce8e0 0x7f2e68159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.726+0000 7f2e70000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680cba60 0x7f2e680c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.726+0000 7f2e70000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6806d0a0 con 0x7f2e680ae2c0 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.726+0000 7f2e70000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e680ca3b0 con 0x7f2e680ce8e0 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.726+0000 7f2e70000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680ca690 con 0x7f2e680cba60 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6cc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e680ce8e0 0x7f2e68159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6cc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e680ce8e0 0x7f2e68159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51654/0 (socket says 172.21.15.162:51654) 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6cc00640 1 -- 172.21.15.162:0/3472954428 learned_addr learned my addr 172.21.15.162:0/3472954428 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6cc00640 1 -- 172.21.15.162:0/3472954428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680cba60 msgr2=0x7f2e680c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6e000640 1 --2- 172.21.15.162:0/3472954428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680cba60 0x7f2e680c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6cc00640 1 --2- 172.21.15.162:0/3472954428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680cba60 0x7f2e680c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6cc00640 1 -- 172.21.15.162:0/3472954428 >> v1:172.21.15.179:6789/0 conn(0x7f2e680ae2c0 legacy=0x7f2e6806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.727+0000 7f2e6cc00640 1 -- 172.21.15.162:0/3472954428 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6806d2f0 con 0x7f2e680ce8e0 2024-01-20T11:09:10.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.729+0000 7f2e6cc00640 1 --2- 172.21.15.162:0/3472954428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ce8e0 0x7f2e68159a50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000bb10 tx=0x7f2e5002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ec0ba98c34782d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:10.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.733+0000 7f2e67e00640 1 -- 172.21.15.162:0/3472954428 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50036440 con 0x7f2e680ce8e0 2024-01-20T11:09:10.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.733+0000 7f2e67e00640 1 -- 172.21.15.162:0/3472954428 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e500365a0 con 0x7f2e680ce8e0 2024-01-20T11:09:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.733+0000 7f2e67e00640 1 -- 172.21.15.162:0/3472954428 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50036930 con 0x7f2e680ce8e0 2024-01-20T11:09:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 -- 172.21.15.162:0/3472954428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ce8e0 msgr2=0x7f2e68159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 --2- 172.21.15.162:0/3472954428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ce8e0 0x7f2e68159a50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000bb10 tx=0x7f2e5002e150 comp rx=0 tx=0).stop 2024-01-20T11:09:10.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 -- 172.21.15.162:0/3472954428 shutdown_connections 2024-01-20T11:09:10.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 --2- 172.21.15.162:0/3472954428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680cba60 0x7f2e680c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 --2- 172.21.15.162:0/3472954428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ce8e0 0x7f2e68159a50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 -- 172.21.15.162:0/3472954428 >> 172.21.15.162:0/3472954428 conn(0x7f2e680b0cd0 msgr2=0x7f2e680b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:10.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 -- 172.21.15.162:0/3472954428 shutdown_connections 2024-01-20T11:09:10.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.734+0000 7f2e70000640 1 -- 172.21.15.162:0/3472954428 wait complete. 2024-01-20T11:09:10.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.736+0000 7f2e70000640 1 Processor -- start 2024-01-20T11:09:10.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.736+0000 7f2e70000640 1 -- start start 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e70000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ae2c0 0x7f2e681e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e70000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e680cba60 0x7f2e68154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e70000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680ce8e0 0x7f2e681f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e70000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68155700 con 0x7f2e680ae2c0 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e70000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e681559e0 con 0x7f2e680cba60 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e70000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68155cc0 con 0x7f2e680ce8e0 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e6d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ae2c0 0x7f2e681e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e6d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ae2c0 0x7f2e681e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51656/0 (socket says 172.21.15.162:51656) 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e6d600640 1 -- 172.21.15.162:0/3157538543 learned_addr learned my addr 172.21.15.162:0/3157538543 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.737+0000 7f2e6e000640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680ce8e0 0x7f2e681f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e6cc00640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e680cba60 0x7f2e68154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e6d600640 1 -- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680ce8e0 msgr2=0x7f2e681f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e6d600640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680ce8e0 0x7f2e681f2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e6d600640 1 -- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e680cba60 msgr2=0x7f2e68154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e6d600640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e680cba60 0x7f2e68154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e6d600640 1 -- 172.21.15.162:0/3157538543 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5000b770 con 0x7f2e680ae2c0 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e6d600640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ae2c0 0x7f2e681e3620 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c450 tx=0x7f2e5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e65600640 1 -- 172.21.15.162:0/3157538543 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580052d0 con 0x7f2e680ae2c0 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e65600640 1 -- 172.21.15.162:0/3157538543 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58005430 con 0x7f2e680ae2c0 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e65600640 1 -- 172.21.15.162:0/3157538543 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58012870 con 0x7f2e680ae2c0 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e68155fa0 con 0x7f2e680ae2c0 2024-01-20T11:09:10.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.738+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e68151c80 con 0x7f2e680ae2c0 2024-01-20T11:09:10.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.740+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e681564c0 con 0x7f2e680ae2c0 2024-01-20T11:09:10.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.740+0000 7f2e65600640 1 -- 172.21.15.162:0/3157538543 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2e580129d0 con 0x7f2e680ae2c0 2024-01-20T11:09:10.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.741+0000 7f2e65600640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4006aed0 0x7f2e4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:10.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.741+0000 7f2e65600640 1 -- 172.21.15.162:0/3157538543 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e58089220 con 0x7f2e680ae2c0 2024-01-20T11:09:10.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.742+0000 7f2e6cc00640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4006aed0 0x7f2e4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:10.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.742+0000 7f2e6cc00640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4006aed0 0x7f2e4006d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2e50038000 tx=0x7f2e50008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:10.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.745+0000 7f2e65600640 1 -- 172.21.15.162:0/3157538543 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2e681564c0 con 0x7f2e680ae2c0 2024-01-20T11:09:10.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.960+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e681564c0 con 0x7f2e680ae2c0 2024-01-20T11:09:10.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.961+0000 7f2e65600640 1 -- 172.21.15.162:0/3157538543 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f2e58054050 con 0x7f2e680ae2c0 2024-01-20T11:09:10.962 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:10.962 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:09:10.962 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:09:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4006aed0 msgr2=0x7f2e4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4006aed0 0x7f2e4006d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2e50038000 tx=0x7f2e50008040 comp rx=0 tx=0).stop 2024-01-20T11:09:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ae2c0 msgr2=0x7f2e681e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ae2c0 0x7f2e681e3620 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c450 tx=0x7f2e5800c910 comp rx=0 tx=0).stop 2024-01-20T11:09:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 shutdown_connections 2024-01-20T11:09:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e680ce8e0 0x7f2e681f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2e4006aed0 0x7f2e4006d390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e680cba60 0x7f2e68154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 --2- 172.21.15.162:0/3157538543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e680ae2c0 0x7f2e681e3620 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 >> 172.21.15.162:0/3157538543 conn(0x7f2e680b0cd0 msgr2=0x7f2e68150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 shutdown_connections 2024-01-20T11:09:10.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:10.963+0000 7f2e70000640 1 -- 172.21.15.162:0/3157538543 wait complete. 2024-01-20T11:09:10.981 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:11.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.166+0000 7f819be00640 1 Processor -- start 2024-01-20T11:09:11.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.167+0000 7f819be00640 1 -- start start 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.168+0000 7f819be00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f819c13e040 0x7f819c0cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.168+0000 7f819be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f819c0cd9c0 0x7f819c0cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.168+0000 7f819be00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0cc550 con 0x7f819c0cb9d0 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.168+0000 7f819be00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c15fe00 con 0x7f819c0cd9c0 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.168+0000 7f819be00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c15b910 con 0x7f819c13e040 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f8191e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f819c0cd9c0 0x7f819c0cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f8191e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f819c0cd9c0 0x7f819c0cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51672/0 (socket says 172.21.15.162:51672) 2024-01-20T11:09:11.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f8191e00640 1 -- 172.21.15.162:0/110929359 learned_addr learned my addr 172.21.15.162:0/110929359 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:11.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f819aa00640 1 --2- 172.21.15.162:0/110929359 >> v2:172.21.15.179:3300/0 conn(0x7f819c13e040 0x7f819c0cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f8191e00640 1 -- 172.21.15.162:0/110929359 >> v2:172.21.15.179:3300/0 conn(0x7f819c13e040 msgr2=0x7f819c0cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:11.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f8191e00640 1 --2- 172.21.15.162:0/110929359 >> v2:172.21.15.179:3300/0 conn(0x7f819c13e040 0x7f819c0cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f8191e00640 1 -- 172.21.15.162:0/110929359 >> v1:172.21.15.162:6789/0 conn(0x7f819c0cb9d0 legacy=0x7f819c0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.169+0000 7f8191e00640 1 -- 172.21.15.162:0/110929359 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c15bbf0 con 0x7f819c0cd9c0 2024-01-20T11:09:11.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.170+0000 7f8191e00640 1 --2- 172.21.15.162:0/110929359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c0cf8b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f819c0b5080 tx=0x7f818402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d47a434bfbd066b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:11.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819a000640 1 -- 172.21.15.162:0/110929359 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184031870 con 0x7f819c0cd9c0 2024-01-20T11:09:11.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819a000640 1 -- 172.21.15.162:0/110929359 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840319d0 con 0x7f819c0cd9c0 2024-01-20T11:09:11.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819a000640 1 -- 172.21.15.162:0/110929359 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184031d60 con 0x7f819c0cd9c0 2024-01-20T11:09:11.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819be00640 1 -- 172.21.15.162:0/110929359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 msgr2=0x7f819c0cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819be00640 1 --2- 172.21.15.162:0/110929359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c0cf8b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f819c0b5080 tx=0x7f818402b910 comp rx=0 tx=0).stop 2024-01-20T11:09:11.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819be00640 1 -- 172.21.15.162:0/110929359 shutdown_connections 2024-01-20T11:09:11.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819be00640 1 --2- 172.21.15.162:0/110929359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c0cf8b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819be00640 1 --2- 172.21.15.162:0/110929359 >> v2:172.21.15.179:3300/0 conn(0x7f819c13e040 0x7f819c0cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.171+0000 7f819be00640 1 -- 172.21.15.162:0/110929359 >> 172.21.15.162:0/110929359 conn(0x7f819c06aa20 msgr2=0x7f819c06ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:11.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.172+0000 7f819be00640 1 -- 172.21.15.162:0/110929359 shutdown_connections 2024-01-20T11:09:11.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.172+0000 7f819be00640 1 -- 172.21.15.162:0/110929359 wait complete. 2024-01-20T11:09:11.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.173+0000 7f819be00640 1 Processor -- start 2024-01-20T11:09:11.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.173+0000 7f819be00640 1 -- start start 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.174+0000 7f819be00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819c0cb9d0 0x7f819c137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.174+0000 7f819be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c1397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.174+0000 7f819be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f819c13e040 0x7f819c138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.174+0000 7f819be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c139120 con 0x7f819c0cd9c0 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.174+0000 7f819be00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c139e70 con 0x7f819c0cb9d0 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.174+0000 7f819be00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c13a150 con 0x7f819c13e040 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c1397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c1397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51686/0 (socket says 172.21.15.162:51686) 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 -- 172.21.15.162:0/1008477647 learned_addr learned my addr 172.21.15.162:0/1008477647 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f819b400640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f819c13e040 0x7f819c138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 -- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f819c13e040 msgr2=0x7f819c138be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f819aa00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819c0cb9d0 0x7f819c137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f819c13e040 0x7f819c138be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 -- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819c0cb9d0 msgr2=0x7f819c137a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819c0cb9d0 0x7f819c137a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.175+0000 7f8191e00640 1 -- 172.21.15.162:0/1008477647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840094d0 con 0x7f819c0cd9c0 2024-01-20T11:09:11.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.176+0000 7f8191e00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c1397e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f818402b950 tx=0x7f81840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:11.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.176+0000 7f8193400640 1 -- 172.21.15.162:0/1008477647 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818403ad30 con 0x7f819c0cd9c0 2024-01-20T11:09:11.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.176+0000 7f8193400640 1 -- 172.21.15.162:0/1008477647 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840443f0 con 0x7f819c0cd9c0 2024-01-20T11:09:11.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.176+0000 7f8193400640 1 -- 172.21.15.162:0/1008477647 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840447a0 con 0x7f819c0cd9c0 2024-01-20T11:09:11.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.176+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c13a430 con 0x7f819c0cd9c0 2024-01-20T11:09:11.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.176+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c13a9f0 con 0x7f819c0cd9c0 2024-01-20T11:09:11.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.177+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c074a30 con 0x7f819c0cd9c0 2024-01-20T11:09:11.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.178+0000 7f8193400640 1 -- 172.21.15.162:0/1008477647 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f818404d450 con 0x7f819c0cd9c0 2024-01-20T11:09:11.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.179+0000 7f8193400640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f817406aed0 0x7f817406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.179+0000 7f8193400640 1 -- 172.21.15.162:0/1008477647 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f818402d040 con 0x7f819c0cd9c0 2024-01-20T11:09:11.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.179+0000 7f819aa00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f817406aed0 0x7f817406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.180+0000 7f819aa00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f817406aed0 0x7f817406d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f819c154120 tx=0x7f818c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:11.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.184+0000 7f8193400640 1 -- 172.21.15.162:0/1008477647 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8184076ac0 con 0x7f819c0cd9c0 2024-01-20T11:09:11.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.378+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f819c13a290 con 0x7f819c0cd9c0 2024-01-20T11:09:11.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.381+0000 7f8193400640 1 -- 172.21.15.162:0/1008477647 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f819c13a290 con 0x7f819c0cd9c0 2024-01-20T11:09:11.382 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:11.382 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":36,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:42.965160+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:08:38.930132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T11:08:40.039032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f817406aed0 msgr2=0x7f817406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f817406aed0 0x7f817406d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f819c154120 tx=0x7f818c00b040 comp rx=0 tx=0).stop 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 msgr2=0x7f819c1397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c1397e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f818402b950 tx=0x7f81840046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 shutdown_connections 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f819c13e040 0x7f819c138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819c0cd9c0 0x7f819c1397e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f817406aed0 0x7f817406d390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 --2- 172.21.15.162:0/1008477647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819c0cb9d0 0x7f819c137a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 >> 172.21.15.162:0/1008477647 conn(0x7f819c06aa20 msgr2=0x7f819c0b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:11.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.384+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 shutdown_connections 2024-01-20T11:09:11.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.385+0000 7f819be00640 1 -- 172.21.15.162:0/1008477647 wait complete. 2024-01-20T11:09:11.403 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T11:09:11.404 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:11.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.608+0000 7f5189600640 1 Processor -- start 2024-01-20T11:09:11.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.608+0000 7f5189600640 1 -- start start 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.609+0000 7f5189600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51840b55b0 0x7f51840ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.609+0000 7f5189600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406d040 0x7f51840d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.609+0000 7f5189600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518406ce20 con 0x7f51840b51d0 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.609+0000 7f5189600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518406c210 con 0x7f51840b55b0 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.609+0000 7f5189600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518406c4f0 con 0x7f518406d040 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.610+0000 7f5182000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51840b55b0 0x7f51840ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.610+0000 7f5182000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51840b55b0 0x7f51840ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51690/0 (socket says 172.21.15.162:51690) 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.610+0000 7f5182000640 1 -- 172.21.15.162:0/3171544957 learned_addr learned my addr 172.21.15.162:0/3171544957 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.610+0000 7f5182000640 1 -- 172.21.15.162:0/3171544957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406d040 msgr2=0x7f51840d16e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-20T11:09:11.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.610+0000 7f5182000640 1 --2- 172.21.15.162:0/3171544957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406d040 0x7f51840d16e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.610+0000 7f5182000640 1 -- 172.21.15.162:0/3171544957 >> v1:172.21.15.179:6789/0 conn(0x7f51840b51d0 legacy=0x7f51840cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:11.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.610+0000 7f5182000640 1 -- 172.21.15.162:0/3171544957 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518406c7d0 con 0x7f51840b55b0 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.611+0000 7f5182000640 1 --2- 172.21.15.162:0/3171544957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b55b0 0x7f51840ce570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f516c009870 tx=0x7f516c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf292c8953b555d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.611+0000 7f5181600640 1 -- 172.21.15.162:0/3171544957 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c0317e0 con 0x7f51840b55b0 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.611+0000 7f5181600640 1 -- 172.21.15.162:0/3171544957 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c031940 con 0x7f51840b55b0 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.611+0000 7f5181600640 1 -- 172.21.15.162:0/3171544957 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c031cd0 con 0x7f51840b55b0 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 -- 172.21.15.162:0/3171544957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b55b0 msgr2=0x7f51840ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 --2- 172.21.15.162:0/3171544957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b55b0 0x7f51840ce570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f516c009870 tx=0x7f516c02b880 comp rx=0 tx=0).stop 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 -- 172.21.15.162:0/3171544957 shutdown_connections 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 --2- 172.21.15.162:0/3171544957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406d040 0x7f51840d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 --2- 172.21.15.162:0/3171544957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b55b0 0x7f51840ce570 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 -- 172.21.15.162:0/3171544957 >> 172.21.15.162:0/3171544957 conn(0x7f518409c790 msgr2=0x7f51840d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 -- 172.21.15.162:0/3171544957 shutdown_connections 2024-01-20T11:09:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.612+0000 7f5189600640 1 -- 172.21.15.162:0/3171544957 wait complete. 2024-01-20T11:09:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.614+0000 7f5189600640 1 Processor -- start 2024-01-20T11:09:11.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.614+0000 7f5189600640 1 -- start start 2024-01-20T11:09:11.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5189600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f518406d040 0x7f518415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5189600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b51d0 0x7f51840c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5189600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840b55b0 0x7f51840b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5189600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840c8a30 con 0x7f51840b51d0 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5189600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840c7a20 con 0x7f518406d040 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5189600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51840ca030 con 0x7f51840b55b0 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5182000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b51d0 0x7f51840c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5182000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b51d0 0x7f51840c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51694/0 (socket says 172.21.15.162:51694) 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.615+0000 7f5182000640 1 -- 172.21.15.162:0/1194829556 learned_addr learned my addr 172.21.15.162:0/1194829556 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182a00640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f518406d040 0x7f518415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182000640 1 -- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840b55b0 msgr2=0x7f51840b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182000640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840b55b0 0x7f51840b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182000640 1 -- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f518406d040 msgr2=0x7f518415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182000640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f518406d040 0x7f518415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182000640 1 -- 172.21.15.162:0/1194829556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0094d0 con 0x7f51840b51d0 2024-01-20T11:09:11.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182a00640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f518406d040 0x7f518415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:11.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f5182000640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b51d0 0x7f51840c9af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f516c000c00 tx=0x7f516c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:11.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.616+0000 7f517aa00640 1 -- 172.21.15.162:0/1194829556 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c032880 con 0x7f51840b51d0 2024-01-20T11:09:11.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.617+0000 7f517aa00640 1 -- 172.21.15.162:0/1194829556 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c0329e0 con 0x7f51840b51d0 2024-01-20T11:09:11.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.617+0000 7f517aa00640 1 -- 172.21.15.162:0/1194829556 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c032d90 con 0x7f51840b51d0 2024-01-20T11:09:11.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.617+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51840c7c70 con 0x7f51840b51d0 2024-01-20T11:09:11.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.617+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51840c8230 con 0x7f51840b51d0 2024-01-20T11:09:11.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.618+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518404e970 con 0x7f51840b51d0 2024-01-20T11:09:11.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.619+0000 7f517aa00640 1 -- 172.21.15.162:0/1194829556 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f516c04d3f0 con 0x7f51840b51d0 2024-01-20T11:09:11.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.620+0000 7f517aa00640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f515c06aed0 0x7f515c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:11.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.620+0000 7f517aa00640 1 -- 172.21.15.162:0/1194829556 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f516c0ab470 con 0x7f51840b51d0 2024-01-20T11:09:11.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.620+0000 7f5182a00640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f515c06aed0 0x7f515c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:11.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.621+0000 7f5182a00640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f515c06aed0 0x7f515c06d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51740016b0 tx=0x7f5174009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:11.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.625+0000 7f517aa00640 1 -- 172.21.15.162:0/1194829556 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f516c0763d0 con 0x7f51840b51d0 2024-01-20T11:09:11.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.857+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51840b1e50 con 0x7f51840b51d0 2024-01-20T11:09:11.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.858+0000 7f517aa00640 1 -- 172.21.15.162:0/1194829556 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f516c0799f0 con 0x7f51840b51d0 2024-01-20T11:09:11.859 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:11.859 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:09:11.860 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:09:11.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.861+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f515c06aed0 msgr2=0x7f515c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.861+0000 7f5189600640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f515c06aed0 0x7f515c06d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51740016b0 tx=0x7f5174009040 comp rx=0 tx=0).stop 2024-01-20T11:09:11.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.861+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b51d0 msgr2=0x7f51840c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:11.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.861+0000 7f5189600640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b51d0 0x7f51840c9af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f516c000c00 tx=0x7f516c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.861+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 shutdown_connections 2024-01-20T11:09:11.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.862+0000 7f5189600640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840b55b0 0x7f51840b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.862+0000 7f5189600640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51840b51d0 0x7f51840c9af0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.862+0000 7f5189600640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f515c06aed0 0x7f515c06d390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.862+0000 7f5189600640 1 --2- 172.21.15.162:0/1194829556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f518406d040 0x7f518415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:11.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.862+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 >> 172.21.15.162:0/1194829556 conn(0x7f518409c790 msgr2=0x7f518415fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:11.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.862+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 shutdown_connections 2024-01-20T11:09:11.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:11.862+0000 7f5189600640 1 -- 172.21.15.162:0/1194829556 wait complete. 2024-01-20T11:09:11.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:12.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.089+0000 7fcd2fe00640 1 Processor -- start 2024-01-20T11:09:12.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.090+0000 7fcd2fe00640 1 -- start start 2024-01-20T11:09:12.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.091+0000 7fcd2fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd3015d420 0x7fcd300d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.091+0000 7fcd2fe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd300d1f90 0x7fcd300b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.091+0000 7fcd2fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd300b2880 con 0x7fcd3015d800 2024-01-20T11:09:12.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.091+0000 7fcd2fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd30161110 con 0x7fcd3015d420 2024-01-20T11:09:12.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.091+0000 7fcd2fe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd301613f0 con 0x7fcd300d1f90 2024-01-20T11:09:12.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.091+0000 7fcd2ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd3015d420 0x7fcd300d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd3015d420 0x7fcd300d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51696/0 (socket says 172.21.15.162:51696) 2024-01-20T11:09:12.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2ea00640 1 -- 172.21.15.162:0/3019965345 learned_addr learned my addr 172.21.15.162:0/3019965345 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd25e00640 1 --1- 172.21.15.162:0/3019965345 >> v1:172.21.15.162:6789/0 conn(0x7fcd3015d800 0x7fcd300d1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52644/0 (socket says 172.21.15.162:52644) 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2f400640 1 --2- 172.21.15.162:0/3019965345 >> v2:172.21.15.179:3300/0 conn(0x7fcd300d1f90 0x7fcd300b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2ea00640 1 -- 172.21.15.162:0/3019965345 >> v2:172.21.15.179:3300/0 conn(0x7fcd300d1f90 msgr2=0x7fcd300b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2ea00640 1 --2- 172.21.15.162:0/3019965345 >> v2:172.21.15.179:3300/0 conn(0x7fcd300d1f90 0x7fcd300b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2ea00640 1 -- 172.21.15.162:0/3019965345 >> v1:172.21.15.162:6789/0 conn(0x7fcd3015d800 legacy=0x7fcd300d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2ea00640 1 -- 172.21.15.162:0/3019965345 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd301616d0 con 0x7fcd3015d420 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.092+0000 7fcd2f400640 1 --2- 172.21.15.162:0/3019965345 >> v2:172.21.15.179:3300/0 conn(0x7fcd300d1f90 0x7fcd300b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:12.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.093+0000 7fcd2ea00640 1 --2- 172.21.15.162:0/3019965345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300d0fc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b5da0 tx=0x7fcd2002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af909b2d3f37a348 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:12.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.093+0000 7fcd2e000640 1 -- 172.21.15.162:0/3019965345 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2002cbb0 con 0x7fcd3015d420 2024-01-20T11:09:12.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2e000640 1 -- 172.21.15.162:0/3019965345 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2002cd10 con 0x7fcd3015d420 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2e000640 1 -- 172.21.15.162:0/3019965345 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20034610 con 0x7fcd3015d420 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 -- 172.21.15.162:0/3019965345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 msgr2=0x7fcd300d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/3019965345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300d0fc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b5da0 tx=0x7fcd2002c010 comp rx=0 tx=0).stop 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 -- 172.21.15.162:0/3019965345 shutdown_connections 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/3019965345 >> v2:172.21.15.179:3300/0 conn(0x7fcd300d1f90 0x7fcd300b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/3019965345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300d0fc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 -- 172.21.15.162:0/3019965345 >> 172.21.15.162:0/3019965345 conn(0x7fcd3008cc50 msgr2=0x7fcd3009c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 -- 172.21.15.162:0/3019965345 shutdown_connections 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.094+0000 7fcd2fe00640 1 -- 172.21.15.162:0/3019965345 wait complete. 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.096+0000 7fcd2fe00640 1 Processor -- start 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.096+0000 7fcd2fe00640 1 -- start start 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300d1f90 0x7fcd30157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3015d800 0x7fcd300b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd2fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30157cc0 con 0x7fcd3015d420 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd2fe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300cb760 con 0x7fcd3015d800 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd2fe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300ca8b0 con 0x7fcd300d1f90 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd25e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd25e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51708/0 (socket says 172.21.15.162:51708) 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.097+0000 7fcd25e00640 1 -- 172.21.15.162:0/2560830971 learned_addr learned my addr 172.21.15.162:0/2560830971 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd2ea00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300d1f90 0x7fcd30157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd2f400640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3015d800 0x7fcd300b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd25e00640 1 -- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300d1f90 msgr2=0x7fcd30157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd25e00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300d1f90 0x7fcd30157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd25e00640 1 -- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3015d800 msgr2=0x7fcd300b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd25e00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3015d800 0x7fcd300b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd25e00640 1 -- 172.21.15.162:0/2560830971 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009b30 con 0x7fcd3015d420 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd25e00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300ca370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c440 tx=0x7fcd18001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:12.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.098+0000 7fcd27400640 1 -- 172.21.15.162:0/2560830971 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180074e0 con 0x7fcd3015d420 2024-01-20T11:09:12.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.099+0000 7fcd27400640 1 -- 172.21.15.162:0/2560830971 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18007640 con 0x7fcd3015d420 2024-01-20T11:09:12.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.099+0000 7fcd27400640 1 -- 172.21.15.162:0/2560830971 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18004a20 con 0x7fcd3015d420 2024-01-20T11:09:12.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.099+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd300cab50 con 0x7fcd3015d420 2024-01-20T11:09:12.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.099+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd300cb110 con 0x7fcd3015d420 2024-01-20T11:09:12.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.100+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30074a30 con 0x7fcd3015d420 2024-01-20T11:09:12.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.101+0000 7fcd27400640 1 -- 172.21.15.162:0/2560830971 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcd18004b80 con 0x7fcd3015d420 2024-01-20T11:09:12.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.101+0000 7fcd27400640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd0806aed0 0x7fcd0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.102+0000 7fcd27400640 1 -- 172.21.15.162:0/2560830971 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd18089080 con 0x7fcd3015d420 2024-01-20T11:09:12.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.102+0000 7fcd2ea00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd0806aed0 0x7fcd0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.102+0000 7fcd2ea00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd0806aed0 0x7fcd0806d390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd20035000 tx=0x7fcd20030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:12.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.106+0000 7fcd27400640 1 -- 172.21.15.162:0/2560830971 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcd180bc0d0 con 0x7fcd3015d420 2024-01-20T11:09:12.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.335+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd300cb8a0 con 0x7fcd3015d420 2024-01-20T11:09:12.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.336+0000 7fcd27400640 1 -- 172.21.15.162:0/2560830971 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fcd18053eb0 con 0x7fcd3015d420 2024-01-20T11:09:12.337 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:12.337 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:08:41.042767+0000","modified":"2024-01-20T11:08:44.515516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5097":{"gid":5097,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6837/1733739377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1733739377},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733739377}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T11:09:12.337 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 15 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd0806aed0 msgr2=0x7fcd0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd0806aed0 0x7fcd0806d390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd20035000 tx=0x7fcd20030000 comp rx=0 tx=0).stop 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 msgr2=0x7fcd300ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300ca370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c440 tx=0x7fcd18001e70 comp rx=0 tx=0).stop 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 shutdown_connections 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fcd0806aed0 0x7fcd0806d390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3015d800 0x7fcd300b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd3015d420 0x7fcd300ca370 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 --2- 172.21.15.162:0/2560830971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300d1f90 0x7fcd30157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 >> 172.21.15.162:0/2560830971 conn(0x7fcd3008cc50 msgr2=0x7fcd300ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:12.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 shutdown_connections 2024-01-20T11:09:12.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.339+0000 7fcd2fe00640 1 -- 172.21.15.162:0/2560830971 wait complete. 2024-01-20T11:09:12.357 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:12.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.563+0000 7fce6ca00640 1 Processor -- start 2024-01-20T11:09:12.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.563+0000 7fce6ca00640 1 -- start start 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6ca00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64155a30 0x7fce640ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6ca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce640ae6b0 0x7fce6406c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce64070b60 con 0x7fce64070630 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6ca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6415ba10 con 0x7fce640ae6b0 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6ca00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6415bc00 con 0x7fce64155a30 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce640ae6b0 0x7fce6406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce640ae6b0 0x7fce6406c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51716/0 (socket says 172.21.15.162:51716) 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6aa00640 1 -- 172.21.15.162:0/795124766 learned_addr learned my addr 172.21.15.162:0/795124766 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.565+0000 7fce6a000640 1 --2- 172.21.15.162:0/795124766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64155a30 0x7fce640ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.566+0000 7fce6aa00640 1 -- 172.21.15.162:0/795124766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64155a30 msgr2=0x7fce640ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.566+0000 7fce6aa00640 1 --2- 172.21.15.162:0/795124766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64155a30 0x7fce640ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.566+0000 7fce6aa00640 1 -- 172.21.15.162:0/795124766 >> v1:172.21.15.162:6789/0 conn(0x7fce64070630 legacy=0x7fce640adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.566+0000 7fce6aa00640 1 -- 172.21.15.162:0/795124766 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6415bee0 con 0x7fce640ae6b0 2024-01-20T11:09:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.567+0000 7fce6aa00640 1 --2- 172.21.15.162:0/795124766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6406c690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009e50 tx=0x7fce5c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9181ccd97b5ae42b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce68c00640 1 -- 172.21.15.162:0/795124766 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c02ca70 con 0x7fce640ae6b0 2024-01-20T11:09:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce68c00640 1 -- 172.21.15.162:0/795124766 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c02cbd0 con 0x7fce640ae6b0 2024-01-20T11:09:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce68c00640 1 -- 172.21.15.162:0/795124766 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0343f0 con 0x7fce640ae6b0 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce6ca00640 1 -- 172.21.15.162:0/795124766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 msgr2=0x7fce6406c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce6ca00640 1 --2- 172.21.15.162:0/795124766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6406c690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009e50 tx=0x7fce5c02bed0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce6ca00640 1 -- 172.21.15.162:0/795124766 shutdown_connections 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce6ca00640 1 --2- 172.21.15.162:0/795124766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6406c690 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce6ca00640 1 --2- 172.21.15.162:0/795124766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64155a30 0x7fce640ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.568+0000 7fce6ca00640 1 -- 172.21.15.162:0/795124766 >> 172.21.15.162:0/795124766 conn(0x7fce640b0cd0 msgr2=0x7fce640b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.569+0000 7fce6ca00640 1 -- 172.21.15.162:0/795124766 shutdown_connections 2024-01-20T11:09:12.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.569+0000 7fce6ca00640 1 -- 172.21.15.162:0/795124766 wait complete. 2024-01-20T11:09:12.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.570+0000 7fce6ca00640 1 Processor -- start 2024-01-20T11:09:12.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.571+0000 7fce6ca00640 1 -- start start 2024-01-20T11:09:12.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.571+0000 7fce6ca00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64070630 0x7fce6415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.571+0000 7fce6ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6409c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.571+0000 7fce6ca00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce64155a30 0x7fce6409cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce6ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640b45c0 con 0x7fce640ae6b0 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce6ca00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640b48a0 con 0x7fce64155a30 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce6ca00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce64144870 con 0x7fce64070630 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6409c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6409c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51718/0 (socket says 172.21.15.162:51718) 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 -- 172.21.15.162:0/3049868935 learned_addr learned my addr 172.21.15.162:0/3049868935 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce6a000640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64070630 0x7fce6415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 -- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64070630 msgr2=0x7fce6415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce6aa00640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce64155a30 0x7fce6409cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64070630 0x7fce6415ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 -- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce64155a30 msgr2=0x7fce6409cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce64155a30 0x7fce6409cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.572+0000 7fce69600640 1 -- 172.21.15.162:0/3049868935 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c009b30 con 0x7fce640ae6b0 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.573+0000 7fce69600640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6409c580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c440 tx=0x7fce4c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:12.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.573+0000 7fce62000640 1 -- 172.21.15.162:0/3049868935 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0052d0 con 0x7fce640ae6b0 2024-01-20T11:09:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.573+0000 7fce62000640 1 -- 172.21.15.162:0/3049868935 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c005430 con 0x7fce640ae6b0 2024-01-20T11:09:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.573+0000 7fce62000640 1 -- 172.21.15.162:0/3049868935 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c007260 con 0x7fce640ae6b0 2024-01-20T11:09:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.573+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce64144b50 con 0x7fce640ae6b0 2024-01-20T11:09:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.573+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce640b3840 con 0x7fce640ae6b0 2024-01-20T11:09:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.574+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6404e970 con 0x7fce640ae6b0 2024-01-20T11:09:12.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.575+0000 7fce62000640 1 -- 172.21.15.162:0/3049868935 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fce4c0073c0 con 0x7fce640ae6b0 2024-01-20T11:09:12.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.576+0000 7fce62000640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce3c06aed0 0x7fce3c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.576+0000 7fce62000640 1 -- 172.21.15.162:0/3049868935 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce4c088a60 con 0x7fce640ae6b0 2024-01-20T11:09:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.576+0000 7fce6a000640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce3c06aed0 0x7fce3c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:12.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.577+0000 7fce6a000640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce3c06aed0 0x7fce3c06d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fce54006fd0 tx=0x7fce54008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:12.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.581+0000 7fce62000640 1 -- 172.21.15.162:0/3049868935 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fce4c053930 con 0x7fce640ae6b0 2024-01-20T11:09:12.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.775+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce64155250 con 0x7fce640ae6b0 2024-01-20T11:09:12.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.777+0000 7fce62000640 1 -- 172.21.15.162:0/3049868935 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16594 (secure 0 0 0) 0x7fce4c056f50 con 0x7fce640ae6b0 2024-01-20T11:09:12.778 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:12.778 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":36,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:08:42.965160+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:08:38.930132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T11:08:40.039032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce3c06aed0 msgr2=0x7fce3c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce3c06aed0 0x7fce3c06d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fce54006fd0 tx=0x7fce54008040 comp rx=0 tx=0).stop 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 msgr2=0x7fce6409c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6409c580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c440 tx=0x7fce4c001e70 comp rx=0 tx=0).stop 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 shutdown_connections 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce3c06aed0 0x7fce3c06d390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce64155a30 0x7fce6409cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce640ae6b0 0x7fce6409c580 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 --2- 172.21.15.162:0/3049868935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce64070630 0x7fce6415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 >> 172.21.15.162:0/3049868935 conn(0x7fce640b0cd0 msgr2=0x7fce640cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:12.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 shutdown_connections 2024-01-20T11:09:12.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:12.780+0000 7fce6ca00640 1 -- 172.21.15.162:0/3049868935 wait complete. 2024-01-20T11:09:12.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-20T11:09:13.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.001+0000 7fedaaa00640 1 Processor -- start 2024-01-20T11:09:13.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.002+0000 7fedaaa00640 1 -- start start 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.003+0000 7fedaaa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 0x7feda406c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.003+0000 7fedaaa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda406bc70 con 0x7feda415d800 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.003+0000 7fedaaa00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda415dbe0 con 0x7feda40b5690 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.003+0000 7fedaaa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40b2df0 con 0x7feda40d1fc0 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.003+0000 7feda3e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7feda415d800 0x7feda40b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52674/0 (socket says 172.21.15.162:52674) 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.003+0000 7feda3e00640 1 -- 172.21.15.162:0/1948966956 learned_addr learned my addr 172.21.15.162:0/1948966956 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166556138 0 0) 0x7feda406bc70 con 0x7feda415d800 2024-01-20T11:09:13.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed84003520 con 0x7feda415d800 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda8a00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 0x7feda406c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4187791105 0 0) 0x7fed84003520 con 0x7feda415d800 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 msgr2=0x7feda406c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 0x7feda406c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 >> v1:172.21.15.179:6789/0 conn(0x7feda40b5690 legacy=0x7feda406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40d2510 con 0x7feda415d800 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fed94001670 con 0x7feda415d800 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 >> v1:172.21.15.162:6789/0 conn(0x7feda415d800 legacy=0x7feda40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed840039a0 0x7fed84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 0x7fed840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed84004d00 0x7fed84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40b2df0 con 0x7fed840039a0 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8400bb90 con 0x7fed84004d00 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.004+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8400bd50 con 0x7feda40d1fc0 2024-01-20T11:09:13.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3e00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed840039a0 0x7fed84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3400640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 0x7fed840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3e00640 1 -- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 msgr2=0x7fed840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3e00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 0x7fed840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3e00640 1 -- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed84004d00 msgr2=0x7fed84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3e00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed84004d00 0x7fed84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3e00640 1 -- 172.21.15.162:0/1948966956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84003520 con 0x7fed840039a0 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.005+0000 7feda3400640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feda40d1fc0 0x7fed840047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.006+0000 7feda3e00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed840039a0 0x7fed84003dc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c0e0 tx=0x7fed840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc0d5b95b1c1658 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.006+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94005ad0 con 0x7fed840039a0 2024-01-20T11:09:13.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.006+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94005c30 con 0x7fed840039a0 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.006+0000 7feda2a00640 1 -- 172.21.15.162:0/1948966956 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9402c7d0 con 0x7fed840039a0 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.007+0000 7fedaaa00640 1 -- 172.21.15.162:0/1948966956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed840039a0 msgr2=0x7fed84003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.007+0000 7fedaaa00640 1 --2- 172.21.15.162:0/1948966956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed840039a0 0x7fed84003dc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c0e0 tx=0x7fed840057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.007+0000 7feda8a00640 1 -- 172.21.15.162:0/1948966956 reap_dead start 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.007+0000 7fedaaa00640 1 -- 172.21.15.162:0/1948966956 shutdown_connections 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.007+0000 7fedaaa00640 1 -- 172.21.15.162:0/1948966956 >> 172.21.15.162:0/1948966956 conn(0x7feda409c7b0 msgr2=0x7feda40d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.007+0000 7fedaaa00640 1 -- 172.21.15.162:0/1948966956 shutdown_connections 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.007+0000 7fedaaa00640 1 -- 172.21.15.162:0/1948966956 wait complete. 2024-01-20T11:09:13.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.009+0000 7fedaaa00640 1 Processor -- start 2024-01-20T11:09:13.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.009+0000 7fedaaa00640 1 -- start start 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7fedaaa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed840039a0 0x7feda414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7fedaaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4158790 0x7feda415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7fedaaa00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feda4158c10 0x7feda415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7fedaaa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4159170 con 0x7feda4158790 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7fedaaa00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda41f6650 con 0x7feda4158c10 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7fedaaa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda41f6930 con 0x7fed840039a0 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7feda3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4158790 0x7feda415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7feda3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4158790 0x7feda415b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51742/0 (socket says 172.21.15.162:51742) 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.010+0000 7feda3400640 1 -- 172.21.15.162:0/482416110 learned_addr learned my addr 172.21.15.162:0/482416110 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda3e00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed840039a0 0x7feda414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda8a00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feda4158c10 0x7feda415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda3400640 1 -- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed840039a0 msgr2=0x7feda414dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda3400640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed840039a0 0x7feda414dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda3400640 1 -- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feda4158c10 msgr2=0x7feda415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda3400640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feda4158c10 0x7feda415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda3400640 1 -- 172.21.15.162:0/482416110 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda41f6c10 con 0x7feda4158790 2024-01-20T11:09:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7feda3400640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4158790 0x7feda415b100 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00dae0 tx=0x7fed8c0020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7fed9be00640 1 -- 172.21.15.162:0/482416110 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c003da0 con 0x7feda4158790 2024-01-20T11:09:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7fed9be00640 1 -- 172.21.15.162:0/482416110 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c00b710 con 0x7feda4158790 2024-01-20T11:09:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.011+0000 7fed9be00640 1 -- 172.21.15.162:0/482416110 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00bac0 con 0x7feda4158790 2024-01-20T11:09:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.012+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda41f6ef0 con 0x7feda4158790 2024-01-20T11:09:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.012+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda41f7410 con 0x7feda4158790 2024-01-20T11:09:13.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.013+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda41592b0 con 0x7feda4158790 2024-01-20T11:09:13.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.014+0000 7fed9be00640 1 -- 172.21.15.162:0/482416110 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fed8c00bc20 con 0x7feda4158790 2024-01-20T11:09:13.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.015+0000 7fed9be00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fed7c06aed0 0x7fed7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.015+0000 7fed9be00640 1 -- 172.21.15.162:0/482416110 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed8c089960 con 0x7feda4158790 2024-01-20T11:09:13.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.015+0000 7feda3e00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fed7c06aed0 0x7fed7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.016+0000 7feda3e00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fed7c06aed0 0x7fed7c06d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed94034000 tx=0x7fed94037040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:13.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.019+0000 7fed9be00640 1 -- 172.21.15.162:0/482416110 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fed8c054820 con 0x7feda4158790 2024-01-20T11:09:13.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.253+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feda404e970 con 0x7feda4158790 2024-01-20T11:09:13.254 INFO:tasks.ceph.mon.a.smithi162.stderr:2024-01-20T11:09:13.254+0000 7f7926600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T11:09:13.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.257+0000 7fed9be00640 1 -- 172.21.15.162:0/482416110 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7fed8c057e40 con 0x7feda4158790 2024-01-20T11:09:13.257 INFO:teuthology.orchestra.run.smithi162.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T11:09:13.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fed7c06aed0 msgr2=0x7fed7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fed7c06aed0 0x7fed7c06d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed94034000 tx=0x7fed94037040 comp rx=0 tx=0).stop 2024-01-20T11:09:13.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4158790 msgr2=0x7feda415b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4158790 0x7feda415b100 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00dae0 tx=0x7fed8c0020a0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 shutdown_connections 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fed7c06aed0 0x7fed7c06d390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feda4158c10 0x7feda415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda4158790 0x7feda415b100 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 --2- 172.21.15.162:0/482416110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed840039a0 0x7feda414dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 >> 172.21.15.162:0/482416110 conn(0x7feda409c7b0 msgr2=0x7feda40b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 shutdown_connections 2024-01-20T11:09:13.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.260+0000 7fedaaa00640 1 -- 172.21.15.162:0/482416110 wait complete. 2024-01-20T11:09:13.279 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-20T11:09:13.389 INFO:tasks.ceph.mds.c.smithi162.stdout:starting mds.c at 2024-01-20T11:09:13.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.471+0000 7f741a600640 1 Processor -- start 2024-01-20T11:09:13.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.471+0000 7f741a600640 1 -- start start 2024-01-20T11:09:13.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.472+0000 7f741a600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7414141bb0 0x7f74140ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.472+0000 7f741a600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f741406cdf0 0x7f74140717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.472+0000 7f741a600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74140cee70 con 0x7f74140ce6a0 2024-01-20T11:09:13.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.472+0000 7f741a600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74140cd7a0 con 0x7f741406cdf0 2024-01-20T11:09:13.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.472+0000 7f741a600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74140ceb90 con 0x7f7414141bb0 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f741406cdf0 0x7f74140717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f741406cdf0 0x7f74140717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51770/0 (socket says 172.21.15.162:51770) 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413e00640 1 -- 172.21.15.162:0/1229948049 learned_addr learned my addr 172.21.15.162:0/1229948049 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413e00640 1 -- 172.21.15.162:0/1229948049 >> v2:172.21.15.179:3300/0 conn(0x7f7414141bb0 msgr2=0x7f74140ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413400640 1 --2- 172.21.15.162:0/1229948049 >> v2:172.21.15.179:3300/0 conn(0x7f7414141bb0 0x7f74140ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413e00640 1 --2- 172.21.15.162:0/1229948049 >> v2:172.21.15.179:3300/0 conn(0x7f7414141bb0 0x7f74140ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413e00640 1 -- 172.21.15.162:0/1229948049 >> v1:172.21.15.179:6789/0 conn(0x7f74140ce6a0 legacy=0x7f741406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:13.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.473+0000 7f7413e00640 1 -- 172.21.15.162:0/1229948049 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74140cd150 con 0x7f741406cdf0 2024-01-20T11:09:13.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.474+0000 7f7413e00640 1 --2- 172.21.15.162:0/1229948049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f741406cdf0 0x7f74140717b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f74140ccea0 tx=0x7f740c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b2fb5d085efece server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:13.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.475+0000 7f7412000640 1 -- 172.21.15.162:0/1229948049 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c02c9f0 con 0x7f741406cdf0 2024-01-20T11:09:13.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.475+0000 7f7412000640 1 -- 172.21.15.162:0/1229948049 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c02cb50 con 0x7f741406cdf0 2024-01-20T11:09:13.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.475+0000 7f7412000640 1 -- 172.21.15.162:0/1229948049 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0343f0 con 0x7f741406cdf0 2024-01-20T11:09:13.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.475+0000 7f741a600640 1 -- 172.21.15.162:0/1229948049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f741406cdf0 msgr2=0x7f74140717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.475+0000 7f741a600640 1 --2- 172.21.15.162:0/1229948049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f741406cdf0 0x7f74140717b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f74140ccea0 tx=0x7f740c02be50 comp rx=0 tx=0).stop 2024-01-20T11:09:13.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.476+0000 7f741a600640 1 -- 172.21.15.162:0/1229948049 shutdown_connections 2024-01-20T11:09:13.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.476+0000 7f741a600640 1 --2- 172.21.15.162:0/1229948049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f741406cdf0 0x7f74140717b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.476+0000 7f741a600640 1 --2- 172.21.15.162:0/1229948049 >> v2:172.21.15.179:3300/0 conn(0x7f7414141bb0 0x7f74140ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.476+0000 7f741a600640 1 -- 172.21.15.162:0/1229948049 >> 172.21.15.162:0/1229948049 conn(0x7f741406a600 msgr2=0x7f741406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:13.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.476+0000 7f741a600640 1 -- 172.21.15.162:0/1229948049 shutdown_connections 2024-01-20T11:09:13.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.476+0000 7f741a600640 1 -- 172.21.15.162:0/1229948049 wait complete. 2024-01-20T11:09:13.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.478+0000 7f741a600640 1 Processor -- start 2024-01-20T11:09:13.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.478+0000 7f741a600640 1 -- start start 2024-01-20T11:09:13.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f741a600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741406cdf0 0x7f741415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f741a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74140ce6a0 0x7f74141313d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f741a600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7414141bb0 0x7f7414131910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f741a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414132df0 con 0x7f74140ce6a0 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f741a600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414132170 con 0x7f7414141bb0 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f741a600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7414132450 con 0x7f741406cdf0 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7412a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74140ce6a0 0x7f74141313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7412a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74140ce6a0 0x7f74141313d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51774/0 (socket says 172.21.15.162:51774) 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7412a00640 1 -- 172.21.15.162:0/2773999752 learned_addr learned my addr 172.21.15.162:0/2773999752 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7413400640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741406cdf0 0x7f741415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7412a00640 1 -- 172.21.15.162:0/2773999752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741406cdf0 msgr2=0x7f741415ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7412a00640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741406cdf0 0x7f741415ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7412a00640 1 -- 172.21.15.162:0/2773999752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7414141bb0 msgr2=0x7f7414131910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.479+0000 7f7412a00640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7414141bb0 0x7f7414131910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:13.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.480+0000 7f7412a00640 1 -- 172.21.15.162:0/2773999752 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c009b30 con 0x7f74140ce6a0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.480+0000 7f7412a00640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74140ce6a0 0x7f74141313d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c430 tx=0x7f73fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.480+0000 7f740b400640 1 -- 172.21.15.162:0/2773999752 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc011790 con 0x7f74140ce6a0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.480+0000 7f740b400640 1 -- 172.21.15.162:0/2773999752 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc0118f0 con 0x7f74140ce6a0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.480+0000 7f740b400640 1 -- 172.21.15.162:0/2773999752 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc011ca0 con 0x7f74140ce6a0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.480+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7414132730 con 0x7f74140ce6a0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.480+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7414131e50 con 0x7f74140ce6a0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.481+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7414132f30 con 0x7f74140ce6a0 2024-01-20T11:09:13.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.482+0000 7f740b400640 1 -- 172.21.15.162:0/2773999752 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f73fc01c460 con 0x7f74140ce6a0 2024-01-20T11:09:13.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.484+0000 7f740b400640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f73ec06aed0 0x7f73ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:13.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.484+0000 7f740b400640 1 -- 172.21.15.162:0/2773999752 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f73fc0896d0 con 0x7f74140ce6a0 2024-01-20T11:09:13.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.484+0000 7f7413400640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f73ec06aed0 0x7f73ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:13.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.485+0000 7f7413400640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f73ec06aed0 0x7f73ec06d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f740400b7c0 tx=0x7f7404008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:13.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.488+0000 7f740b400640 1 -- 172.21.15.162:0/2773999752 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7414132f30 con 0x7f74140ce6a0 2024-01-20T11:09:13.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:13.716+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7414132f30 con 0x7f74140ce6a0 2024-01-20T11:09:14.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.261+0000 7f740b400640 1 -- 172.21.15.162:0/2773999752 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7414132f30 con 0x7f74140ce6a0 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f73ec06aed0 msgr2=0x7f73ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f73ec06aed0 0x7f73ec06d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f740400b7c0 tx=0x7f7404008040 comp rx=0 tx=0).stop 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74140ce6a0 msgr2=0x7f74141313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74140ce6a0 0x7f74141313d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c430 tx=0x7f73fc00c8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 shutdown_connections 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f73ec06aed0 0x7f73ec06d390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7414141bb0 0x7f7414131910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74140ce6a0 0x7f74141313d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 --2- 172.21.15.162:0/2773999752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741406cdf0 0x7f741415ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.264+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 >> 172.21.15.162:0/2773999752 conn(0x7f741406a600 msgr2=0x7f741406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:14.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.265+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 shutdown_connections 2024-01-20T11:09:14.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.265+0000 7f741a600640 1 -- 172.21.15.162:0/2773999752 wait complete. 2024-01-20T11:09:14.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-20T11:09:14.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.488+0000 7f8635e00640 1 Processor -- start 2024-01-20T11:09:14.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.489+0000 7f8635e00640 1 -- start start 2024-01-20T11:09:14.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.490+0000 7f8635e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8630157fa0 0x7f86300cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:14.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.490+0000 7f8635e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300cd4f0 0x7f863015bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:14.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.490+0000 7f8635e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863006d530 con 0x7f86300ceef0 2024-01-20T11:09:14.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.490+0000 7f8635e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863006c920 con 0x7f8630157fa0 2024-01-20T11:09:14.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.490+0000 7f8635e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863006cc00 con 0x7f86300cd4f0 2024-01-20T11:09:14.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8630157fa0 0x7f86300cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:14.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8630157fa0 0x7f86300cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51788/0 (socket says 172.21.15.162:51788) 2024-01-20T11:09:14.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862ea00640 1 -- 172.21.15.162:0/3084829566 learned_addr learned my addr 172.21.15.162:0/3084829566 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:14.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862ea00640 1 -- 172.21.15.162:0/3084829566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300cd4f0 msgr2=0x7f863015bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:14.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862f400640 1 --2- 172.21.15.162:0/3084829566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300cd4f0 0x7f863015bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:14.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862ea00640 1 --2- 172.21.15.162:0/3084829566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300cd4f0 0x7f863015bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862ea00640 1 -- 172.21.15.162:0/3084829566 >> v1:172.21.15.179:6789/0 conn(0x7f86300ceef0 legacy=0x7f86300ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:14.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.491+0000 7f862ea00640 1 -- 172.21.15.162:0/3084829566 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863006cee0 con 0x7f8630157fa0 2024-01-20T11:09:14.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.492+0000 7f862ea00640 1 --2- 172.21.15.162:0/3084829566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300cf470 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8620009870 tx=0x7f862002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148697dd4e9e953c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.492+0000 7f862e000640 1 -- 172.21.15.162:0/3084829566 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620031640 con 0x7f8630157fa0 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.492+0000 7f862e000640 1 -- 172.21.15.162:0/3084829566 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86200317a0 con 0x7f8630157fa0 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f862e000640 1 -- 172.21.15.162:0/3084829566 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620031b30 con 0x7f8630157fa0 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 -- 172.21.15.162:0/3084829566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 msgr2=0x7f86300cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 --2- 172.21.15.162:0/3084829566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300cf470 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8620009870 tx=0x7f862002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 -- 172.21.15.162:0/3084829566 shutdown_connections 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 --2- 172.21.15.162:0/3084829566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300cd4f0 0x7f863015bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 --2- 172.21.15.162:0/3084829566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300cf470 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 -- 172.21.15.162:0/3084829566 >> 172.21.15.162:0/3084829566 conn(0x7f863006a600 msgr2=0x7f863006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:14.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 -- 172.21.15.162:0/3084829566 shutdown_connections 2024-01-20T11:09:14.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.493+0000 7f8635e00640 1 -- 172.21.15.162:0/3084829566 wait complete. 2024-01-20T11:09:14.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.495+0000 7f8635e00640 1 Processor -- start 2024-01-20T11:09:14.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.495+0000 7f8635e00640 1 -- start start 2024-01-20T11:09:14.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.496+0000 7f8635e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86300cd4f0 0x7f86301f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.496+0000 7f8635e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.496+0000 7f8635e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300c8aa0 0x7f86300b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.496+0000 7f8635e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c8f50 con 0x7f8630157fa0 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.496+0000 7f8635e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8630071950 con 0x7f86300cd4f0 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.496+0000 7f8635e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8630071c30 con 0x7f86300c8aa0 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.496+0000 7f8625e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51794/0 (socket says 172.21.15.162:51794) 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 -- 172.21.15.162:0/4010164905 learned_addr learned my addr 172.21.15.162:0/4010164905 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 -- 172.21.15.162:0/4010164905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300c8aa0 msgr2=0x7f86300b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:14.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300c8aa0 0x7f86300b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 -- 172.21.15.162:0/4010164905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86300cd4f0 msgr2=0x7f86301f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86300cd4f0 0x7f86301f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 -- 172.21.15.162:0/4010164905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200094d0 con 0x7f8630157fa0 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8625e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300c8560 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f861800c430 tx=0x7f861800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8627e00640 1 -- 172.21.15.162:0/4010164905 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618011790 con 0x7f8630157fa0 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.497+0000 7f8627e00640 1 -- 172.21.15.162:0/4010164905 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86180118f0 con 0x7f8630157fa0 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.498+0000 7f8627e00640 1 -- 172.21.15.162:0/4010164905 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618011ce0 con 0x7f8630157fa0 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.498+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8630071f10 con 0x7f8630157fa0 2024-01-20T11:09:14.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.498+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86300724d0 con 0x7f8630157fa0 2024-01-20T11:09:14.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.499+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863015ead0 con 0x7f8630157fa0 2024-01-20T11:09:14.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.500+0000 7f8627e00640 1 -- 172.21.15.162:0/4010164905 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f861801c460 con 0x7f8630157fa0 2024-01-20T11:09:14.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.500+0000 7f8627e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f860806aed0 0x7f860806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:14.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.501+0000 7f8627e00640 1 -- 172.21.15.162:0/4010164905 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8618089710 con 0x7f8630157fa0 2024-01-20T11:09:14.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.501+0000 7f862ea00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f860806aed0 0x7f860806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:14.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.501+0000 7f862ea00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f860806aed0 0x7f860806d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8620036000 tx=0x7f8620030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:14.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.505+0000 7f8627e00640 1 -- 172.21.15.162:0/4010164905 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f86180544e0 con 0x7f8630157fa0 2024-01-20T11:09:14.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:14.698+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8630155e50 con 0x7f8630157fa0 2024-01-20T11:09:15.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.272+0000 7f8627e00640 1 -- 172.21.15.162:0/4010164905 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8618057b00 con 0x7f8630157fa0 2024-01-20T11:09:15.273 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' removed 2024-01-20T11:09:15.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.276+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f860806aed0 msgr2=0x7f860806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:15.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.276+0000 7f8635e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f860806aed0 0x7f860806d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8620036000 tx=0x7f8620030000 comp rx=0 tx=0).stop 2024-01-20T11:09:15.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.276+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 msgr2=0x7f86300c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:15.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.276+0000 7f8635e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300c8560 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f861800c430 tx=0x7f861800c8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 shutdown_connections 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86300c8aa0 0x7f86300b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8630157fa0 0x7f86300c8560 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f860806aed0 0x7f860806d390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 --2- 172.21.15.162:0/4010164905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86300cd4f0 0x7f86301f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 >> 172.21.15.162:0/4010164905 conn(0x7f863006a600 msgr2=0x7f863015c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 shutdown_connections 2024-01-20T11:09:15.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.277+0000 7f8635e00640 1 -- 172.21.15.162:0/4010164905 wait complete. 2024-01-20T11:09:15.308 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-20T11:09:15.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.507+0000 7f4000200640 1 Processor -- start 2024-01-20T11:09:15.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.508+0000 7f4000200640 1 -- start start 2024-01-20T11:09:15.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.509+0000 7f4000200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ff8157fa0 0x7f3ff80cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:15.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.509+0000 7f4000200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff806d530 con 0x7f3ff80ceef0 2024-01-20T11:09:15.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.509+0000 7f4000200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff806c920 con 0x7f3ff80cd4f0 2024-01-20T11:09:15.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.509+0000 7f4000200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff806cc00 con 0x7f3ff8157fa0 2024-01-20T11:09:15.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.509+0000 7f3ffd800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ff8157fa0 0x7f3ff80cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:15.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.509+0000 7f3ffce00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3ff80ceef0 0x7f3ff80ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52700/0 (socket says 172.21.15.162:52700) 2024-01-20T11:09:15.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.509+0000 7f3ffce00640 1 -- 172.21.15.162:0/620868521 learned_addr learned my addr 172.21.15.162:0/620868521 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:15.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.510+0000 7f3ff7e00640 1 -- 172.21.15.162:0/620868521 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944512104 0 0) 0x7f3ff806d530 con 0x7f3ff80ceef0 2024-01-20T11:09:15.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.510+0000 7f3ff7e00640 1 -- 172.21.15.162:0/620868521 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd8003520 con 0x7f3ff80ceef0 2024-01-20T11:09:15.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.510+0000 7f3ffd800640 1 -- 172.21.15.162:0/620868521 >> v1:172.21.15.179:6789/0 conn(0x7f3ff80cd4f0 legacy=0x7f3ff815bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:15.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.510+0000 7f3ffd800640 1 -- 172.21.15.162:0/620868521 >> v1:172.21.15.162:6789/0 conn(0x7f3ff80ceef0 legacy=0x7f3ff80ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:15.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.510+0000 7f3ffd800640 1 -- 172.21.15.162:0/620868521 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff806cee0 con 0x7f3ff8157fa0 2024-01-20T11:09:15.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.511+0000 7f3ffd800640 1 --2- 172.21.15.162:0/620868521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80cf470 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10465330b0e9c70 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:15.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.511+0000 7f3ff7e00640 1 -- 172.21.15.162:0/620868521 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8031830 con 0x7f3ff8157fa0 2024-01-20T11:09:15.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.511+0000 7f3ff7e00640 1 -- 172.21.15.162:0/620868521 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8031990 con 0x7f3ff8157fa0 2024-01-20T11:09:15.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.511+0000 7f3ff7e00640 1 -- 172.21.15.162:0/620868521 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8031d20 con 0x7f3ff8157fa0 2024-01-20T11:09:15.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.512+0000 7f4000200640 1 -- 172.21.15.162:0/620868521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 msgr2=0x7f3ff80cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:15.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.512+0000 7f4000200640 1 --2- 172.21.15.162:0/620868521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80cf470 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802b8d0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.512+0000 7f4000200640 1 -- 172.21.15.162:0/620868521 shutdown_connections 2024-01-20T11:09:15.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.512+0000 7f4000200640 1 --2- 172.21.15.162:0/620868521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80cf470 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.512+0000 7f4000200640 1 -- 172.21.15.162:0/620868521 >> 172.21.15.162:0/620868521 conn(0x7f3ff806a600 msgr2=0x7f3ff806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:15.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.512+0000 7f4000200640 1 -- 172.21.15.162:0/620868521 shutdown_connections 2024-01-20T11:09:15.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.512+0000 7f4000200640 1 -- 172.21.15.162:0/620868521 wait complete. 2024-01-20T11:09:15.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.514+0000 7f4000200640 1 Processor -- start 2024-01-20T11:09:15.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.514+0000 7f4000200640 1 -- start start 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f4000200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ff80cd4f0 0x7f3ff8097f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f4000200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f4000200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ff80b1fb0 0x7f3ff80ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f4000200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff815d150 con 0x7f3ff8157fa0 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f4000200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80ca270 con 0x7f3ff80cd4f0 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f4000200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c8700 con 0x7f3ff80b1fb0 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f3ffce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f3ffce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51808/0 (socket says 172.21.15.162:51808) 2024-01-20T11:09:15.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.515+0000 7f3ffce00640 1 -- 172.21.15.162:0/1109989031 learned_addr learned my addr 172.21.15.162:0/1109989031 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:15.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffd800640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ff80cd4f0 0x7f3ff8097f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:15.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffe200640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ff80b1fb0 0x7f3ff80ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffce00640 1 -- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ff80b1fb0 msgr2=0x7f3ff80ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffce00640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ff80b1fb0 0x7f3ff80ad210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffce00640 1 -- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ff80cd4f0 msgr2=0x7f3ff8097f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffce00640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ff80cd4f0 0x7f3ff8097f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffce00640 1 -- 172.21.15.162:0/1109989031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009400 con 0x7f3ff8157fa0 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffd800640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ff80cd4f0 0x7f3ff8097f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ffce00640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80b3990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c430 tx=0x7f3fe000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ff5600640 1 -- 172.21.15.162:0/1109989031 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0005ce0 con 0x7f3ff8157fa0 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ff5600640 1 -- 172.21.15.162:0/1109989031 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe0005e40 con 0x7f3ff8157fa0 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f3ff5600640 1 -- 172.21.15.162:0/1109989031 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00072f0 con 0x7f3ff8157fa0 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.516+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff80c89e0 con 0x7f3ff8157fa0 2024-01-20T11:09:15.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.517+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff80c8fa0 con 0x7f3ff8157fa0 2024-01-20T11:09:15.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.517+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff804e970 con 0x7f3ff8157fa0 2024-01-20T11:09:15.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.519+0000 7f3ff5600640 1 -- 172.21.15.162:0/1109989031 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3fe0007450 con 0x7f3ff8157fa0 2024-01-20T11:09:15.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.520+0000 7f3ff5600640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3fd006aed0 0x7f3fd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:15.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.520+0000 7f3ff5600640 1 -- 172.21.15.162:0/1109989031 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3fe0088b80 con 0x7f3ff8157fa0 2024-01-20T11:09:15.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.520+0000 7f3ffd800640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3fd006aed0 0x7f3fd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:15.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.521+0000 7f3ffd800640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3fd006aed0 0x7f3fd006d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8036000 tx=0x7f3fe803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:15.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.524+0000 7f3ff5600640 1 -- 172.21.15.162:0/1109989031 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3fe0057630 con 0x7f3ff8157fa0 2024-01-20T11:09:15.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:15.736+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ff80c95d0 con 0x7f3ff8157fa0 2024-01-20T11:09:16.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.275+0000 7f3ff5600640 1 -- 172.21.15.162:0/1109989031 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3fe0088e60 con 0x7f3ff8157fa0 2024-01-20T11:09:16.276 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' removed 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3fd006aed0 msgr2=0x7f3fd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3fd006aed0 0x7f3fd006d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8036000 tx=0x7f3fe803c040 comp rx=0 tx=0).stop 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 msgr2=0x7f3ff80b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80b3990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c430 tx=0x7f3fe000c8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 shutdown_connections 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ff80b1fb0 0x7f3ff80ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff8157fa0 0x7f3ff80b3990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3fd006aed0 0x7f3fd006d390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 --2- 172.21.15.162:0/1109989031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ff80cd4f0 0x7f3ff8097f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.279+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 >> 172.21.15.162:0/1109989031 conn(0x7f3ff806a600 msgr2=0x7f3ff8159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:16.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.280+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 shutdown_connections 2024-01-20T11:09:16.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.280+0000 7f4000200640 1 -- 172.21.15.162:0/1109989031 wait complete. 2024-01-20T11:09:16.304 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-20T11:09:16.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.501+0000 7f7395000640 1 Processor -- start 2024-01-20T11:09:16.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.502+0000 7f7395000640 1 -- start start 2024-01-20T11:09:16.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.503+0000 7f7395000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 0x7f7390166560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.503+0000 7f7395000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73900cee70 con 0x7f73900cdc30 2024-01-20T11:09:16.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.503+0000 7f7395000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73900cd7a0 con 0x7f7390141bb0 2024-01-20T11:09:16.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.503+0000 7f7395000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73900ceb90 con 0x7f739006cdf0 2024-01-20T11:09:16.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f7387e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f73900cdc30 0x7f739006c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51108/0 (socket says 172.21.15.162:51108) 2024-01-20T11:09:16.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f7387e00640 1 -- 172.21.15.162:0/4122318551 learned_addr learned my addr 172.21.15.162:0/4122318551 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683274771 0 0) 0x7f7378001110 con 0x7f73900cdc30 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7370003520 con 0x7f73900cdc30 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738e800640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 0x7f7390166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365267628 0 0) 0x7f7370003520 con 0x7f73900cdc30 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 msgr2=0x7f7390166560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 0x7f7390166560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 >> v1:172.21.15.179:6789/0 conn(0x7f7390141bb0 legacy=0x7f73900ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900cd150 con 0x7f73900cdc30 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f7378001800 con 0x7f73900cdc30 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.504+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 >> v1:172.21.15.162:6789/0 conn(0x7f73900cdc30 legacy=0x7f739006c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738d400640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700039a0 0x7f7370003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738d400640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 0x7f73700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738d400640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7370004d00 0x7f7370005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900ceb90 con 0x7f73700039a0 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737000bb70 con 0x7f7370004d00 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737000bd30 con 0x7f739006cdf0 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738de00640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700039a0 0x7f7370003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738de00640 1 -- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 msgr2=0x7f73700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f7387e00640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 0x7f73700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738e800640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7370004d00 0x7f7370005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738de00640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 0x7f73700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738de00640 1 -- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7370004d00 msgr2=0x7f7370005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738de00640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7370004d00 0x7f7370005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f738de00640 1 -- 172.21.15.162:0/4122318551 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7370003520 con 0x7f73700039a0 2024-01-20T11:09:16.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.505+0000 7f7387e00640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f739006cdf0 0x7f73700047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:16.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.506+0000 7f738de00640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700039a0 0x7f7370003da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7380003d80 tx=0x7f73700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62d3018c8af7a49 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:16.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380032600 con 0x7f73700039a0 2024-01-20T11:09:16.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738002e050 con 0x7f73700039a0 2024-01-20T11:09:16.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f738d400640 1 -- 172.21.15.162:0/4122318551 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800329a0 con 0x7f73700039a0 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f7395000640 1 -- 172.21.15.162:0/4122318551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700039a0 msgr2=0x7f7370003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f7395000640 1 --2- 172.21.15.162:0/4122318551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700039a0 0x7f7370003da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7380003d80 tx=0x7f73700057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f738e800640 1 -- 172.21.15.162:0/4122318551 reap_dead start 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f7395000640 1 -- 172.21.15.162:0/4122318551 shutdown_connections 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f7395000640 1 -- 172.21.15.162:0/4122318551 >> 172.21.15.162:0/4122318551 conn(0x7f739006a600 msgr2=0x7f739006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f7395000640 1 -- 172.21.15.162:0/4122318551 shutdown_connections 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.507+0000 7f7395000640 1 -- 172.21.15.162:0/4122318551 wait complete. 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.509+0000 7f7395000640 1 Processor -- start 2024-01-20T11:09:16.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.509+0000 7f7395000640 1 -- start start 2024-01-20T11:09:16.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f7395000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73700039a0 0x7f73900b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f7395000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7390142b20 0x7f73901f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f7395000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73901f2e00 0x7f73901f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f7395000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390142fb0 con 0x7f73901f2e00 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f7395000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390143290 con 0x7f7390142b20 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f7395000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7390143570 con 0x7f73700039a0 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f738e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73901f2e00 0x7f73901f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.510+0000 7f738e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73901f2e00 0x7f73901f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43416/0 (socket says 172.21.15.162:43416) 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738e800640 1 -- 172.21.15.162:0/3330542494 learned_addr learned my addr 172.21.15.162:0/3330542494 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738de00640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73700039a0 0x7f73900b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f7387e00640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7390142b20 0x7f73901f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738e800640 1 -- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73700039a0 msgr2=0x7f73900b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738e800640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73700039a0 0x7f73900b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738e800640 1 -- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7390142b20 msgr2=0x7f73901f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738e800640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7390142b20 0x7f73901f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738e800640 1 -- 172.21.15.162:0/3330542494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390143850 con 0x7f73901f2e00 2024-01-20T11:09:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f738e800640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73901f2e00 0x7f73901f3270 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f739006b520 tx=0x7f7388009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f7386000640 1 -- 172.21.15.162:0/3330542494 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388007cf0 con 0x7f73901f2e00 2024-01-20T11:09:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.511+0000 7f7386000640 1 -- 172.21.15.162:0/3330542494 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7388007e70 con 0x7f73901f2e00 2024-01-20T11:09:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.512+0000 7f7386000640 1 -- 172.21.15.162:0/3330542494 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388014620 con 0x7f73901f2e00 2024-01-20T11:09:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.512+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73900b19a0 con 0x7f73901f2e00 2024-01-20T11:09:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.512+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73901f3990 con 0x7f73901f2e00 2024-01-20T11:09:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.513+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73900b1b90 con 0x7f73901f2e00 2024-01-20T11:09:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.514+0000 7f7386000640 1 -- 172.21.15.162:0/3330542494 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f738801d3b0 con 0x7f73901f2e00 2024-01-20T11:09:16.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.515+0000 7f7386000640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f736806aed0 0x7f736806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.515+0000 7f7386000640 1 -- 172.21.15.162:0/3330542494 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7388088f70 con 0x7f73901f2e00 2024-01-20T11:09:16.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.515+0000 7f738de00640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f736806aed0 0x7f736806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.516+0000 7f738de00640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f736806aed0 0x7f736806d390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7380034000 tx=0x7f7380009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:16.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.519+0000 7f7386000640 1 -- 172.21.15.162:0/3330542494 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7388054130 con 0x7f73901f2e00 2024-01-20T11:09:16.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.712+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f73901439e0 con 0x7f73901f2e00 2024-01-20T11:09:16.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.717+0000 7f7386000640 1 -- 172.21.15.162:0/3330542494 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f73901439e0 con 0x7f73901f2e00 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.719+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f736806aed0 msgr2=0x7f736806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f736806aed0 0x7f736806d390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7380034000 tx=0x7f7380009030 comp rx=0 tx=0).stop 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73901f2e00 msgr2=0x7f73901f3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73901f2e00 0x7f73901f3270 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f739006b520 tx=0x7f7388009d50 comp rx=0 tx=0).stop 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 shutdown_connections 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73901f2e00 0x7f73901f3270 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f736806aed0 0x7f736806d390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7390142b20 0x7f73901f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 --2- 172.21.15.162:0/3330542494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73700039a0 0x7f73900b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 >> 172.21.15.162:0/3330542494 conn(0x7f739006a600 msgr2=0x7f739015de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:16.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 shutdown_connections 2024-01-20T11:09:16.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.720+0000 7f7395000640 1 -- 172.21.15.162:0/3330542494 wait complete. 2024-01-20T11:09:16.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2024-01-20T11:09:16.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.946+0000 7fb6d5200640 1 Processor -- start 2024-01-20T11:09:16.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.946+0000 7fb6d5200640 1 -- start start 2024-01-20T11:09:16.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.947+0000 7fb6d5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb6d015a320 0x7fb6d015b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.947+0000 7fb6d5200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6d015e930 0x7fb6d00b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.947+0000 7fb6d5200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d00b43f0 con 0x7fb6d00b3fb0 2024-01-20T11:09:16.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6d5200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d0071260 con 0x7fb6d015a320 2024-01-20T11:09:16.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6d5200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d00709f0 con 0x7fb6d015e930 2024-01-20T11:09:16.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6cde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb6d015a320 0x7fb6d015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6ce800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb6d00b3fb0 0x7fb6d00cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51124/0 (socket says 172.21.15.162:51124) 2024-01-20T11:09:16.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6ce800640 1 -- 172.21.15.162:0/4011612998 learned_addr learned my addr 172.21.15.162:0/4011612998 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:16.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6c7e00640 1 --2- 172.21.15.162:0/4011612998 >> v2:172.21.15.179:3300/0 conn(0x7fb6d015e930 0x7fb6d00b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6cde00640 1 -- 172.21.15.162:0/4011612998 >> v2:172.21.15.179:3300/0 conn(0x7fb6d015e930 msgr2=0x7fb6d00b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:16.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6cde00640 1 --2- 172.21.15.162:0/4011612998 >> v2:172.21.15.179:3300/0 conn(0x7fb6d015e930 0x7fb6d00b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6cde00640 1 -- 172.21.15.162:0/4011612998 >> v1:172.21.15.162:6789/0 conn(0x7fb6d00b3fb0 legacy=0x7fb6d00cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6cd400640 1 -- 172.21.15.162:0/4011612998 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712933355 0 0) 0x7fb6d00b43f0 con 0x7fb6d00b3fb0 2024-01-20T11:09:16.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.948+0000 7fb6cde00640 1 -- 172.21.15.162:0/4011612998 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0070cd0 con 0x7fb6d015a320 2024-01-20T11:09:16.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.950+0000 7fb6cde00640 1 --2- 172.21.15.162:0/4011612998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d015b520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00aebf0 tx=0x7fb6c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e451d79de1388a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:16.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.950+0000 7fb6cd400640 1 -- 172.21.15.162:0/4011612998 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0031830 con 0x7fb6d015a320 2024-01-20T11:09:16.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.950+0000 7fb6cd400640 1 -- 172.21.15.162:0/4011612998 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c0031990 con 0x7fb6d015a320 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.950+0000 7fb6cd400640 1 -- 172.21.15.162:0/4011612998 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0031d20 con 0x7fb6d015a320 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.950+0000 7fb6d5200640 1 -- 172.21.15.162:0/4011612998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 msgr2=0x7fb6d015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.950+0000 7fb6d5200640 1 --2- 172.21.15.162:0/4011612998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d015b520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00aebf0 tx=0x7fb6c002b8d0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.951+0000 7fb6d5200640 1 -- 172.21.15.162:0/4011612998 shutdown_connections 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.951+0000 7fb6d5200640 1 --2- 172.21.15.162:0/4011612998 >> v2:172.21.15.179:3300/0 conn(0x7fb6d015e930 0x7fb6d00b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.951+0000 7fb6d5200640 1 --2- 172.21.15.162:0/4011612998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d015b520 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.951+0000 7fb6d5200640 1 -- 172.21.15.162:0/4011612998 >> 172.21.15.162:0/4011612998 conn(0x7fb6d006a600 msgr2=0x7fb6d006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.951+0000 7fb6d5200640 1 -- 172.21.15.162:0/4011612998 shutdown_connections 2024-01-20T11:09:16.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.951+0000 7fb6d5200640 1 -- 172.21.15.162:0/4011612998 wait complete. 2024-01-20T11:09:16.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.953+0000 7fb6d5200640 1 Processor -- start 2024-01-20T11:09:16.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.953+0000 7fb6d5200640 1 -- start start 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6d5200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d00b3fb0 0x7fb6d01469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6d5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d0146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6d5200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d015e930 0x7fb6d0141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6d5200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0147460 con 0x7fb6d015a320 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6d5200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0142c90 con 0x7fb6d015e930 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6d5200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0142110 con 0x7fb6d00b3fb0 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d0146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d0146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43426/0 (socket says 172.21.15.162:43426) 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6c7e00640 1 -- 172.21.15.162:0/1259146832 learned_addr learned my addr 172.21.15.162:0/1259146832 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6cde00640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d00b3fb0 0x7fb6d01469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6c7e00640 1 -- 172.21.15.162:0/1259146832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d00b3fb0 msgr2=0x7fb6d01469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.954+0000 7fb6c7e00640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d00b3fb0 0x7fb6d01469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6c7e00640 1 -- 172.21.15.162:0/1259146832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d015e930 msgr2=0x7fb6d0141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6c7e00640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d015e930 0x7fb6d0141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6c7e00640 1 -- 172.21.15.162:0/1259146832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0009400 con 0x7fb6d015a320 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6c7e00640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d0146f20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800d5f0 tx=0x7fb6b800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6c6000640 1 -- 172.21.15.162:0/1259146832 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80125f0 con 0x7fb6d015a320 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6c6000640 1 -- 172.21.15.162:0/1259146832 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b8012750 con 0x7fb6d015a320 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6c6000640 1 -- 172.21.15.162:0/1259146832 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8012b00 con 0x7fb6d015a320 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d01423f0 con 0x7fb6d015a320 2024-01-20T11:09:16.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.955+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d01429b0 con 0x7fb6d015a320 2024-01-20T11:09:16.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.956+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d004e970 con 0x7fb6d015a320 2024-01-20T11:09:16.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.957+0000 7fb6c6000640 1 -- 172.21.15.162:0/1259146832 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb6b8012c60 con 0x7fb6d015a320 2024-01-20T11:09:16.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.958+0000 7fb6c6000640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb6a806af00 0x7fb6a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:16.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.958+0000 7fb6c6000640 1 -- 172.21.15.162:0/1259146832 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb6b8089780 con 0x7fb6d015a320 2024-01-20T11:09:16.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.959+0000 7fb6cde00640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb6a806af00 0x7fb6a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:16.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.959+0000 7fb6cde00640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb6a806af00 0x7fb6a806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0036000 tx=0x7fb6c0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:16.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:16.963+0000 7fb6c6000640 1 -- 172.21.15.162:0/1259146832 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb6b8054940 con 0x7fb6d015a320 2024-01-20T11:09:17.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.233+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) v1 -- 0x7fb6d014fd40 con 0x7fb6d015a320 2024-01-20T11:09:17.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.295+0000 7fb6c6000640 1 -- 172.21.15.162:0/1259146832 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v110) v1 ==== 132+0+0 (secure 0 0 0) 0x7fb6b8057f60 con 0x7fb6d015a320 2024-01-20T11:09:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb6a806af00 msgr2=0x7fb6a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb6a806af00 0x7fb6a806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0036000 tx=0x7fb6c0008030 comp rx=0 tx=0).stop 2024-01-20T11:09:17.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 msgr2=0x7fb6d0146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d0146f20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800d5f0 tx=0x7fb6b800dab0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 shutdown_connections 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb6a806af00 0x7fb6a806d3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d015e930 0x7fb6d0141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6d015a320 0x7fb6d0146f20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 --2- 172.21.15.162:0/1259146832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d00b3fb0 0x7fb6d01469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 >> 172.21.15.162:0/1259146832 conn(0x7fb6d006a600 msgr2=0x7fb6d0150260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 shutdown_connections 2024-01-20T11:09:17.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.298+0000 7fb6d5200640 1 -- 172.21.15.162:0/1259146832 wait complete. 2024-01-20T11:09:17.318 INFO:tasks.cephfs_test_runner:That when deleting a bunch of dentries and the containing ... ok 2024-01-20T11:09:17.319 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). 2024-01-20T11:09:17.319 INFO:tasks.cephfs_test_runner:test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2024-01-20T11:09:17.319 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:17.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.524+0000 7f7cb7200640 1 Processor -- start 2024-01-20T11:09:17.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.524+0000 7f7cb7200640 1 -- start start 2024-01-20T11:09:17.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.525+0000 7f7cb7200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cb0157b70 0x7f7cb015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.525+0000 7f7cb7200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00cf370 0x7f7cb00cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.525+0000 7f7cb7200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb00b2150 con 0x7f7cb006c690 2024-01-20T11:09:17.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.525+0000 7f7cb7200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb00cfd60 con 0x7f7cb0157b70 2024-01-20T11:09:17.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.525+0000 7f7cb7200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0157f50 con 0x7f7cb00cf370 2024-01-20T11:09:17.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.526+0000 7f7cb5400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00cf370 0x7f7cb00cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.526+0000 7f7cb5400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00cf370 0x7f7cb00cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:38376/0 (socket says 172.21.15.162:38376) 2024-01-20T11:09:17.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.526+0000 7f7cb6800640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7cb006c690 0x7f7cb006cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:54618/0 (socket says 172.21.15.162:54618) 2024-01-20T11:09:17.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.526+0000 7f7cb5400640 1 -- 172.21.15.162:0/1573233433 learned_addr learned my addr 172.21.15.162:0/1573233433 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:17.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.526+0000 7f7cb5e00640 1 --2- 172.21.15.162:0/1573233433 >> v2:172.21.15.179:3300/0 conn(0x7f7cb0157b70 0x7f7cb015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.527+0000 7f7cb5400640 1 -- 172.21.15.162:0/1573233433 >> v2:172.21.15.179:3300/0 conn(0x7f7cb0157b70 msgr2=0x7f7cb015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:17.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.527+0000 7f7cb5400640 1 --2- 172.21.15.162:0/1573233433 >> v2:172.21.15.179:3300/0 conn(0x7f7cb0157b70 0x7f7cb015e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.527+0000 7f7cb5400640 1 -- 172.21.15.162:0/1573233433 >> v1:172.21.15.179:6789/0 conn(0x7f7cb006c690 legacy=0x7f7cb006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.527+0000 7f7cb4a00640 1 -- 172.21.15.162:0/1573233433 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203687767 0 0) 0x7f7cb00b2150 con 0x7f7cb006c690 2024-01-20T11:09:17.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.527+0000 7f7cb5400640 1 -- 172.21.15.162:0/1573233433 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb015ea00 con 0x7f7cb00cf370 2024-01-20T11:09:17.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.528+0000 7f7cb5400640 1 --2- 172.21.15.162:0/1573233433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00cf370 0x7f7cb00cf820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd6b586def4dddf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:17.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.529+0000 7f7cb4a00640 1 -- 172.21.15.162:0/1573233433 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca002f830 con 0x7f7cb00cf370 2024-01-20T11:09:17.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.529+0000 7f7cb4a00640 1 -- 172.21.15.162:0/1573233433 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca002f990 con 0x7f7cb00cf370 2024-01-20T11:09:17.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.529+0000 7f7cb4a00640 1 -- 172.21.15.162:0/1573233433 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca002fd20 con 0x7f7cb00cf370 2024-01-20T11:09:17.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.529+0000 7f7cb7200640 1 -- 172.21.15.162:0/1573233433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00cf370 msgr2=0x7f7cb00cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.529+0000 7f7cb7200640 1 --2- 172.21.15.162:0/1573233433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00cf370 0x7f7cb00cf820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca002ba10 comp rx=0 tx=0).stop 2024-01-20T11:09:17.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.530+0000 7f7cb7200640 1 -- 172.21.15.162:0/1573233433 shutdown_connections 2024-01-20T11:09:17.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.530+0000 7f7cb7200640 1 --2- 172.21.15.162:0/1573233433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00cf370 0x7f7cb00cf820 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.530+0000 7f7cb7200640 1 --2- 172.21.15.162:0/1573233433 >> v2:172.21.15.179:3300/0 conn(0x7f7cb0157b70 0x7f7cb015e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.530+0000 7f7cb7200640 1 -- 172.21.15.162:0/1573233433 >> 172.21.15.162:0/1573233433 conn(0x7f7cb006aa20 msgr2=0x7f7cb006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:17.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.530+0000 7f7cb7200640 1 -- 172.21.15.162:0/1573233433 shutdown_connections 2024-01-20T11:09:17.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.530+0000 7f7cb7200640 1 -- 172.21.15.162:0/1573233433 wait complete. 2024-01-20T11:09:17.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.531+0000 7f7cb7200640 1 Processor -- start 2024-01-20T11:09:17.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.532+0000 7f7cb7200640 1 -- start start 2024-01-20T11:09:17.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.532+0000 7f7cb7200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb006c690 0x7f7cb00aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.532+0000 7f7cb7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb00cf370 0x7f7cb0146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.532+0000 7f7cb7200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb0157b70 0x7f7cb0149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.532+0000 7f7cb7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00af300 con 0x7f7cb00cf370 2024-01-20T11:09:17.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.532+0000 7f7cb7200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00af5e0 con 0x7f7cb0157b70 2024-01-20T11:09:17.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.532+0000 7f7cb7200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00af8c0 con 0x7f7cb006c690 2024-01-20T11:09:17.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb00cf370 0x7f7cb0146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb00cf370 0x7f7cb0146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43442/0 (socket says 172.21.15.162:43442) 2024-01-20T11:09:17.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 -- 172.21.15.162:0/4144964765 learned_addr learned my addr 172.21.15.162:0/4144964765 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:17.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb6800640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb0157b70 0x7f7cb0149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5e00640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb006c690 0x7f7cb00aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 -- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb006c690 msgr2=0x7f7cb00aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb006c690 0x7f7cb00aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 -- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb0157b70 msgr2=0x7f7cb0149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb0157b70 0x7f7cb0149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5400640 1 -- 172.21.15.162:0/4144964765 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00094d0 con 0x7f7cb00cf370 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb6800640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb0157b70 0x7f7cb0149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.533+0000 7f7cb5e00640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb006c690 0x7f7cb00aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.534+0000 7f7cb5400640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb00cf370 0x7f7cb0146c10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.534+0000 7f7cae000640 1 -- 172.21.15.162:0/4144964765 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca003b040 con 0x7f7cb00cf370 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.534+0000 7f7cae000640 1 -- 172.21.15.162:0/4144964765 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca0037be0 con 0x7f7cb00cf370 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.534+0000 7f7cae000640 1 -- 172.21.15.162:0/4144964765 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0042480 con 0x7f7cb00cf370 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.534+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb00afba0 con 0x7f7cb00cf370 2024-01-20T11:09:17.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.534+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb00aeff0 con 0x7f7cb00cf370 2024-01-20T11:09:17.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.535+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb0074a30 con 0x7f7cb00cf370 2024-01-20T11:09:17.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.536+0000 7f7cae000640 1 -- 172.21.15.162:0/4144964765 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7ca00425e0 con 0x7f7cb00cf370 2024-01-20T11:09:17.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.537+0000 7f7cae000640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7c8806aed0 0x7f7c8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.537+0000 7f7cae000640 1 -- 172.21.15.162:0/4144964765 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ca00ac500 con 0x7f7cb00cf370 2024-01-20T11:09:17.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.537+0000 7f7cb5e00640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7c8806aed0 0x7f7c8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.538+0000 7f7cb5e00640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7c8806aed0 0x7f7c8806d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009a20 tx=0x7f7c98008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:17.542 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.542+0000 7f7cae000640 1 -- 172.21.15.162:0/4144964765 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7ca00777e0 con 0x7f7cb00cf370 2024-01-20T11:09:17.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.749+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cb00b00c0 con 0x7f7cb00cf370 2024-01-20T11:09:17.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.751+0000 7f7cae000640 1 -- 172.21.15.162:0/4144964765 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13013 (secure 0 0 0) 0x7f7cb00b00c0 con 0x7f7cb00cf370 2024-01-20T11:09:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:17.752 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":39,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:16.272622+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6837/1733739377":"2024-01-21T11:09:13.254572+0000","172.21.15.162:6835/1733739377":"2024-01-21T11:09:13.254572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:17.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.753+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7c8806aed0 msgr2=0x7f7c8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7c8806aed0 0x7f7c8806d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009a20 tx=0x7f7c98008040 comp rx=0 tx=0).stop 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb00cf370 msgr2=0x7f7cb0146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb00cf370 0x7f7cb0146c10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca00046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 shutdown_connections 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7c8806aed0 0x7f7c8806d390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb0157b70 0x7f7cb0149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb00cf370 0x7f7cb0146c10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 --2- 172.21.15.162:0/4144964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb006c690 0x7f7cb00aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 >> 172.21.15.162:0/4144964765 conn(0x7f7cb006aa20 msgr2=0x7f7cb00b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:17.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 shutdown_connections 2024-01-20T11:09:17.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.754+0000 7f7cb7200640 1 -- 172.21.15.162:0/4144964765 wait complete. 2024-01-20T11:09:17.772 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:09:17.772 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:09:17.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.965+0000 7f3230800640 1 Processor -- start 2024-01-20T11:09:17.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.965+0000 7f3230800640 1 -- start start 2024-01-20T11:09:17.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f3230800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f32280b2040 0x7f322815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f3230800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f32280cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f3230800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32280b2ec0 con 0x7f322815a380 2024-01-20T11:09:17.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f3230800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3228070eb0 con 0x7f32280b2040 2024-01-20T11:09:17.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f3230800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322815ee30 con 0x7f32280cf060 2024-01-20T11:09:17.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f322e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f32280cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f322e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f32280cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:38394/0 (socket says 172.21.15.162:38394) 2024-01-20T11:09:17.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f322e800640 1 -- 172.21.15.162:0/2590585686 learned_addr learned my addr 172.21.15.162:0/2590585686 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:17.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.967+0000 7f322d400640 1 --2- 172.21.15.162:0/2590585686 >> v2:172.21.15.179:3300/0 conn(0x7f32280b2040 0x7f322815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.968+0000 7f322e800640 1 -- 172.21.15.162:0/2590585686 >> v2:172.21.15.179:3300/0 conn(0x7f32280b2040 msgr2=0x7f322815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:17.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.968+0000 7f322e800640 1 --2- 172.21.15.162:0/2590585686 >> v2:172.21.15.179:3300/0 conn(0x7f32280b2040 0x7f322815e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.968+0000 7f322e800640 1 -- 172.21.15.162:0/2590585686 >> v1:172.21.15.179:6789/0 conn(0x7f322815a380 legacy=0x7f32280707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.968+0000 7f322e800640 1 -- 172.21.15.162:0/2590585686 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32280ce700 con 0x7f32280cf060 2024-01-20T11:09:17.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.970+0000 7f322e800640 1 --2- 172.21.15.162:0/2590585686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f32280cf4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0533b068f472c07 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:17.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.970+0000 7f322ca00640 1 -- 172.21.15.162:0/2590585686 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220031640 con 0x7f32280cf060 2024-01-20T11:09:17.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.970+0000 7f322ca00640 1 -- 172.21.15.162:0/2590585686 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32200317a0 con 0x7f32280cf060 2024-01-20T11:09:17.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.970+0000 7f322ca00640 1 -- 172.21.15.162:0/2590585686 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220031b30 con 0x7f32280cf060 2024-01-20T11:09:17.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 -- 172.21.15.162:0/2590585686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 msgr2=0x7f32280cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 --2- 172.21.15.162:0/2590585686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f32280cf4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 -- 172.21.15.162:0/2590585686 shutdown_connections 2024-01-20T11:09:17.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 --2- 172.21.15.162:0/2590585686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f32280cf4d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 --2- 172.21.15.162:0/2590585686 >> v2:172.21.15.179:3300/0 conn(0x7f32280b2040 0x7f322815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 -- 172.21.15.162:0/2590585686 >> 172.21.15.162:0/2590585686 conn(0x7f322806a600 msgr2=0x7f322806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:17.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 -- 172.21.15.162:0/2590585686 shutdown_connections 2024-01-20T11:09:17.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.971+0000 7f3230800640 1 -- 172.21.15.162:0/2590585686 wait complete. 2024-01-20T11:09:17.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.973+0000 7f3230800640 1 Processor -- start 2024-01-20T11:09:17.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.973+0000 7f3230800640 1 -- start start 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f3230800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32280b2040 0x7f322815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f3230800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f322815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f3230800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f322815a380 0x7f32280ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f3230800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322815de30 con 0x7f32280b2040 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f3230800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322815aca0 con 0x7f322815a380 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f3230800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322815d2b0 con 0x7f32280cf060 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32280b2040 0x7f322815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32280b2040 0x7f322815cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43450/0 (socket says 172.21.15.162:43450) 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 -- 172.21.15.162:0/3505149948 learned_addr learned my addr 172.21.15.162:0/3505149948 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322d400640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f322815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 -- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 msgr2=0x7f322815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f322815a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 -- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f322815a380 msgr2=0x7f32280ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322e800640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f322815a380 0x7f32280ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f322815a380 0x7f32280ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.974+0000 7f322de00640 1 -- 172.21.15.162:0/3505149948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200094d0 con 0x7f32280b2040 2024-01-20T11:09:17.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.975+0000 7f322de00640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32280b2040 0x7f322815cc40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f321800c730 tx=0x7f321800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:17.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.975+0000 7f3226000640 1 -- 172.21.15.162:0/3505149948 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218006d50 con 0x7f32280b2040 2024-01-20T11:09:17.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.975+0000 7f3226000640 1 -- 172.21.15.162:0/3505149948 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321800ce40 con 0x7f32280b2040 2024-01-20T11:09:17.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.975+0000 7f3226000640 1 -- 172.21.15.162:0/3505149948 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218003bb0 con 0x7f32280b2040 2024-01-20T11:09:17.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.975+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322815d590 con 0x7f32280b2040 2024-01-20T11:09:17.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.975+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322815db50 con 0x7f32280b2040 2024-01-20T11:09:17.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.977+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322804e970 con 0x7f32280b2040 2024-01-20T11:09:17.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.977+0000 7f3226000640 1 -- 172.21.15.162:0/3505149948 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3218003d10 con 0x7f32280b2040 2024-01-20T11:09:17.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.979+0000 7f3226000640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f320006aed0 0x7f320006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:17.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.979+0000 7f3226000640 1 -- 172.21.15.162:0/3505149948 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3218088cd0 con 0x7f32280b2040 2024-01-20T11:09:17.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.979+0000 7f322d400640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f320006aed0 0x7f320006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:17.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.980+0000 7f322d400640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f320006aed0 0x7f320006d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f32280cf9e0 tx=0x7f3210008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:17.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:17.984+0000 7f3226000640 1 -- 172.21.15.162:0/3505149948 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f32180579c0 con 0x7f32280b2040 2024-01-20T11:09:18.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.178+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32280b2ec0 con 0x7f32280b2040 2024-01-20T11:09:18.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.179+0000 7f3226000640 1 -- 172.21.15.162:0/3505149948 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32280b2ec0 con 0x7f32280b2040 2024-01-20T11:09:18.179 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:09:18.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.181+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f320006aed0 msgr2=0x7f320006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.181+0000 7f3230800640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f320006aed0 0x7f320006d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f32280cf9e0 tx=0x7f3210008040 comp rx=0 tx=0).stop 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32280b2040 msgr2=0x7f322815cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32280b2040 0x7f322815cc40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f321800c730 tx=0x7f321800cbf0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 shutdown_connections 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f320006aed0 0x7f320006d390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f322815a380 0x7f32280ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32280cf060 0x7f322815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 --2- 172.21.15.162:0/3505149948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32280b2040 0x7f322815cc40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 >> 172.21.15.162:0/3505149948 conn(0x7f322806a600 msgr2=0x7f3228156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 shutdown_connections 2024-01-20T11:09:18.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.182+0000 7f3230800640 1 -- 172.21.15.162:0/3505149948 wait complete. 2024-01-20T11:09:18.201 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2024-01-20T11:09:18.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.407+0000 7f3f52000640 1 Processor -- start 2024-01-20T11:09:18.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.407+0000 7f3f52000640 1 -- start start 2024-01-20T11:09:18.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f52000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f4c155a30 0x7f3f4c0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:18.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f52000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f4c070630 0x7f3f4c0adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:18.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f52000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c070b60 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f52000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c15ba10 con 0x7f3f4c155a30 2024-01-20T11:09:18.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f52000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c15bc00 con 0x7f3f4c070630 2024-01-20T11:09:18.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f4b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f4c155a30 0x7f3f4c0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:18.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f4be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3f4c15c6e0 0x7f3f4c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51128/0 (socket says 172.21.15.162:51128) 2024-01-20T11:09:18.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f4be00640 1 -- 172.21.15.162:0/2765768872 learned_addr learned my addr 172.21.15.162:0/2765768872 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:18.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.409+0000 7f3f43e00640 1 --2- 172.21.15.162:0/2765768872 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c070630 0x7f3f4c0adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:18.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.410+0000 7f3f4b400640 1 -- 172.21.15.162:0/2765768872 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c070630 msgr2=0x7f3f4c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:18.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.410+0000 7f3f4b400640 1 --2- 172.21.15.162:0/2765768872 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c070630 0x7f3f4c0adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.410+0000 7f3f4b400640 1 -- 172.21.15.162:0/2765768872 >> v1:172.21.15.162:6789/0 conn(0x7f3f4c15c6e0 legacy=0x7f3f4c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:18.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.410+0000 7f3f4aa00640 1 -- 172.21.15.162:0/2765768872 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877698677 0 0) 0x7f3f4c070b60 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.410+0000 7f3f4b400640 1 -- 172.21.15.162:0/2765768872 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c15bee0 con 0x7f3f4c155a30 2024-01-20T11:09:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.411+0000 7f3f4b400640 1 --2- 172.21.15.162:0/2765768872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c155a30 0x7f3f4c0ce800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c06d870 tx=0x7f3f3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b12a73bbf22251 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.411+0000 7f3f4aa00640 1 -- 172.21.15.162:0/2765768872 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c031830 con 0x7f3f4c155a30 2024-01-20T11:09:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.411+0000 7f3f4aa00640 1 -- 172.21.15.162:0/2765768872 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c031990 con 0x7f3f4c155a30 2024-01-20T11:09:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.411+0000 7f3f4aa00640 1 -- 172.21.15.162:0/2765768872 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c031d20 con 0x7f3f4c155a30 2024-01-20T11:09:18.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 -- 172.21.15.162:0/2765768872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c155a30 msgr2=0x7f3f4c0ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 --2- 172.21.15.162:0/2765768872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c155a30 0x7f3f4c0ce800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c06d870 tx=0x7f3f3c02b8d0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 -- 172.21.15.162:0/2765768872 shutdown_connections 2024-01-20T11:09:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 --2- 172.21.15.162:0/2765768872 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c070630 0x7f3f4c0adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 --2- 172.21.15.162:0/2765768872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c155a30 0x7f3f4c0ce800 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 -- 172.21.15.162:0/2765768872 >> 172.21.15.162:0/2765768872 conn(0x7f3f4c0b0cd0 msgr2=0x7f3f4c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 -- 172.21.15.162:0/2765768872 shutdown_connections 2024-01-20T11:09:18.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.412+0000 7f3f52000640 1 -- 172.21.15.162:0/2765768872 wait complete. 2024-01-20T11:09:18.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.414+0000 7f3f52000640 1 Processor -- start 2024-01-20T11:09:18.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.414+0000 7f3f52000640 1 -- start start 2024-01-20T11:09:18.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f52000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c070630 0x7f3f4c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:18.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f52000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c155a30 0x7f3f4c0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:18.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f52000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c15c6e0 0x7f3f4c14f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:18.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f52000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0b42a0 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f52000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0b01f0 con 0x7f3f4c070630 2024-01-20T11:09:18.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f52000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c14f9c0 con 0x7f3f4c155a30 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f4be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c15c6e0 0x7f3f4c14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f4be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c15c6e0 0x7f3f4c14f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43464/0 (socket says 172.21.15.162:43464) 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f4be00640 1 -- 172.21.15.162:0/666737379 learned_addr learned my addr 172.21.15.162:0/666737379 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.415+0000 7f3f4b400640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c070630 0x7f3f4c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f4be00640 1 -- 172.21.15.162:0/666737379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c155a30 msgr2=0x7f3f4c0b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f4be00640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c155a30 0x7f3f4c0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f4be00640 1 -- 172.21.15.162:0/666737379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c070630 msgr2=0x7f3f4c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f4be00640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c070630 0x7f3f4c0b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f4be00640 1 -- 172.21.15.162:0/666737379 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c009400 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f4be00640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c15c6e0 0x7f3f4c14f480 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7b0 tx=0x7f3f4400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:18.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f43400640 1 -- 172.21.15.162:0/666737379 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400a5e0 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f43400640 1 -- 172.21.15.162:0/666737379 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400a760 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f43400640 1 -- 172.21.15.162:0/666737379 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400ab10 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c0b3620 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.416+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c0b3be0 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.417+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c0b43e0 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.418+0000 7f3f43400640 1 -- 172.21.15.162:0/666737379 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3f4400ac70 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.419+0000 7f3f43400640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f2406af00 0x7f3f2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:18.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.419+0000 7f3f43400640 1 -- 172.21.15.162:0/666737379 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3f44088690 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.419+0000 7f3f4b400640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f2406af00 0x7f3f2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:18.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.420+0000 7f3f4b400640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f2406af00 0x7f3f2406d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c036000 tx=0x7f3f3c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:18.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.423+0000 7f3f43400640 1 -- 172.21.15.162:0/666737379 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3f4c0b43e0 con 0x7f3f4c15c6e0 2024-01-20T11:09:18.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:18.671+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) v1 -- 0x7f3f4c0b43e0 con 0x7f3f4c15c6e0 2024-01-20T11:09:19.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.574+0000 7f3f43400640 1 -- 172.21.15.162:0/666737379 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v112) v1 ==== 136+0+0 (secure 0 0 0) 0x7f3f4c0b43e0 con 0x7f3f4c15c6e0 2024-01-20T11:09:19.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.577+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f2406af00 msgr2=0x7f3f2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:19.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.577+0000 7f3f52000640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f2406af00 0x7f3f2406d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c036000 tx=0x7f3f3c03c040 comp rx=0 tx=0).stop 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.577+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c15c6e0 msgr2=0x7f3f4c14f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.577+0000 7f3f52000640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c15c6e0 0x7f3f4c14f480 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7b0 tx=0x7f3f4400cc70 comp rx=0 tx=0).stop 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 shutdown_connections 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f4c15c6e0 0x7f3f4c14f480 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c155a30 0x7f3f4c0b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f2406af00 0x7f3f2406d3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 --2- 172.21.15.162:0/666737379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c070630 0x7f3f4c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 >> 172.21.15.162:0/666737379 conn(0x7f3f4c0b0cd0 msgr2=0x7f3f4c15cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 shutdown_connections 2024-01-20T11:09:19.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.578+0000 7f3f52000640 1 -- 172.21.15.162:0/666737379 wait complete. 2024-01-20T11:09:19.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-20T11:09:19.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.805+0000 7f8f43400640 1 Processor -- start 2024-01-20T11:09:19.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.805+0000 7f8f43400640 1 -- start start 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.807+0000 7f8f43400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f3c141bb0 0x7f8f3c0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.807+0000 7f8f43400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8f3c0ce6a0 0x7f8f3c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.807+0000 7f8f43400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0cee70 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.807+0000 7f8f43400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0cd7a0 con 0x7f8f3c0ce6a0 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.807+0000 7f8f43400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0ceb90 con 0x7f8f3c141bb0 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f41400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8f3c0cdc30 0x7f8f3c15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51136/0 (socket says 172.21.15.162:51136) 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f41400640 1 -- 172.21.15.162:0/2551148424 learned_addr learned my addr 172.21.15.162:0/2551148424 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:19.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f3be00640 1 --2- 172.21.15.162:0/2551148424 >> v2:172.21.15.162:3300/0 conn(0x7f8f3c0ce6a0 0x7f8f3c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:19.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f40a00640 1 --2- 172.21.15.162:0/2551148424 >> v2:172.21.15.179:3300/0 conn(0x7f8f3c141bb0 0x7f8f3c0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:19.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f3b400640 1 -- 172.21.15.162:0/2551148424 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422231211 0 0) 0x7f8f34001490 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f3be00640 1 -- 172.21.15.162:0/2551148424 >> v2:172.21.15.179:3300/0 conn(0x7f8f3c141bb0 msgr2=0x7f8f3c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:19.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f3be00640 1 --2- 172.21.15.162:0/2551148424 >> v2:172.21.15.179:3300/0 conn(0x7f8f3c141bb0 0x7f8f3c0ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f3be00640 1 -- 172.21.15.162:0/2551148424 >> v1:172.21.15.162:6789/0 conn(0x7f8f3c0cdc30 legacy=0x7f8f3c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:19.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.808+0000 7f8f3be00640 1 -- 172.21.15.162:0/2551148424 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0cd150 con 0x7f8f3c0ce6a0 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f3be00640 1 --2- 172.21.15.162:0/2551148424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0ce6a0 0x7f8f3c06c6e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0ccea0 tx=0x7f8f2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306b261bd37a0d0f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f3b400640 1 -- 172.21.15.162:0/2551148424 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2402e070 con 0x7f8f3c0ce6a0 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f3b400640 1 -- 172.21.15.162:0/2551148424 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f240315a0 con 0x7f8f3c0ce6a0 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f3b400640 1 -- 172.21.15.162:0/2551148424 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24031930 con 0x7f8f3c0ce6a0 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f43400640 1 -- 172.21.15.162:0/2551148424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0ce6a0 msgr2=0x7f8f3c06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f43400640 1 --2- 172.21.15.162:0/2551148424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0ce6a0 0x7f8f3c06c6e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0ccea0 tx=0x7f8f2402b840 comp rx=0 tx=0).stop 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f43400640 1 -- 172.21.15.162:0/2551148424 shutdown_connections 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.810+0000 7f8f43400640 1 --2- 172.21.15.162:0/2551148424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0ce6a0 0x7f8f3c06c6e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.811+0000 7f8f43400640 1 --2- 172.21.15.162:0/2551148424 >> v2:172.21.15.179:3300/0 conn(0x7f8f3c141bb0 0x7f8f3c0ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.811+0000 7f8f43400640 1 -- 172.21.15.162:0/2551148424 >> 172.21.15.162:0/2551148424 conn(0x7f8f3c06a600 msgr2=0x7f8f3c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:19.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.811+0000 7f8f43400640 1 -- 172.21.15.162:0/2551148424 shutdown_connections 2024-01-20T11:09:19.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.811+0000 7f8f43400640 1 -- 172.21.15.162:0/2551148424 wait complete. 2024-01-20T11:09:19.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.812+0000 7f8f43400640 1 Processor -- start 2024-01-20T11:09:19.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.812+0000 7f8f43400640 1 -- start start 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.813+0000 7f8f43400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0cdc30 0x7f8f3c140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.813+0000 7f8f43400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c0ce6a0 0x7f8f3c1e6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.813+0000 7f8f43400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c141bb0 0x7f8f3c1e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.813+0000 7f8f43400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c140ea0 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.813+0000 7f8f43400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c1e55a0 con 0x7f8f3c0ce6a0 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.813+0000 7f8f43400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c1f4230 con 0x7f8f3c141bb0 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0cdc30 0x7f8f3c140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0cdc30 0x7f8f3c140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43492/0 (socket says 172.21.15.162:43492) 2024-01-20T11:09:19.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 -- 172.21.15.162:0/2450382654 learned_addr learned my addr 172.21.15.162:0/2450382654 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:19.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 -- 172.21.15.162:0/2450382654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c141bb0 msgr2=0x7f8f3c1e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c141bb0 0x7f8f3c1e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 -- 172.21.15.162:0/2450382654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c0ce6a0 msgr2=0x7f8f3c1e6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c0ce6a0 0x7f8f3c1e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 -- 172.21.15.162:0/2450382654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009400 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.814+0000 7f8f40a00640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0cdc30 0x7f8f3c140220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00d5f0 tx=0x7f8f2c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.815+0000 7f8f38c00640 1 -- 172.21.15.162:0/2450382654 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0125f0 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.815+0000 7f8f38c00640 1 -- 172.21.15.162:0/2450382654 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c012750 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.815+0000 7f8f38c00640 1 -- 172.21.15.162:0/2450382654 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c012b00 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.815+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c1e4990 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.815+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c1e4f50 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.816+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c04e970 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.817+0000 7f8f38c00640 1 -- 172.21.15.162:0/2450382654 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8f2c012c60 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.818+0000 7f8f38c00640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f1406aed0 0x7f8f1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:19.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.818+0000 7f8f38c00640 1 -- 172.21.15.162:0/2450382654 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8f2c089820 con 0x7f8f3c0cdc30 2024-01-20T11:09:19.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.818+0000 7f8f3be00640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f1406aed0 0x7f8f1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:19.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.819+0000 7f8f3be00640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f1406aed0 0x7f8f1406d390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8f24036000 tx=0x7f8f24030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:19.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:19.822+0000 7f8f38c00640 1 -- 172.21.15.162:0/2450382654 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8f2c0549e0 con 0x7f8f3c0cdc30 2024-01-20T11:09:20.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.000+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8f3c0cff80 con 0x7f8f3c0cdc30 2024-01-20T11:09:20.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.008+0000 7f8f38c00640 1 -- 172.21.15.162:0/2450382654 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8f2c058000 con 0x7f8f3c0cdc30 2024-01-20T11:09:20.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.010+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f1406aed0 msgr2=0x7f8f1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.010+0000 7f8f43400640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f1406aed0 0x7f8f1406d390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8f24036000 tx=0x7f8f24030000 comp rx=0 tx=0).stop 2024-01-20T11:09:20.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.010+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0cdc30 msgr2=0x7f8f3c140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.010+0000 7f8f43400640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0cdc30 0x7f8f3c140220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00d5f0 tx=0x7f8f2c00dab0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 shutdown_connections 2024-01-20T11:09:20.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c141bb0 0x7f8f3c1e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8f1406aed0 0x7f8f1406d390 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c0ce6a0 0x7f8f3c1e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 --2- 172.21.15.162:0/2450382654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f3c0cdc30 0x7f8f3c140220 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 >> 172.21.15.162:0/2450382654 conn(0x7f8f3c06a600 msgr2=0x7f8f3c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:20.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 shutdown_connections 2024-01-20T11:09:20.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.011+0000 7f8f43400640 1 -- 172.21.15.162:0/2450382654 wait complete. 2024-01-20T11:09:20.029 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T11:09:20.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:09:20.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:09:20.246 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T11:09:20.247 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:20.247 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:20.303 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053860,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-20T11:09:20.303 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:09:20.303 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:20.360 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:09:20.360 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:20.360 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:20.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053860,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-20T11:09:20.421 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:09:20.421 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:20.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:09:20.477 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-20T11:09:20.477 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:20.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.698+0000 7f02b7200640 1 Processor -- start 2024-01-20T11:09:20.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.699+0000 7f02b7200640 1 -- start start 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.700+0000 7f02b7200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02b00d40d0 0x7f02b00d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.700+0000 7f02b7200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b00d2af0 con 0x7f02b00ce4d0 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.700+0000 7f02b7200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b00d1ee0 con 0x7f02b0160c60 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.700+0000 7f02b7200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00d21c0 con 0x7f02b00d40d0 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.700+0000 7f02b5200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f02b00ce4d0 0x7f02b006b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51148/0 (socket says 172.21.15.162:51148) 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02b5200640 1 -- 172.21.15.162:0/750122554 learned_addr learned my addr 172.21.15.162:0/750122554 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02a7200640 1 --2- 172.21.15.162:0/750122554 >> v2:172.21.15.179:3300/0 conn(0x7f02b00d40d0 0x7f02b00d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144133041 0 0) 0x7f02b00d2af0 con 0x7f02b00ce4d0 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0290003520 con 0x7f02b00ce4d0 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2838085617 0 0) 0x7f0290003520 con 0x7f02b00ce4d0 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 >> v2:172.21.15.179:3300/0 conn(0x7f02b00d40d0 msgr2=0x7f02b00d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 --2- 172.21.15.162:0/750122554 >> v2:172.21.15.179:3300/0 conn(0x7f02b00d40d0 0x7f02b00d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 >> v1:172.21.15.179:6789/0 conn(0x7f02b0160c60 legacy=0x7f02b00d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00d24a0 con 0x7f02b00ce4d0 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f02a80019f0 con 0x7f02b00ce4d0 2024-01-20T11:09:20.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 >> v1:172.21.15.162:6789/0 conn(0x7f02b00ce4d0 legacy=0x7f02b006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0290003970 0x7f0290003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02900047c0 0x7f0290004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.701+0000 7f02af400640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0290005180 0x7f029000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00d21c0 con 0x7f0290003970 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029000c020 con 0x7f0290005180 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029000c1e0 con 0x7f02900047c0 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02afe00640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0290003970 0x7f0290003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02afe00640 1 -- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02900047c0 msgr2=0x7f0290004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02a7200640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02900047c0 0x7f0290004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02b5200640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0290005180 0x7f029000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02afe00640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02900047c0 0x7f0290004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02afe00640 1 -- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0290005180 msgr2=0x7f029000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02afe00640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0290005180 0x7f029000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02afe00640 1 -- 172.21.15.162:0/750122554 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0290003520 con 0x7f0290003970 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02b5200640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0290005180 0x7f029000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.702+0000 7f02b5200640 1 -- 172.21.15.162:0/750122554 reap_dead start 2024-01-20T11:09:20.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.703+0000 7f02afe00640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0290003970 0x7f0290003d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f02a0001750 tx=0x7f02900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0fc15958817c6a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.703+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00052d0 con 0x7f0290003970 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.703+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a002e050 con 0x7f0290003970 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02af400640 1 -- 172.21.15.162:0/750122554 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0003830 con 0x7f0290003970 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02b7200640 1 -- 172.21.15.162:0/750122554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0290003970 msgr2=0x7f0290003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02b7200640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0290003970 0x7f0290003d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f02a0001750 tx=0x7f02900057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02b7200640 1 -- 172.21.15.162:0/750122554 shutdown_connections 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02b7200640 1 --2- 172.21.15.162:0/750122554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0290003970 0x7f0290003d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02b7200640 1 -- 172.21.15.162:0/750122554 >> 172.21.15.162:0/750122554 conn(0x7f02b009c790 msgr2=0x7f02b00d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:20.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02b7200640 1 -- 172.21.15.162:0/750122554 shutdown_connections 2024-01-20T11:09:20.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.704+0000 7f02b7200640 1 -- 172.21.15.162:0/750122554 wait complete. 2024-01-20T11:09:20.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.706+0000 7f02b7200640 1 Processor -- start 2024-01-20T11:09:20.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.706+0000 7f02b7200640 1 -- start start 2024-01-20T11:09:20.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02b7200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0290003970 0x7f02b015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02b7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02b0154670 0x7f02b00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02b7200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b0159850 0x7f02b00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02b7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b01544d0 con 0x7f02b0154670 2024-01-20T11:09:20.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02b7200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015b7f0 con 0x7f02b0159850 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02b7200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c9490 con 0x7f0290003970 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02a7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02b0154670 0x7f02b00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02a7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02b0154670 0x7f02b00c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43506/0 (socket says 172.21.15.162:43506) 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.707+0000 7f02a7200640 1 -- 172.21.15.162:0/1229801422 learned_addr learned my addr 172.21.15.162:0/1229801422 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02b5200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b0159850 0x7f02b00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02afe00640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0290003970 0x7f02b015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02a7200640 1 -- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0290003970 msgr2=0x7f02b015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02a7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0290003970 0x7f02b015b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02a7200640 1 -- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b0159850 msgr2=0x7f02b00b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02a7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b0159850 0x7f02b00b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02a7200640 1 -- 172.21.15.162:0/1229801422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0154e60 con 0x7f02b0154670 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02afe00640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0290003970 0x7f02b015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02a7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02b0154670 0x7f02b00c8f50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f02980108e0 tx=0x7f0298010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02acc00640 1 -- 172.21.15.162:0/1229801422 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800eb60 con 0x7f02b0154670 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02acc00640 1 -- 172.21.15.162:0/1229801422 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029800ecc0 con 0x7f02b0154670 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b015ba40 con 0x7f02b0154670 2024-01-20T11:09:20.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02acc00640 1 -- 172.21.15.162:0/1229801422 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029801c400 con 0x7f02b0154670 2024-01-20T11:09:20.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.708+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b0159050 con 0x7f02b0154670 2024-01-20T11:09:20.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.710+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b004e970 con 0x7f02b0154670 2024-01-20T11:09:20.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.710+0000 7f02acc00640 1 -- 172.21.15.162:0/1229801422 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f029801c560 con 0x7f02b0154670 2024-01-20T11:09:20.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.711+0000 7f02acc00640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f028806af00 0x7f028806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:20.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.711+0000 7f02acc00640 1 -- 172.21.15.162:0/1229801422 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0298089970 con 0x7f02b0154670 2024-01-20T11:09:20.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.712+0000 7f02afe00640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f028806af00 0x7f028806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:20.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.712+0000 7f02afe00640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f028806af00 0x7f028806d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02a0033000 tx=0x7f02a0009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:20.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.716+0000 7f02acc00640 1 -- 172.21.15.162:0/1229801422 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0298054b40 con 0x7f02b0154670 2024-01-20T11:09:20.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.945+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02b00ce1b0 con 0x7f02b0154670 2024-01-20T11:09:20.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.947+0000 7f02acc00640 1 -- 172.21.15.162:0/1229801422 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f0298058160 con 0x7f02b0154670 2024-01-20T11:09:20.947 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:20.947 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1909669683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1909669683},{"type":"v1","addr":"172.21.15.179:6833","nonce":1909669683}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1065375873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1065375873},{"type":"v1","addr":"172.21.15.179:6835","nonce":1065375873}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/270631999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":270631999},{"type":"v1","addr":"172.21.15.162:6836","nonce":270631999}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2655017097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2655017097},{"type":"v1","addr":"172.21.15.162:6837","nonce":2655017097}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[]} 2024-01-20T11:09:20.948 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 17 2024-01-20T11:09:20.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f028806af00 msgr2=0x7f028806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f028806af00 0x7f028806d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02a0033000 tx=0x7f02a0009030 comp rx=0 tx=0).stop 2024-01-20T11:09:20.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02b0154670 msgr2=0x7f02b00c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:20.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02b0154670 0x7f02b00c8f50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f02980108e0 tx=0x7f0298010da0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 shutdown_connections 2024-01-20T11:09:20.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f028806af00 0x7f028806d3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b0159850 0x7f02b00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02b0154670 0x7f02b00c8f50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 --2- 172.21.15.162:0/1229801422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0290003970 0x7f02b015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:20.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.949+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 >> 172.21.15.162:0/1229801422 conn(0x7f02b009c790 msgr2=0x7f02b00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:20.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.950+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 shutdown_connections 2024-01-20T11:09:20.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:20.950+0000 7f02b7200640 1 -- 172.21.15.162:0/1229801422 wait complete. 2024-01-20T11:09:20.969 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-20T11:09:20.970 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-20T11:09:20.970 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-20T11:09:20.970 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:09:20.970 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-20T11:09:20.970 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-20T11:09:20.970 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-20T11:09:20.971 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:09:20.971 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-20T11:09:20.971 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-20T11:09:20.971 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-20T11:09:20.971 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:09:20.971 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-20T11:09:20.971 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-20T11:09:20.972 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-20T11:09:20.972 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:09:20.992 INFO:tasks.ceph.mds.d:Stopped 2024-01-20T11:09:20.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-20T11:09:20.995 INFO:tasks.ceph.mds.b:Stopped 2024-01-20T11:09:20.995 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-20T11:09:20.996 INFO:tasks.ceph.mds.c:Stopped 2024-01-20T11:09:20.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-20T11:09:20.997 INFO:tasks.ceph.mds.a:Stopped 2024-01-20T11:09:20.998 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-20T11:09:21.041 INFO:tasks.ceph.mds.d:Started 2024-01-20T11:09:21.042 DEBUG:teuthology.parallel:result is None 2024-01-20T11:09:21.044 INFO:tasks.ceph.mds.c:Started 2024-01-20T11:09:21.044 DEBUG:teuthology.parallel:result is None 2024-01-20T11:09:21.048 INFO:tasks.ceph.mds.b:Started 2024-01-20T11:09:21.048 DEBUG:teuthology.parallel:result is None 2024-01-20T11:09:21.050 INFO:tasks.ceph.mds.a:Started 2024-01-20T11:09:21.050 DEBUG:teuthology.parallel:result is None 2024-01-20T11:09:21.050 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-20T11:09:21.193 INFO:tasks.ceph.mds.c.smithi162.stdout:starting mds.c at 2024-01-20T11:09:21.194 INFO:tasks.ceph.mds.a.smithi162.stdout:starting mds.a at 2024-01-20T11:09:21.205 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-01-20T11:09:21.206 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-01-20T11:09:21.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.231+0000 7fe2c1e00640 1 Processor -- start 2024-01-20T11:09:21.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.232+0000 7fe2c1e00640 1 -- start start 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2c1e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe2bc0b5690 0x7fe2bc06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2c1e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe2bc0d1fc0 0x7fe2bc06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2c1e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2bc06bc70 con 0x7fe2bc15d800 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2c1e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc0b2df0 con 0x7fe2bc0d1fc0 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2c1e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc15dbe0 con 0x7fe2bc0b5690 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2baa00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe2bc15d800 0x7fe2bc0b4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51166/0 (socket says 172.21.15.162:51166) 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2baa00640 1 -- 172.21.15.162:0/34531442 learned_addr learned my addr 172.21.15.162:0/34531442 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2bb400640 1 --2- 172.21.15.162:0/34531442 >> v2:172.21.15.162:3300/0 conn(0x7fe2bc0d1fc0 0x7fe2bc06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2b1e00640 1 --2- 172.21.15.162:0/34531442 >> v2:172.21.15.179:3300/0 conn(0x7fe2bc0b5690 0x7fe2bc06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2ba000640 1 -- 172.21.15.162:0/34531442 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282637042 0 0) 0x7fe2bc06bc70 con 0x7fe2bc15d800 2024-01-20T11:09:21.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2ba000640 1 -- 172.21.15.162:0/34531442 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c003520 con 0x7fe2bc15d800 2024-01-20T11:09:21.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2bb400640 1 -- 172.21.15.162:0/34531442 >> v2:172.21.15.179:3300/0 conn(0x7fe2bc0b5690 msgr2=0x7fe2bc06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:21.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2bb400640 1 --2- 172.21.15.162:0/34531442 >> v2:172.21.15.179:3300/0 conn(0x7fe2bc0b5690 0x7fe2bc06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2bb400640 1 -- 172.21.15.162:0/34531442 >> v1:172.21.15.162:6789/0 conn(0x7fe2bc15d800 legacy=0x7fe2bc0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.233+0000 7fe2bb400640 1 -- 172.21.15.162:0/34531442 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc0d2510 con 0x7fe2bc0d1fc0 2024-01-20T11:09:21.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.234+0000 7fe2bb400640 1 --2- 172.21.15.162:0/34531442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc0d1fc0 0x7fe2bc06c640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc09cee0 tx=0x7fe2b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4059a562798c3cee server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:21.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2ba000640 1 -- 172.21.15.162:0/34531442 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b402cc80 con 0x7fe2bc0d1fc0 2024-01-20T11:09:21.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2ba000640 1 -- 172.21.15.162:0/34531442 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b402cde0 con 0x7fe2bc0d1fc0 2024-01-20T11:09:21.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2ba000640 1 -- 172.21.15.162:0/34531442 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4034660 con 0x7fe2bc0d1fc0 2024-01-20T11:09:21.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 -- 172.21.15.162:0/34531442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc0d1fc0 msgr2=0x7fe2bc06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/34531442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc0d1fc0 0x7fe2bc06c640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc09cee0 tx=0x7fe2b402bed0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 -- 172.21.15.162:0/34531442 shutdown_connections 2024-01-20T11:09:21.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/34531442 >> v2:172.21.15.179:3300/0 conn(0x7fe2bc0b5690 0x7fe2bc06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/34531442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc0d1fc0 0x7fe2bc06c640 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 -- 172.21.15.162:0/34531442 >> 172.21.15.162:0/34531442 conn(0x7fe2bc09c7b0 msgr2=0x7fe2bc0d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:21.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 -- 172.21.15.162:0/34531442 shutdown_connections 2024-01-20T11:09:21.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.235+0000 7fe2c1e00640 1 -- 172.21.15.162:0/34531442 wait complete. 2024-01-20T11:09:21.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.237+0000 7fe2c1e00640 1 Processor -- start 2024-01-20T11:09:21.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.237+0000 7fe2c1e00640 1 -- start start 2024-01-20T11:09:21.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2bc0b5690 0x7fe2bc0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2bc0d1fc0 0x7fe2bc0a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc15d800 0x7fe2bc0a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2c1e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc15a240 con 0x7fe2bc15d800 2024-01-20T11:09:21.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2c1e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc09efd0 con 0x7fe2bc0b5690 2024-01-20T11:09:21.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2c1e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc09f2b0 con 0x7fe2bc0d1fc0 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2bb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc15d800 0x7fe2bc0a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2bb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc15d800 0x7fe2bc0a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43546/0 (socket says 172.21.15.162:43546) 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2bb400640 1 -- 172.21.15.162:0/1916981510 learned_addr learned my addr 172.21.15.162:0/1916981510 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2baa00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2bc0b5690 0x7fe2bc0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.238+0000 7fe2b1e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2bc0d1fc0 0x7fe2bc0a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2bb400640 1 -- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2bc0d1fc0 msgr2=0x7fe2bc0a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2bb400640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2bc0d1fc0 0x7fe2bc0a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2bb400640 1 -- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2bc0b5690 msgr2=0x7fe2bc0c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2bb400640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2bc0b5690 0x7fe2bc0c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2bb400640 1 -- 172.21.15.162:0/1916981510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4009a70 con 0x7fe2bc15d800 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2baa00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2bc0b5690 0x7fe2bc0c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2bb400640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc15d800 0x7fe2bc0a05b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009e80 tx=0x7fe2b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2b3e00640 1 -- 172.21.15.162:0/1916981510 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b403e610 con 0x7fe2bc15d800 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2b3e00640 1 -- 172.21.15.162:0/1916981510 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b403e770 con 0x7fe2bc15d800 2024-01-20T11:09:21.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc09f590 con 0x7fe2bc15d800 2024-01-20T11:09:21.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2b3e00640 1 -- 172.21.15.162:0/1916981510 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b403eb60 con 0x7fe2bc15d800 2024-01-20T11:09:21.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.239+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc09fb50 con 0x7fe2bc15d800 2024-01-20T11:09:21.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.241+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc04e970 con 0x7fe2bc15d800 2024-01-20T11:09:21.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.241+0000 7fe2b3e00640 1 -- 172.21.15.162:0/1916981510 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe2b403b050 con 0x7fe2bc15d800 2024-01-20T11:09:21.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.242+0000 7fe2b3e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe29406aed0 0x7fe29406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.242+0000 7fe2b3e00640 1 -- 172.21.15.162:0/1916981510 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2b40abb40 con 0x7fe2bc15d800 2024-01-20T11:09:21.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.242+0000 7fe2baa00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe29406aed0 0x7fe29406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.243+0000 7fe2baa00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe29406aed0 0x7fe29406d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005880 tx=0x7fe2ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:21.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.246+0000 7fe2b3e00640 1 -- 172.21.15.162:0/1916981510 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe2b4076db0 con 0x7fe2bc15d800 2024-01-20T11:09:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.449+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe2bc0b8d50 con 0x7fe2bc15d800 2024-01-20T11:09:21.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.605+0000 7fe2b3e00640 1 -- 172.21.15.162:0/1916981510 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe2b404e080 con 0x7fe2bc15d800 2024-01-20T11:09:21.606 INFO:teuthology.orchestra.run.smithi162.stderr: removed all blocklist entries 2024-01-20T11:09:21.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe29406aed0 msgr2=0x7fe29406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe29406aed0 0x7fe29406d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005880 tx=0x7fe2ac009040 comp rx=0 tx=0).stop 2024-01-20T11:09:21.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc15d800 msgr2=0x7fe2bc0a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc15d800 0x7fe2bc0a05b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009e80 tx=0x7fe2b4004a40 comp rx=0 tx=0).stop 2024-01-20T11:09:21.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 shutdown_connections 2024-01-20T11:09:21.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2bc15d800 0x7fe2bc0a05b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2bc0d1fc0 0x7fe2bc0a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fe29406aed0 0x7fe29406d390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 --2- 172.21.15.162:0/1916981510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2bc0b5690 0x7fe2bc0c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.609+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 >> 172.21.15.162:0/1916981510 conn(0x7fe2bc09c7b0 msgr2=0x7fe2bc06cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:21.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.610+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 shutdown_connections 2024-01-20T11:09:21.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.610+0000 7fe2c1e00640 1 -- 172.21.15.162:0/1916981510 wait complete. 2024-01-20T11:09:21.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-20T11:09:21.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.825+0000 7f1debe00640 1 Processor -- start 2024-01-20T11:09:21.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.825+0000 7f1debe00640 1 -- start start 2024-01-20T11:09:21.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.826+0000 7f1debe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 0x7f1de415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.826+0000 7f1debe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1de415f520 0x7f1de406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1debe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de415f960 con 0x7f1de406cb10 2024-01-20T11:09:21.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1debe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de406d3a0 con 0x7f1de415f520 2024-01-20T11:09:21.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1debe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40ccc70 con 0x7f1de413e380 2024-01-20T11:09:21.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1de9e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1de406cb10 0x7f1de4140c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51174/0 (socket says 172.21.15.162:51174) 2024-01-20T11:09:21.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1de9e00640 1 -- 172.21.15.162:0/3092422150 learned_addr learned my addr 172.21.15.162:0/3092422150 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1de8a00640 1 --2- 172.21.15.162:0/3092422150 >> v2:172.21.15.179:3300/0 conn(0x7f1de415f520 0x7f1de406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1de9400640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 0x7f1de415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593720503 0 0) 0x7f1de415f960 con 0x7f1de406cb10 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.827+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc4003520 con 0x7f1de406cb10 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2540657704 0 0) 0x7f1dc4003520 con 0x7f1de406cb10 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 msgr2=0x7f1de415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 0x7f1de415efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 >> v2:172.21.15.179:3300/0 conn(0x7f1de415f520 msgr2=0x7f1de406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 --2- 172.21.15.162:0/3092422150 >> v2:172.21.15.179:3300/0 conn(0x7f1de415f520 0x7f1de406c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de413fa50 con 0x7f1de406cb10 2024-01-20T11:09:21.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f1dd4001670 con 0x7f1de406cb10 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de8a00640 1 --2- 172.21.15.162:0/3092422150 >> v2:172.21.15.179:3300/0 conn(0x7f1de415f520 0x7f1de406c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 >> v1:172.21.15.162:6789/0 conn(0x7f1de406cb10 legacy=0x7f1de4140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 0x7f1dc4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4003ef0 0x7f1dc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dc4004d00 0x7f1dc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de406d3a0 con 0x7f1dc4004d00 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40ccc70 con 0x7f1dc4003ef0 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc400b9d0 con 0x7f1de413e380 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de9e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dc4004d00 0x7f1dc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.828+0000 7f1de9400640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 0x7f1dc4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.829+0000 7f1de8a00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4003ef0 0x7f1dc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.829+0000 7f1de9e00640 1 -- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 msgr2=0x7f1dc4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.829+0000 7f1de9e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413e380 0x7f1dc4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.829+0000 7f1de9e00640 1 -- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4003ef0 msgr2=0x7f1dc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:21.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.829+0000 7f1de9e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4003ef0 0x7f1dc40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.829+0000 7f1de9e00640 1 -- 172.21.15.162:0/3092422150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4003520 con 0x7f1dc4004d00 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.830+0000 7f1de9e00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dc4004d00 0x7f1dc4005180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c240 tx=0x7f1dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9e25e61f1e5246 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.830+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd402cb00 con 0x7f1dc4004d00 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.830+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd402cc60 con 0x7f1dc4004d00 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.830+0000 7f1de3e00640 1 -- 172.21.15.162:0/3092422150 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4005af0 con 0x7f1dc4004d00 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.830+0000 7f1debe00640 1 -- 172.21.15.162:0/3092422150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dc4004d00 msgr2=0x7f1dc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.830+0000 7f1debe00640 1 --2- 172.21.15.162:0/3092422150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dc4004d00 0x7f1dc4005180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c240 tx=0x7f1dc40057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.830+0000 7f1de9e00640 1 -- 172.21.15.162:0/3092422150 reap_dead start 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.831+0000 7f1debe00640 1 -- 172.21.15.162:0/3092422150 shutdown_connections 2024-01-20T11:09:21.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.831+0000 7f1debe00640 1 -- 172.21.15.162:0/3092422150 >> 172.21.15.162:0/3092422150 conn(0x7f1de406a600 msgr2=0x7f1de406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:21.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.831+0000 7f1debe00640 1 -- 172.21.15.162:0/3092422150 shutdown_connections 2024-01-20T11:09:21.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.831+0000 7f1debe00640 1 -- 172.21.15.162:0/3092422150 wait complete. 2024-01-20T11:09:21.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.832+0000 7f1debe00640 1 Processor -- start 2024-01-20T11:09:21.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.832+0000 7f1debe00640 1 -- start start 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.833+0000 7f1debe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4004d00 0x7f1de40c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.833+0000 7f1debe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de40afc90 0x7f1de40c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.833+0000 7f1debe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413d200 0x7f1de40c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.833+0000 7f1debe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de413c4d0 con 0x7f1de40afc90 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.833+0000 7f1debe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de413cd70 con 0x7f1dc4004d00 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.833+0000 7f1debe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40c4e70 con 0x7f1de413d200 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de40afc90 0x7f1de40c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de40afc90 0x7f1de40c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43570/0 (socket says 172.21.15.162:43570) 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 -- 172.21.15.162:0/4228319708 learned_addr learned my addr 172.21.15.162:0/4228319708 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 -- 172.21.15.162:0/4228319708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413d200 msgr2=0x7f1de40c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413d200 0x7f1de40c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 -- 172.21.15.162:0/4228319708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4004d00 msgr2=0x7f1de40c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4004d00 0x7f1de40c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 -- 172.21.15.162:0/4228319708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de40c50f0 con 0x7f1de40afc90 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de8a00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de40afc90 0x7f1de40c4930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc010860 tx=0x7f1dcc010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.834+0000 7f1de1600640 1 -- 172.21.15.162:0/4228319708 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00eae0 con 0x7f1de40afc90 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.835+0000 7f1de1600640 1 -- 172.21.15.162:0/4228319708 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc00c050 con 0x7f1de40afc90 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.835+0000 7f1de1600640 1 -- 172.21.15.162:0/4228319708 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00ee40 con 0x7f1de40afc90 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.835+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de413c720 con 0x7f1de40afc90 2024-01-20T11:09:21.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.835+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de40b0110 con 0x7f1de40afc90 2024-01-20T11:09:21.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.836+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de404e970 con 0x7f1de40afc90 2024-01-20T11:09:21.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.837+0000 7f1de1600640 1 -- 172.21.15.162:0/4228319708 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1dcc015470 con 0x7f1de40afc90 2024-01-20T11:09:21.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.837+0000 7f1de1600640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1dbc06aed0 0x7f1dbc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:21.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.837+0000 7f1de1600640 1 -- 172.21.15.162:0/4228319708 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1dcc089cc0 con 0x7f1de40afc90 2024-01-20T11:09:21.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.838+0000 7f1de9400640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1dbc06aed0 0x7f1dbc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:21.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.838+0000 7f1de9400640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1dbc06aed0 0x7f1dbc06d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009fa0 tx=0x7f1ddc009750 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:21.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:21.842+0000 7f1de1600640 1 -- 172.21.15.162:0/4228319708 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1dcc090080 con 0x7f1de40afc90 2024-01-20T11:09:22.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.109+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1de40cff10 con 0x7f1de40afc90 2024-01-20T11:09:22.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.110+0000 7f1de1600640 1 -- 172.21.15.162:0/4228319708 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1dcc054ed0 con 0x7f1de40afc90 2024-01-20T11:09:22.110 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:22.110 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "auth_dump": [ 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.a", 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA2qatli4LXOBAAyHG4hThQHVzhS2VuxtIShQ==", 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.b", 2024-01-20T11:09:22.111 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatln9JhHRAAThi8suQy0WUJaCK80hNdMQ==", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.c", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatljiNoDRAAF01GIgXhTP8Xw3tCJz4r9w==", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:09:22.112 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mds.d", 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatlO9ZVKxAAlodCLFD0cJVAL5yXVeEqlg==", 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.0", 2024-01-20T11:09:22.113 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA8qatlmprLFhAA8txfY4VYIHGeFSq4MqTKXA==", 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.1", 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA/qatlvx9yLxAAudg/s2BWxTBkX5HFB2XdcA==", 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.114 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.2", 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBDqatly0LLCxAAs92m9lgojdlmvSk6BdLbzA==", 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.3", 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBGqatl2IqpIhAAphkrhMKWP3GywFmTNSymdw==", 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.115 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.4", 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBNqatl67EHLhAAU+cN87inhfqC8zSyDhXfwA==", 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.116 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.5", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBRqatljVzrDRAAUPAgVpOxYiDrJyOnvBnUgA==", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.6", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBUqatlbmzXFxAApeFOxi8HAIpzM0qO3gxhZA==", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.117 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "osd.7", 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQBXqatl+MWELxAArrji0ys1SfJ7v5yIwAifFQ==", 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow profile osd", 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile osd", 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.118 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.0", 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA3qatljGIeOBAAZAh1ameerRU000krb9bN6g==", 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow r", 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-20T11:09:22.119 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.1", 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA4qatl8NRKERAAGAVRlvq6iuXNcwGBrsxjCQ==", 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow r", 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow rw", 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rwx" 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.2", 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA4qatlChY5BxAAkBXYUjzsz/0ZfA/D7ydtsQ==", 2024-01-20T11:09:22.120 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow r", 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow rw", 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rwx" 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.3", 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA4qatle+5OGxAAqVEOXYysmTEwit512OV0Gw==", 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow", 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow r", 2024-01-20T11:09:22.121 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow rw", 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow rwx" 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "client.admin", 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA1qatlxob7LxAAjSuHtskn16u3B3P3zKkJCg==", 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow *", 2024-01-20T11:09:22.122 INFO:teuthology.orchestra.run.smithi162.stdout: "mgr": "allow *", 2024-01-20T11:09:22.123 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow *", 2024-01-20T11:09:22.123 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.123 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.123 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.123 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.123 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mgr.x", 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA2qatleWbxLRAAM9Mru8f0sV5ndjgiwANf4A==", 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow *", 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile mgr", 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "entity": "mgr.y", 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "AQA2qatlfFkPIxAAg8+vmZmaSmheq0M0JmG30w==", 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": { 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": "allow *", 2024-01-20T11:09:22.124 INFO:teuthology.orchestra.run.smithi162.stdout: "mon": "allow profile mgr", 2024-01-20T11:09:22.125 INFO:teuthology.orchestra.run.smithi162.stdout: "osd": "allow *" 2024-01-20T11:09:22.125 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.125 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:22.125 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-01-20T11:09:22.125 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.112+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1dbc06aed0 msgr2=0x7f1dbc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1dbc06aed0 0x7f1dbc06d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009fa0 tx=0x7f1ddc009750 comp rx=0 tx=0).stop 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de40afc90 msgr2=0x7f1de40c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de40afc90 0x7f1de40c4930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc010860 tx=0x7f1dcc010d20 comp rx=0 tx=0).stop 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 shutdown_connections 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1de413d200 0x7f1de40c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de40afc90 0x7f1de40c4930 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1dbc06aed0 0x7f1dbc06d390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 --2- 172.21.15.162:0/4228319708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc4004d00 0x7f1de40c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 >> 172.21.15.162:0/4228319708 conn(0x7f1de406a600 msgr2=0x7f1de413f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:22.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 shutdown_connections 2024-01-20T11:09:22.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.113+0000 7f1debe00640 1 -- 172.21.15.162:0/4228319708 wait complete. 2024-01-20T11:09:22.130 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:22.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.335+0000 7f194e400640 1 Processor -- start 2024-01-20T11:09:22.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.336+0000 7f194e400640 1 -- start start 2024-01-20T11:09:22.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.337+0000 7f194e400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1948143c70 0x7f1948070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.337+0000 7f194e400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 0x7f19480cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.337+0000 7f194e400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19480cd300 con 0x7f19480cf960 2024-01-20T11:09:22.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.337+0000 7f194e400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19480cfdd0 con 0x7f1948143c70 2024-01-20T11:09:22.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.337+0000 7f194e400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480cc9d0 con 0x7f19480b3ad0 2024-01-20T11:09:22.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.337+0000 7f194da00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f19480cf960 0x7f19480b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51178/0 (socket says 172.21.15.162:51178) 2024-01-20T11:09:22.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.337+0000 7f194da00640 1 -- 172.21.15.162:0/927060616 learned_addr learned my addr 172.21.15.162:0/927060616 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f194d000640 1 --2- 172.21.15.162:0/927060616 >> v2:172.21.15.179:3300/0 conn(0x7f1948143c70 0x7f1948070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f193fc00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 0x7f19480cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572660447 0 0) 0x7f19480cd300 con 0x7f19480cf960 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1928003520 con 0x7f19480cf960 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148210217 0 0) 0x7f1928003520 con 0x7f19480cf960 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 msgr2=0x7f19480cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 0x7f19480cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 >> v2:172.21.15.179:3300/0 conn(0x7f1948143c70 msgr2=0x7f1948070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 --2- 172.21.15.162:0/927060616 >> v2:172.21.15.179:3300/0 conn(0x7f1948143c70 0x7f1948070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480cccb0 con 0x7f19480cf960 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f1940001670 con 0x7f19480cf960 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 >> v1:172.21.15.162:6789/0 conn(0x7f19480cf960 legacy=0x7f19480b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 0x7f1928003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1928003ef0 0x7f19280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928004d00 0x7f1928005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480cfdd0 con 0x7f1928004d00 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480cc9d0 con 0x7f1928003ef0 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.338+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192800b980 con 0x7f19480b3ad0 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f194da00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928004d00 0x7f1928005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f193fc00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1928003ef0 0x7f19280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f194d000640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 0x7f1928003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f194da00640 1 -- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 msgr2=0x7f1928003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f194da00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19480b3ad0 0x7f1928003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f194da00640 1 -- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1928003ef0 msgr2=0x7f19280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:22.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f194da00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1928003ef0 0x7f19280047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.339+0000 7f194da00640 1 -- 172.21.15.162:0/927060616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928003520 con 0x7f1928004d00 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.340+0000 7f194da00640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928004d00 0x7f1928005180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f194000c240 tx=0x7f19280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb39e8a6a0d66bd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.340+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194002cae0 con 0x7f1928004d00 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.340+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194002cc40 con 0x7f1928004d00 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.340+0000 7f1947e00640 1 -- 172.21.15.162:0/927060616 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940005af0 con 0x7f1928004d00 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.341+0000 7f194e400640 1 -- 172.21.15.162:0/927060616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928004d00 msgr2=0x7f1928005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.341+0000 7f194e400640 1 --2- 172.21.15.162:0/927060616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1928004d00 0x7f1928005180 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f194000c240 tx=0x7f19280057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.341+0000 7f194da00640 1 -- 172.21.15.162:0/927060616 reap_dead start 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.341+0000 7f194e400640 1 -- 172.21.15.162:0/927060616 shutdown_connections 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.341+0000 7f194e400640 1 -- 172.21.15.162:0/927060616 >> 172.21.15.162:0/927060616 conn(0x7f194806aa20 msgr2=0x7f194806ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:22.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.341+0000 7f194e400640 1 -- 172.21.15.162:0/927060616 shutdown_connections 2024-01-20T11:09:22.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.341+0000 7f194e400640 1 -- 172.21.15.162:0/927060616 wait complete. 2024-01-20T11:09:22.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.343+0000 7f194e400640 1 Processor -- start 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.343+0000 7f194e400640 1 -- start start 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f194e400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1928004d00 0x7f19481599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f194e400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f194813f940 0x7f194813e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f194e400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f194813fdc0 0x7f19480ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f194e400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948159220 con 0x7f194813f940 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f194e400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480ad300 con 0x7f194813fdc0 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f194e400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480ac960 con 0x7f1928004d00 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f193fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f194813f940 0x7f194813e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f193fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f194813f940 0x7f194813e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43602/0 (socket says 172.21.15.162:43602) 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.344+0000 7f193fc00640 1 -- 172.21.15.162:0/4012640768 learned_addr learned my addr 172.21.15.162:0/4012640768 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f194d000640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1928004d00 0x7f19481599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f194da00640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f194813fdc0 0x7f19480ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f193fc00640 1 -- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1928004d00 msgr2=0x7f19481599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f193fc00640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1928004d00 0x7f19481599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f193fc00640 1 -- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f194813fdc0 msgr2=0x7f19480ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f193fc00640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f194813fdc0 0x7f19480ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f193fc00640 1 -- 172.21.15.162:0/4012640768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480acc40 con 0x7f194813f940 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f193fc00640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f194813f940 0x7f194813e960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1930010860 tx=0x7f1930010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f1945600640 1 -- 172.21.15.162:0/4012640768 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930009610 con 0x7f194813f940 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f1945600640 1 -- 172.21.15.162:0/4012640768 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193000eb60 con 0x7f194813f940 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f1945600640 1 -- 172.21.15.162:0/4012640768 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193001c400 con 0x7f194813f940 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19480acf20 con 0x7f194813f940 2024-01-20T11:09:22.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.345+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194813f3e0 con 0x7f194813f940 2024-01-20T11:09:22.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.346+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1948074a30 con 0x7f194813f940 2024-01-20T11:09:22.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.347+0000 7f1945600640 1 -- 172.21.15.162:0/4012640768 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f193001c560 con 0x7f194813f940 2024-01-20T11:09:22.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.348+0000 7f1945600640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f192006aed0 0x7f192006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.348+0000 7f1945600640 1 -- 172.21.15.162:0/4012640768 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1930089940 con 0x7f194813f940 2024-01-20T11:09:22.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.348+0000 7f194d000640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f192006aed0 0x7f192006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.349+0000 7f194d000640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f192006aed0 0x7f192006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1948140b60 tx=0x7f193800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:22.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.353+0000 7f1945600640 1 -- 172.21.15.162:0/4012640768 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1930054c00 con 0x7f194813f940 2024-01-20T11:09:22.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.547+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19480b3f40 con 0x7f194813f940 2024-01-20T11:09:22.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.549+0000 7f1945600640 1 -- 172.21.15.162:0/4012640768 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12882 (secure 0 0 0) 0x7f19480b3f40 con 0x7f194813f940 2024-01-20T11:09:22.550 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:22.551 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":43,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:21.618775+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f192006aed0 msgr2=0x7f192006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f192006aed0 0x7f192006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1948140b60 tx=0x7f193800b040 comp rx=0 tx=0).stop 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f194813f940 msgr2=0x7f194813e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f194813f940 0x7f194813e960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1930010860 tx=0x7f1930010d20 comp rx=0 tx=0).stop 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 shutdown_connections 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f192006aed0 0x7f192006d390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f194813fdc0 0x7f19480ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f194813f940 0x7f194813e960 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 --2- 172.21.15.162:0/4012640768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1928004d00 0x7f19481599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 >> 172.21.15.162:0/4012640768 conn(0x7f194806aa20 msgr2=0x7f1948070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:22.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 shutdown_connections 2024-01-20T11:09:22.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.552+0000 7f194e400640 1 -- 172.21.15.162:0/4012640768 wait complete. 2024-01-20T11:09:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:09:22.574 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:09:22.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.785+0000 7fd819c00640 1 Processor -- start 2024-01-20T11:09:22.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.785+0000 7fd819c00640 1 -- start start 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd819c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd814141bb0 0x7fd8140ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd819c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd8140ce6a0 0x7fd81406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd819c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140cee70 con 0x7fd8140cdc30 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd819c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8140cd7a0 con 0x7fd8140ce6a0 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd819c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140ceb90 con 0x7fd814141bb0 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd812000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd8140ce6a0 0x7fd81406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd812000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd8140ce6a0 0x7fd81406c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43608/0 (socket says 172.21.15.162:43608) 2024-01-20T11:09:22.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.787+0000 7fd812000640 1 -- 172.21.15.162:0/2453926760 learned_addr learned my addr 172.21.15.162:0/2453926760 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:22.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.788+0000 7fd812a00640 1 --2- 172.21.15.162:0/2453926760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd814141bb0 0x7fd8140ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.788+0000 7fd812000640 1 -- 172.21.15.162:0/2453926760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd814141bb0 msgr2=0x7fd8140ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:22.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.788+0000 7fd812000640 1 --2- 172.21.15.162:0/2453926760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd814141bb0 0x7fd8140ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.788+0000 7fd812000640 1 -- 172.21.15.162:0/2453926760 >> v1:172.21.15.179:6789/0 conn(0x7fd8140cdc30 legacy=0x7fd81415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:22.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.788+0000 7fd812000640 1 -- 172.21.15.162:0/2453926760 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140cd150 con 0x7fd8140ce6a0 2024-01-20T11:09:22.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.788+0000 7fd812a00640 1 --2- 172.21.15.162:0/2453926760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd814141bb0 0x7fd8140ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:22.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.789+0000 7fd812000640 1 --2- 172.21.15.162:0/2453926760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140ce6a0 0x7fd81406c6e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009e50 tx=0x7fd7fc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71124b028badb273 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.789+0000 7fd811600640 1 -- 172.21.15.162:0/2453926760 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc02c9f0 con 0x7fd8140ce6a0 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.789+0000 7fd811600640 1 -- 172.21.15.162:0/2453926760 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc02cb50 con 0x7fd8140ce6a0 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.789+0000 7fd811600640 1 -- 172.21.15.162:0/2453926760 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0343f0 con 0x7fd8140ce6a0 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 -- 172.21.15.162:0/2453926760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140ce6a0 msgr2=0x7fd81406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 --2- 172.21.15.162:0/2453926760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140ce6a0 0x7fd81406c6e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009e50 tx=0x7fd7fc02be50 comp rx=0 tx=0).stop 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 -- 172.21.15.162:0/2453926760 shutdown_connections 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 --2- 172.21.15.162:0/2453926760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140ce6a0 0x7fd81406c6e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 --2- 172.21.15.162:0/2453926760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd814141bb0 0x7fd8140ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 -- 172.21.15.162:0/2453926760 >> 172.21.15.162:0/2453926760 conn(0x7fd81406a600 msgr2=0x7fd81406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:22.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 -- 172.21.15.162:0/2453926760 shutdown_connections 2024-01-20T11:09:22.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.790+0000 7fd819c00640 1 -- 172.21.15.162:0/2453926760 wait complete. 2024-01-20T11:09:22.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.792+0000 7fd819c00640 1 Processor -- start 2024-01-20T11:09:22.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.792+0000 7fd819c00640 1 -- start start 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd819c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140cdc30 0x7fd814137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd819c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8140ce6a0 0x7fd8140b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd819c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd814141bb0 0x7fd81415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd819c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814138c10 con 0x7fd8140cdc30 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd819c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140b4160 con 0x7fd814141bb0 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd819c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd814138000 con 0x7fd8140ce6a0 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd812a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140cdc30 0x7fd814137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd812a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140cdc30 0x7fd814137970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43620/0 (socket says 172.21.15.162:43620) 2024-01-20T11:09:22.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd812a00640 1 -- 172.21.15.162:0/1763417866 learned_addr learned my addr 172.21.15.162:0/1763417866 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd812000640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8140ce6a0 0x7fd8140b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd812a00640 1 -- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8140ce6a0 msgr2=0x7fd8140b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd812a00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8140ce6a0 0x7fd8140b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd812a00640 1 -- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd814141bb0 msgr2=0x7fd81415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.793+0000 7fd813400640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd814141bb0 0x7fd81415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd812a00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd814141bb0 0x7fd81415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd812a00640 1 -- 172.21.15.162:0/1763417866 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009b30 con 0x7fd8140cdc30 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd813400640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd814141bb0 0x7fd81415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:22.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd812a00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140cdc30 0x7fd814137970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c7f0 tx=0x7fd80400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:22.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd80aa00640 1 -- 172.21.15.162:0/1763417866 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804007820 con 0x7fd8140cdc30 2024-01-20T11:09:22.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd80aa00640 1 -- 172.21.15.162:0/1763417866 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804007980 con 0x7fd8140cdc30 2024-01-20T11:09:22.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd80aa00640 1 -- 172.21.15.162:0/1763417866 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804007cf0 con 0x7fd8140cdc30 2024-01-20T11:09:22.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8141382e0 con 0x7fd8140cdc30 2024-01-20T11:09:22.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.794+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8141388a0 con 0x7fd8140cdc30 2024-01-20T11:09:22.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.796+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81404e970 con 0x7fd8140cdc30 2024-01-20T11:09:22.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.796+0000 7fd80aa00640 1 -- 172.21.15.162:0/1763417866 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd8040113f0 con 0x7fd8140cdc30 2024-01-20T11:09:22.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.797+0000 7fd80aa00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd7ec06aed0 0x7fd7ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:22.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.797+0000 7fd80aa00640 1 -- 172.21.15.162:0/1763417866 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8040896d0 con 0x7fd8140cdc30 2024-01-20T11:09:22.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.797+0000 7fd812000640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd7ec06aed0 0x7fd7ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:22.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.798+0000 7fd812000640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd7ec06aed0 0x7fd7ec06d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc035000 tx=0x7fd7fc030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:22.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.802+0000 7fd80aa00640 1 -- 172.21.15.162:0/1763417866 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd804054850 con 0x7fd8140cdc30 2024-01-20T11:09:22.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.996+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8140cff80 con 0x7fd8140cdc30 2024-01-20T11:09:22.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:22.997+0000 7fd80aa00640 1 -- 172.21.15.162:0/1763417866 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd80401f020 con 0x7fd8140cdc30 2024-01-20T11:09:22.998 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd7ec06aed0 msgr2=0x7fd7ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd7ec06aed0 0x7fd7ec06d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc035000 tx=0x7fd7fc030000 comp rx=0 tx=0).stop 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140cdc30 msgr2=0x7fd814137970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140cdc30 0x7fd814137970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c7f0 tx=0x7fd80400ccb0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 shutdown_connections 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd7ec06aed0 0x7fd7ec06d390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd814141bb0 0x7fd81415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8140ce6a0 0x7fd8140b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 --2- 172.21.15.162:0/1763417866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8140cdc30 0x7fd814137970 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 >> 172.21.15.162:0/1763417866 conn(0x7fd81406a600 msgr2=0x7fd81415d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:23.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 shutdown_connections 2024-01-20T11:09:23.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.000+0000 7fd819c00640 1 -- 172.21.15.162:0/1763417866 wait complete. 2024-01-20T11:09:23.020 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T11:09:23.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.229+0000 7f66db200640 1 Processor -- start 2024-01-20T11:09:23.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.229+0000 7f66db200640 1 -- start start 2024-01-20T11:09:23.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.230+0000 7f66db200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66dc143bd0 0x7f66dc15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.230+0000 7f66db200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc15ea60 con 0x7f66dc06dfe0 2024-01-20T11:09:23.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.230+0000 7f66db200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc15b610 con 0x7f66dc071c90 2024-01-20T11:09:23.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.230+0000 7f66db200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc15dc40 con 0x7f66dc143bd0 2024-01-20T11:09:23.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.231+0000 7f66d3e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f66dc06dfe0 0x7f66dc071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51192/0 (socket says 172.21.15.162:51192) 2024-01-20T11:09:23.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.231+0000 7f66d3e00640 1 -- 172.21.15.162:0/166051897 learned_addr learned my addr 172.21.15.162:0/166051897 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:23.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.231+0000 7f66d9e00640 1 --2- 172.21.15.162:0/166051897 >> v2:172.21.15.179:3300/0 conn(0x7f66dc143bd0 0x7f66dc15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.231+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378586406 0 0) 0x7f66dc15ea60 con 0x7f66dc06dfe0 2024-01-20T11:09:23.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.231+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66bc003520 con 0x7f66dc06dfe0 2024-01-20T11:09:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4181357452 0 0) 0x7f66bc003520 con 0x7f66dc06dfe0 2024-01-20T11:09:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 >> v2:172.21.15.179:3300/0 conn(0x7f66dc143bd0 msgr2=0x7f66dc15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 --2- 172.21.15.162:0/166051897 >> v2:172.21.15.179:3300/0 conn(0x7f66dc143bd0 0x7f66dc15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 >> v1:172.21.15.179:6789/0 conn(0x7f66dc071c90 legacy=0x7f66dc15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc15de50 con 0x7f66dc06dfe0 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f66c4001670 con 0x7f66dc06dfe0 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 >> v1:172.21.15.162:6789/0 conn(0x7f66dc06dfe0 legacy=0x7f66dc071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc003970 0x7f66bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc0047c0 0x7f66bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc005180 0x7f66bc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc15dc40 con 0x7f66bc005180 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc00e330 con 0x7f66bc0047c0 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc00e4f0 con 0x7f66bc003970 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66da800640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc005180 0x7f66bc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d3e00640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc0047c0 0x7f66bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.232+0000 7f66d9e00640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc003970 0x7f66bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.233+0000 7f66da800640 1 -- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc003970 msgr2=0x7f66bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.233+0000 7f66da800640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc003970 0x7f66bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.233+0000 7f66da800640 1 -- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc0047c0 msgr2=0x7f66bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.233+0000 7f66da800640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc0047c0 0x7f66bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.233+0000 7f66da800640 1 -- 172.21.15.162:0/166051897 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc003520 con 0x7f66bc005180 2024-01-20T11:09:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.234+0000 7f66da800640 1 -- 172.21.15.162:0/166051897 reap_dead start 2024-01-20T11:09:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.234+0000 7f66da800640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc005180 0x7f66bc00db90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f66d4001e50 tx=0x7f66bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a0e356d6dab51a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.234+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003b70 con 0x7f66bc005180 2024-01-20T11:09:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.234+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4003d10 con 0x7f66bc005180 2024-01-20T11:09:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.234+0000 7f66d9400640 1 -- 172.21.15.162:0/166051897 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4005310 con 0x7f66bc005180 2024-01-20T11:09:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.235+0000 7f66db200640 1 -- 172.21.15.162:0/166051897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc005180 msgr2=0x7f66bc00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.235+0000 7f66db200640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc005180 0x7f66bc00db90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f66d4001e50 tx=0x7f66bc0057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.235+0000 7f66db200640 1 -- 172.21.15.162:0/166051897 shutdown_connections 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.235+0000 7f66db200640 1 --2- 172.21.15.162:0/166051897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc005180 0x7f66bc00db90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.235+0000 7f66db200640 1 -- 172.21.15.162:0/166051897 >> 172.21.15.162:0/166051897 conn(0x7f66dc0b0c40 msgr2=0x7f66dc0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.235+0000 7f66db200640 1 -- 172.21.15.162:0/166051897 shutdown_connections 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.235+0000 7f66db200640 1 -- 172.21.15.162:0/166051897 wait complete. 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.237+0000 7f66db200640 1 Processor -- start 2024-01-20T11:09:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.237+0000 7f66db200640 1 -- start start 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66db200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc005180 0x7f66dc13ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66db200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc0cc770 0x7f66dc13bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66db200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66dc13c430 0x7f66dc13d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66db200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc140520 con 0x7f66dc0cc770 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66db200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc13c200 con 0x7f66bc005180 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66db200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0ccc50 con 0x7f66dc13c430 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc0cc770 0x7f66dc13bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc0cc770 0x7f66dc13bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43640/0 (socket says 172.21.15.162:43640) 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 -- 172.21.15.162:0/715828396 learned_addr learned my addr 172.21.15.162:0/715828396 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 -- 172.21.15.162:0/715828396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66dc13c430 msgr2=0x7f66dc13d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66dc13c430 0x7f66dc13d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d9e00640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc005180 0x7f66dc13ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 -- 172.21.15.162:0/715828396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc005180 msgr2=0x7f66dc13ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc005180 0x7f66dc13ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.238+0000 7f66d3e00640 1 -- 172.21.15.162:0/715828396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0ccf30 con 0x7f66dc0cc770 2024-01-20T11:09:23.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.239+0000 7f66d3e00640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc0cc770 0x7f66dc13bcc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f66c4001050 tx=0x7f66c400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:23.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.239+0000 7f66d2000640 1 -- 172.21.15.162:0/715828396 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400c6c0 con 0x7f66dc0cc770 2024-01-20T11:09:23.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.239+0000 7f66d2000640 1 -- 172.21.15.162:0/715828396 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400c820 con 0x7f66dc0cc770 2024-01-20T11:09:23.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.239+0000 7f66d2000640 1 -- 172.21.15.162:0/715828396 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400cbd0 con 0x7f66dc0cc770 2024-01-20T11:09:23.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.239+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc0cd210 con 0x7f66dc0cc770 2024-01-20T11:09:23.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.239+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc0cd7d0 con 0x7f66dc0cc770 2024-01-20T11:09:23.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.240+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc074a30 con 0x7f66dc0cc770 2024-01-20T11:09:23.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.241+0000 7f66d2000640 1 -- 172.21.15.162:0/715828396 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f66c401d460 con 0x7f66dc0cc770 2024-01-20T11:09:23.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.242+0000 7f66d2000640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f66b406af00 0x7f66b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.243+0000 7f66d2000640 1 -- 172.21.15.162:0/715828396 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66c40894e0 con 0x7f66dc0cc770 2024-01-20T11:09:23.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.243+0000 7f66d9e00640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f66b406af00 0x7f66b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.243+0000 7f66d9e00640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f66b406af00 0x7f66b406d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0098d0 tx=0x7f66cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:23.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.247+0000 7f66d2000640 1 -- 172.21.15.162:0/715828396 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f66c4054660 con 0x7f66dc0cc770 2024-01-20T11:09:23.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.445+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66dc06cb50 con 0x7f66dc0cc770 2024-01-20T11:09:23.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.446+0000 7f66d2000640 1 -- 172.21.15.162:0/715828396 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7f66c4057c80 con 0x7f66dc0cc770 2024-01-20T11:09:23.446 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:23.446 INFO:teuthology.orchestra.run.smithi162.stdout:[ 2024-01-20T11:09:23.447 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-01-20T11:09:23.447 INFO:teuthology.orchestra.run.smithi162.stdout: "poolnum": 1, 2024-01-20T11:09:23.447 INFO:teuthology.orchestra.run.smithi162.stdout: "poolname": ".mgr" 2024-01-20T11:09:23.447 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-01-20T11:09:23.447 INFO:teuthology.orchestra.run.smithi162.stdout:] 2024-01-20T11:09:23.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f66b406af00 msgr2=0x7f66b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f66b406af00 0x7f66b406d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0098d0 tx=0x7f66cc008040 comp rx=0 tx=0).stop 2024-01-20T11:09:23.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc0cc770 msgr2=0x7f66dc13bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc0cc770 0x7f66dc13bcc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f66c4001050 tx=0x7f66c400eb90 comp rx=0 tx=0).stop 2024-01-20T11:09:23.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 shutdown_connections 2024-01-20T11:09:23.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66dc13c430 0x7f66dc13d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc0cc770 0x7f66dc13bcc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f66b406af00 0x7f66b406d3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 --2- 172.21.15.162:0/715828396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc005180 0x7f66dc13ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.448+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 >> 172.21.15.162:0/715828396 conn(0x7f66dc0b0c40 msgr2=0x7f66dc15c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:23.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.449+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 shutdown_connections 2024-01-20T11:09:23.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.449+0000 7f66db200640 1 -- 172.21.15.162:0/715828396 wait complete. 2024-01-20T11:09:23.467 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-20T11:09:23.467 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-20T11:09:23.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.680+0000 7ffa3ec00640 1 Processor -- start 2024-01-20T11:09:23.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.681+0000 7ffa3ec00640 1 -- start start 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa3ec00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffa380ceef0 0x7ffa380ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa3ec00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3806d530 con 0x7ffa380cd320 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa3ec00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380cfb80 con 0x7ffa38157fa0 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa3ec00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380cd7b0 con 0x7ffa380ceef0 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa37400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffa380ceef0 0x7ffa380ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa3cc00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ffa380cd320 0x7ffa3815bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51196/0 (socket says 172.21.15.162:51196) 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa37400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffa380ceef0 0x7ffa380ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43642/0 (socket says 172.21.15.162:43642) 2024-01-20T11:09:23.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.682+0000 7ffa3cc00640 1 -- 172.21.15.162:0/2459059708 learned_addr learned my addr 172.21.15.162:0/2459059708 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:23.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.683+0000 7ffa37400640 1 -- 172.21.15.162:0/2459059708 >> v1:172.21.15.179:6789/0 conn(0x7ffa38157fa0 legacy=0x7ffa380cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.683+0000 7ffa37400640 1 -- 172.21.15.162:0/2459059708 >> v1:172.21.15.162:6789/0 conn(0x7ffa380cd320 legacy=0x7ffa3815bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.683+0000 7ffa37400640 1 -- 172.21.15.162:0/2459059708 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3806c920 con 0x7ffa380ceef0 2024-01-20T11:09:23.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.685+0000 7ffa37400640 1 --2- 172.21.15.162:0/2459059708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa380ceef0 0x7ffa380ccde0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ffa200097a0 tx=0x7ffa2002db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae5d2528112433 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:23.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.685+0000 7ffa36a00640 1 -- 172.21.15.162:0/2459059708 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2002e920 con 0x7ffa380ceef0 2024-01-20T11:09:23.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.685+0000 7ffa36a00640 1 -- 172.21.15.162:0/2459059708 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2002ea80 con 0x7ffa380ceef0 2024-01-20T11:09:23.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.685+0000 7ffa36a00640 1 -- 172.21.15.162:0/2459059708 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2002ee10 con 0x7ffa380ceef0 2024-01-20T11:09:23.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.686+0000 7ffa3ec00640 1 -- 172.21.15.162:0/2459059708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa380ceef0 msgr2=0x7ffa380ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.686+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/2459059708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa380ceef0 0x7ffa380ccde0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ffa200097a0 tx=0x7ffa2002db70 comp rx=0 tx=0).stop 2024-01-20T11:09:23.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.686+0000 7ffa3ec00640 1 -- 172.21.15.162:0/2459059708 shutdown_connections 2024-01-20T11:09:23.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.686+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/2459059708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa380ceef0 0x7ffa380ccde0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.686+0000 7ffa3ec00640 1 -- 172.21.15.162:0/2459059708 >> 172.21.15.162:0/2459059708 conn(0x7ffa3806a600 msgr2=0x7ffa3806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:23.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.686+0000 7ffa3ec00640 1 -- 172.21.15.162:0/2459059708 shutdown_connections 2024-01-20T11:09:23.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.686+0000 7ffa3ec00640 1 -- 172.21.15.162:0/2459059708 wait complete. 2024-01-20T11:09:23.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.688+0000 7ffa3ec00640 1 Processor -- start 2024-01-20T11:09:23.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.688+0000 7ffa3ec00640 1 -- start start 2024-01-20T11:09:23.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.688+0000 7ffa3ec00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa380cd320 0x7ffa38153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa3ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa38157fa0 0x7ffa380cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa3ec00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa38153c00 0x7ffa380c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa3ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380ca410 con 0x7ffa38157fa0 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa3ec00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380ca6f0 con 0x7ffa38153c00 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa3ec00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380ca9d0 con 0x7ffa380cd320 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa38157fa0 0x7ffa380cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa38157fa0 0x7ffa380cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43646/0 (socket says 172.21.15.162:43646) 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 -- 172.21.15.162:0/1488954275 learned_addr learned my addr 172.21.15.162:0/1488954275 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 -- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa380cd320 msgr2=0x7ffa38153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa3cc00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa38153c00 0x7ffa380c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37e00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa380cd320 0x7ffa38153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa380cd320 0x7ffa38153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 -- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa38153c00 msgr2=0x7ffa380c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:23.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa38153c00 0x7ffa380c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa37400640 1 -- 172.21.15.162:0/1488954275 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20009400 con 0x7ffa38157fa0 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.689+0000 7ffa3cc00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa38153c00 0x7ffa380c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.690+0000 7ffa37400640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa38157fa0 0x7ffa380cbcb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ffa20039040 tx=0x7ffa200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.690+0000 7ffa2fe00640 1 -- 172.21.15.162:0/1488954275 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2003f430 con 0x7ffa38157fa0 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.690+0000 7ffa2fe00640 1 -- 172.21.15.162:0/1488954275 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2003f5b0 con 0x7ffa38157fa0 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.690+0000 7ffa2fe00640 1 -- 172.21.15.162:0/1488954275 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2003f960 con 0x7ffa38157fa0 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.690+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa380cacb0 con 0x7ffa38157fa0 2024-01-20T11:09:23.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.690+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa380cc620 con 0x7ffa38157fa0 2024-01-20T11:09:23.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.691+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3804e970 con 0x7ffa38157fa0 2024-01-20T11:09:23.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.692+0000 7ffa2fe00640 1 -- 172.21.15.162:0/1488954275 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ffa2003d040 con 0x7ffa38157fa0 2024-01-20T11:09:23.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.693+0000 7ffa2fe00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffa1006aed0 0x7ffa1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:23.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.693+0000 7ffa2fe00640 1 -- 172.21.15.162:0/1488954275 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffa200ad910 con 0x7ffa38157fa0 2024-01-20T11:09:23.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.693+0000 7ffa37e00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffa1006aed0 0x7ffa1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:23.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.694+0000 7ffa37e00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffa1006aed0 0x7ffa1006d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffa28007fd0 tx=0x7ffa28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:23.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.697+0000 7ffa2fe00640 1 -- 172.21.15.162:0/1488954275 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ffa20078b20 con 0x7ffa38157fa0 2024-01-20T11:09:23.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:23.891+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ffa380ca550 con 0x7ffa38157fa0 2024-01-20T11:09:24.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.625+0000 7ffa2fe00640 1 -- 172.21.15.162:0/1488954275 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffa380ca550 con 0x7ffa38157fa0 2024-01-20T11:09:24.626 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' created 2024-01-20T11:09:24.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffa1006aed0 msgr2=0x7ffa1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:24.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffa1006aed0 0x7ffa1006d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffa28007fd0 tx=0x7ffa28009040 comp rx=0 tx=0).stop 2024-01-20T11:09:24.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa38157fa0 msgr2=0x7ffa380cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:24.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa38157fa0 0x7ffa380cbcb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ffa20039040 tx=0x7ffa200046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 shutdown_connections 2024-01-20T11:09:24.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffa1006aed0 0x7ffa1006d390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa38153c00 0x7ffa380c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa38157fa0 0x7ffa380cbcb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 --2- 172.21.15.162:0/1488954275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa380cd320 0x7ffa38153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.629+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 >> 172.21.15.162:0/1488954275 conn(0x7ffa3806a600 msgr2=0x7ffa380b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:24.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.630+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 shutdown_connections 2024-01-20T11:09:24.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.630+0000 7ffa3ec00640 1 -- 172.21.15.162:0/1488954275 wait complete. 2024-01-20T11:09:24.656 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T11:09:24.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.856+0000 7f389a600640 1 Processor -- start 2024-01-20T11:09:24.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.856+0000 7f389a600640 1 -- start start 2024-01-20T11:09:24.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.858+0000 7f389a600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38940cefe0 0x7f38940cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.858+0000 7f389a600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940cf970 con 0x7f389406c3b0 2024-01-20T11:09:24.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.858+0000 7f389a600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389406c7f0 con 0x7f389415d5b0 2024-01-20T11:09:24.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.858+0000 7f389a600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38940ae130 con 0x7f38940cefe0 2024-01-20T11:09:24.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.858+0000 7f3892a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f389406c3b0 0x7f38940b2040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51198/0 (socket says 172.21.15.162:51198) 2024-01-20T11:09:24.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.858+0000 7f3892a00640 1 -- 172.21.15.162:0/830042917 learned_addr learned my addr 172.21.15.162:0/830042917 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.858+0000 7f3893e00640 1 --2- 172.21.15.162:0/830042917 >> v2:172.21.15.179:3300/0 conn(0x7f38940cefe0 0x7f38940cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559542572 0 0) 0x7f38940cf970 con 0x7f389406c3b0 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3874003520 con 0x7f389406c3b0 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 497138269 0 0) 0x7f3874003520 con 0x7f389406c3b0 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 >> v2:172.21.15.179:3300/0 conn(0x7f38940cefe0 msgr2=0x7f38940cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 --2- 172.21.15.162:0/830042917 >> v2:172.21.15.179:3300/0 conn(0x7f38940cefe0 0x7f38940cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 >> v1:172.21.15.179:6789/0 conn(0x7f389415d5b0 legacy=0x7f38941618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940ae410 con 0x7f389406c3b0 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f387c001670 con 0x7f389406c3b0 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 >> v1:172.21.15.162:6789/0 conn(0x7f389406c3b0 legacy=0x7f38940b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f3874003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740047c0 0x7f3874004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3874005180 0x7f387400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940ae130 con 0x7f3874003970 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387400c120 con 0x7f38740047c0 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387400c2e0 con 0x7f3874005180 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.859+0000 7f3893400640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f3874003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.860+0000 7f3892a00640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740047c0 0x7f3874004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.860+0000 7f3893400640 1 -- 172.21.15.162:0/830042917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3874005180 msgr2=0x7f387400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.860+0000 7f3893400640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3874005180 0x7f387400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.860+0000 7f3893400640 1 -- 172.21.15.162:0/830042917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740047c0 msgr2=0x7f3874004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.860+0000 7f3893400640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740047c0 0x7f3874004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.860+0000 7f3893400640 1 -- 172.21.15.162:0/830042917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874003520 con 0x7f3874003970 2024-01-20T11:09:24.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.860+0000 7f3893e00640 1 -- 172.21.15.162:0/830042917 reap_dead start 2024-01-20T11:09:24.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.861+0000 7f3893400640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f3874003d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3884001750 tx=0x7f38740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aec8464f01ea386 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:24.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.861+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38840052d0 con 0x7f3874003970 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.861+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388402e050 con 0x7f3874003970 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.861+0000 7f3892000640 1 -- 172.21.15.162:0/830042917 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884003830 con 0x7f3874003970 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.862+0000 7f389a600640 1 -- 172.21.15.162:0/830042917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 msgr2=0x7f3874003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.862+0000 7f389a600640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f3874003d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3884001750 tx=0x7f38740057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.862+0000 7f389a600640 1 -- 172.21.15.162:0/830042917 shutdown_connections 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.862+0000 7f389a600640 1 --2- 172.21.15.162:0/830042917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f3874003d90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.862+0000 7f389a600640 1 -- 172.21.15.162:0/830042917 >> 172.21.15.162:0/830042917 conn(0x7f389406a600 msgr2=0x7f389406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.862+0000 7f389a600640 1 -- 172.21.15.162:0/830042917 shutdown_connections 2024-01-20T11:09:24.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.862+0000 7f389a600640 1 -- 172.21.15.162:0/830042917 wait complete. 2024-01-20T11:09:24.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.864+0000 7f389a600640 1 Processor -- start 2024-01-20T11:09:24.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.864+0000 7f389a600640 1 -- start start 2024-01-20T11:09:24.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f389a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f389415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f389a600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389414d0c0 0x7f3894140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f389a600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3894152690 0x7f3894152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f389a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389415c880 con 0x7f3874003970 2024-01-20T11:09:24.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f389a600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389414d960 con 0x7f389414d0c0 2024-01-20T11:09:24.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f389a600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38941410c0 con 0x7f3894152690 2024-01-20T11:09:24.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f389415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:24.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f389415c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43662/0 (socket says 172.21.15.162:43662) 2024-01-20T11:09:24.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893400640 1 -- 172.21.15.162:0/2580971026 learned_addr learned my addr 172.21.15.162:0/2580971026 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:24.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893e00640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3894152690 0x7f3894152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:24.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3892a00640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389414d0c0 0x7f3894140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:24.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893400640 1 -- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3894152690 msgr2=0x7f3894152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:24.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893400640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3894152690 0x7f3894152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893400640 1 -- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389414d0c0 msgr2=0x7f3894140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:24.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.865+0000 7f3893400640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389414d0c0 0x7f3894140b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:24.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.866+0000 7f3893400640 1 -- 172.21.15.162:0/2580971026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389415db10 con 0x7f3874003970 2024-01-20T11:09:24.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.866+0000 7f3893400640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f389415c340 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3884005040 tx=0x7f3884001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:24.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.866+0000 7f388b400640 1 -- 172.21.15.162:0/2580971026 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38840076c0 con 0x7f3874003970 2024-01-20T11:09:24.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.866+0000 7f388b400640 1 -- 172.21.15.162:0/2580971026 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3884007a30 con 0x7f3874003970 2024-01-20T11:09:24.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.866+0000 7f388b400640 1 -- 172.21.15.162:0/2580971026 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884006c20 con 0x7f3874003970 2024-01-20T11:09:24.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.866+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3894152200 con 0x7f3874003970 2024-01-20T11:09:24.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.866+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941518d0 con 0x7f3874003970 2024-01-20T11:09:24.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.867+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38940ade80 con 0x7f3874003970 2024-01-20T11:09:24.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.869+0000 7f388b400640 1 -- 172.21.15.162:0/2580971026 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f38840035f0 con 0x7f3874003970 2024-01-20T11:09:24.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.869+0000 7f388b400640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f386c06aed0 0x7f386c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:24.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.870+0000 7f388b400640 1 -- 172.21.15.162:0/2580971026 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f38840ab3b0 con 0x7f3874003970 2024-01-20T11:09:24.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.870+0000 7f3892a00640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f386c06aed0 0x7f386c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:24.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.870+0000 7f3892a00640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f386c06aed0 0x7f386c06d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f387c001050 tx=0x7f387c001d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:24.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:24.873+0000 7f388b400640 1 -- 172.21.15.162:0/2580971026 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f38840764d0 con 0x7f3874003970 2024-01-20T11:09:25.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.067+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f389404e970 con 0x7f3874003970 2024-01-20T11:09:25.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.631+0000 7f388b400640 1 -- 172.21.15.162:0/2580971026 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7f38840410d0 con 0x7f3874003970 2024-01-20T11:09:25.632 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' created 2024-01-20T11:09:25.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.635+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f386c06aed0 msgr2=0x7f386c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:25.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.635+0000 7f389a600640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f386c06aed0 0x7f386c06d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f387c001050 tx=0x7f387c001d50 comp rx=0 tx=0).stop 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.635+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 msgr2=0x7f389415c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.635+0000 7f389a600640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f389415c340 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3884005040 tx=0x7f3884001120 comp rx=0 tx=0).stop 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 shutdown_connections 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3894152690 0x7f3894152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f386c06aed0 0x7f386c06d390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389414d0c0 0x7f3894140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 --2- 172.21.15.162:0/2580971026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3874003970 0x7f389415c340 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 >> 172.21.15.162:0/2580971026 conn(0x7f389406a600 msgr2=0x7f389415f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 shutdown_connections 2024-01-20T11:09:25.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.636+0000 7f389a600640 1 -- 172.21.15.162:0/2580971026 wait complete. 2024-01-20T11:09:25.676 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-20T11:09:25.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.861+0000 7f8b1aa00640 1 Processor -- start 2024-01-20T11:09:25.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.861+0000 7f8b1aa00640 1 -- start start 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140ceb50 0x7f8b1415a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b1aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b140cbac0 0x7f8b140cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b1aa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1415b0c0 con 0x7f8b14157830 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b1aa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b140cc490 con 0x7f8b140cbac0 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1415a5d0 con 0x7f8b140ceb50 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b18a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b140cbac0 0x7f8b140cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b13e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8b14157830 0x7f8b140b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:51202/0 (socket says 172.21.15.162:51202) 2024-01-20T11:09:25.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.863+0000 7f8b13e00640 1 -- 172.21.15.162:0/2268267024 learned_addr learned my addr 172.21.15.162:0/2268267024 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:25.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.864+0000 7f8b0b200640 1 --2- 172.21.15.162:0/2268267024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140ceb50 0x7f8b1415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:25.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.864+0000 7f8b13400640 1 -- 172.21.15.162:0/2268267024 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594246243 0 0) 0x7f8b1415b0c0 con 0x7f8b14157830 2024-01-20T11:09:25.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.864+0000 7f8b13400640 1 -- 172.21.15.162:0/2268267024 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af4005730 con 0x7f8b14157830 2024-01-20T11:09:25.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.864+0000 7f8b18a00640 1 -- 172.21.15.162:0/2268267024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140ceb50 msgr2=0x7f8b1415a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:25.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.864+0000 7f8b18a00640 1 --2- 172.21.15.162:0/2268267024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140ceb50 0x7f8b1415a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.864+0000 7f8b18a00640 1 -- 172.21.15.162:0/2268267024 >> v1:172.21.15.162:6789/0 conn(0x7f8b14157830 legacy=0x7f8b140b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:25.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.864+0000 7f8b18a00640 1 -- 172.21.15.162:0/2268267024 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1406c3b0 con 0x7f8b140cbac0 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b18a00640 1 --2- 172.21.15.162:0/2268267024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140cbac0 0x7f8b140cbf50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009d90 tx=0x7f8b0c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9fc7f2698445fb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b13400640 1 -- 172.21.15.162:0/2268267024 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c02cc50 con 0x7f8b140cbac0 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b13400640 1 -- 172.21.15.162:0/2268267024 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c02cdb0 con 0x7f8b140cbac0 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b13400640 1 -- 172.21.15.162:0/2268267024 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c034660 con 0x7f8b140cbac0 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2268267024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140cbac0 msgr2=0x7f8b140cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2268267024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140cbac0 0x7f8b140cbf50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009d90 tx=0x7f8b0c02bea0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2268267024 shutdown_connections 2024-01-20T11:09:25.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2268267024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140ceb50 0x7f8b1415a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2268267024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140cbac0 0x7f8b140cbf50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.866+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2268267024 >> 172.21.15.162:0/2268267024 conn(0x7f8b1406a600 msgr2=0x7f8b1406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:25.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.867+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2268267024 shutdown_connections 2024-01-20T11:09:25.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.867+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2268267024 wait complete. 2024-01-20T11:09:25.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.868+0000 7f8b1aa00640 1 Processor -- start 2024-01-20T11:09:25.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.869+0000 7f8b1aa00640 1 -- start start 2024-01-20T11:09:25.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.869+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140cbac0 0x7f8b140b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:25.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.869+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140ceb50 0x7f8b1414be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:25.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b14157830 0x7f8b140ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:25.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b141532c0 con 0x7f8b140ceb50 2024-01-20T11:09:25.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b141535a0 con 0x7f8b14157830 2024-01-20T11:09:25.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14153880 con 0x7f8b140cbac0 2024-01-20T11:09:25.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140ceb50 0x7f8b1414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:25.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140ceb50 0x7f8b1414be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43670/0 (socket says 172.21.15.162:43670) 2024-01-20T11:09:25.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 -- 172.21.15.162:0/2490671584 learned_addr learned my addr 172.21.15.162:0/2490671584 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:25.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 -- 172.21.15.162:0/2490671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140cbac0 msgr2=0x7f8b140b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:25.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140cbac0 0x7f8b140b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 -- 172.21.15.162:0/2490671584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b14157830 msgr2=0x7f8b140ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:25.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b14157830 0x7f8b140ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:25.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.870+0000 7f8b0b200640 1 -- 172.21.15.162:0/2490671584 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c009a70 con 0x7f8b140ceb50 2024-01-20T11:09:25.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.871+0000 7f8b0b200640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140ceb50 0x7f8b1414be70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00e980 tx=0x7f8afc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:25.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.871+0000 7f8b10c00640 1 -- 172.21.15.162:0/2490671584 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc009670 con 0x7f8b140ceb50 2024-01-20T11:09:25.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.871+0000 7f8b10c00640 1 -- 172.21.15.162:0/2490671584 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00ca00 con 0x7f8b140ceb50 2024-01-20T11:09:25.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.871+0000 7f8b10c00640 1 -- 172.21.15.162:0/2490671584 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00cd90 con 0x7f8b140ceb50 2024-01-20T11:09:25.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.871+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b14153b60 con 0x7f8b140ceb50 2024-01-20T11:09:25.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.871+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b14152f70 con 0x7f8b140ceb50 2024-01-20T11:09:25.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.872+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1404e970 con 0x7f8b140ceb50 2024-01-20T11:09:25.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.873+0000 7f8b10c00640 1 -- 172.21.15.162:0/2490671584 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8afc013470 con 0x7f8b140ceb50 2024-01-20T11:09:25.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.874+0000 7f8b10c00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8aec06aed0 0x7f8aec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:25.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.874+0000 7f8b10c00640 1 -- 172.21.15.162:0/2490671584 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8afc089920 con 0x7f8b140ceb50 2024-01-20T11:09:25.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.875+0000 7f8b13e00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8aec06aed0 0x7f8aec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:25.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.875+0000 7f8b13e00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8aec06aed0 0x7f8aec06d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b04000f60 tx=0x7f8b040078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:25.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:25.879+0000 7f8b10c00640 1 -- 172.21.15.162:0/2490671584 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8afc0547b0 con 0x7f8b140ceb50 2024-01-20T11:09:26.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.110+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8b14150570 con 0x7f8b140ceb50 2024-01-20T11:09:26.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.671+0000 7f8b10c00640 1 -- 172.21.15.162:0/2490671584 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8afc0170c0 con 0x7f8b140ceb50 2024-01-20T11:09:26.672 INFO:teuthology.orchestra.run.smithi162.stderr:new fs with metadata pool 6 and data pool 7 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.676+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8aec06aed0 msgr2=0x7f8aec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.676+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8aec06aed0 0x7f8aec06d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b04000f60 tx=0x7f8b040078f0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.676+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140ceb50 msgr2=0x7f8b1414be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.676+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140ceb50 0x7f8b1414be70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00e980 tx=0x7f8afc00ee40 comp rx=0 tx=0).stop 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.677+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 shutdown_connections 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.677+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f8aec06aed0 0x7f8aec06d390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.677+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b14157830 0x7f8b140ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.677+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140ceb50 0x7f8b1414be70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.677+0000 7f8b1aa00640 1 --2- 172.21.15.162:0/2490671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b140cbac0 0x7f8b140b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.677+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 >> 172.21.15.162:0/2490671584 conn(0x7f8b1406a600 msgr2=0x7f8b140b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:26.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.678+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 shutdown_connections 2024-01-20T11:09:26.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.680+0000 7f8b1aa00640 1 -- 172.21.15.162:0/2490671584 wait complete. 2024-01-20T11:09:26.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:26.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.891+0000 7f1387000640 1 Processor -- start 2024-01-20T11:09:26.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.891+0000 7f1387000640 1 -- start start 2024-01-20T11:09:26.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.893+0000 7f1387000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f138015b300 0x7f13800ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.893+0000 7f1387000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 0x7f13800c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.893+0000 7f1387000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138015b6e0 con 0x7f1380161240 2024-01-20T11:09:26.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.893+0000 7f1387000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13800c8d10 con 0x7f138015b300 2024-01-20T11:09:26.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.893+0000 7f1387000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13800ce580 con 0x7f13800c8350 2024-01-20T11:09:26.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.893+0000 7f1385000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1380161240 0x7f13801616d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:34156/0 (socket says 172.21.15.162:34156) 2024-01-20T11:09:26.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.893+0000 7f1385000640 1 -- 172.21.15.162:0/2687385125 learned_addr learned my addr 172.21.15.162:0/2687385125 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:26.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137fe00640 1 --2- 172.21.15.162:0/2687385125 >> v2:172.21.15.179:3300/0 conn(0x7f138015b300 0x7f13800ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f1377200640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 0x7f13800c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207982032 0 0) 0x7f138015b6e0 con 0x7f1380161240 2024-01-20T11:09:26.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1360003520 con 0x7f1380161240 2024-01-20T11:09:26.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134946314 0 0) 0x7f1360003520 con 0x7f1380161240 2024-01-20T11:09:26.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 msgr2=0x7f13800c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:26.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 0x7f13800c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 >> v2:172.21.15.179:3300/0 conn(0x7f138015b300 msgr2=0x7f13800ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 --2- 172.21.15.162:0/2687385125 >> v2:172.21.15.179:3300/0 conn(0x7f138015b300 0x7f13800ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800cd6d0 con 0x7f1380161240 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f13780019f0 con 0x7f1380161240 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 >> v1:172.21.15.162:6789/0 conn(0x7f1380161240 legacy=0x7f13801616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 0x7f1360003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1360003f40 0x7f13600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360004d00 0x7f1360005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800c8d10 con 0x7f1360003f40 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800ce580 con 0x7f1360004d00 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.894+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136000b980 con 0x7f13800c8350 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1377200640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1360003f40 0x7f13600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f137fe00640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 0x7f1360003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1385000640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360004d00 0x7f1360005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1377200640 1 -- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 msgr2=0x7f1360003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:26.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1377200640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 0x7f1360003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1377200640 1 -- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360004d00 msgr2=0x7f1360005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:26.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1377200640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360004d00 0x7f1360005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1377200640 1 -- 172.21.15.162:0/2687385125 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360003520 con 0x7f1360003f40 2024-01-20T11:09:26.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f1385000640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360004d00 0x7f1360005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:26.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.895+0000 7f137fe00640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800c8350 0x7f1360003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:26.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.896+0000 7f1377200640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1360003f40 0x7f13600047c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1368009af0 tx=0x7f13600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cda6bc39c49d880 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:26.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.896+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136802c6b0 con 0x7f1360003f40 2024-01-20T11:09:26.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136802c810 con 0x7f1360003f40 2024-01-20T11:09:26.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f137f400640 1 -- 172.21.15.162:0/2687385125 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136802cba0 con 0x7f1360003f40 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f1387000640 1 -- 172.21.15.162:0/2687385125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1360003f40 msgr2=0x7f13600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f1387000640 1 --2- 172.21.15.162:0/2687385125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1360003f40 0x7f13600047c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1368009af0 tx=0x7f13600057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f1385000640 1 -- 172.21.15.162:0/2687385125 reap_dead start 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f1387000640 1 -- 172.21.15.162:0/2687385125 shutdown_connections 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f1387000640 1 -- 172.21.15.162:0/2687385125 >> 172.21.15.162:0/2687385125 conn(0x7f13800b0cd0 msgr2=0x7f13800b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f1387000640 1 -- 172.21.15.162:0/2687385125 shutdown_connections 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.897+0000 7f1387000640 1 -- 172.21.15.162:0/2687385125 wait complete. 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.899+0000 7f1387000640 1 Processor -- start 2024-01-20T11:09:26.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.899+0000 7f1387000640 1 -- start start 2024-01-20T11:09:26.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1387000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360003f40 0x7f13801569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1387000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1380160b40 0x7f138014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1387000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801f3680 0x7f138015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1387000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138009c910 con 0x7f1380160b40 2024-01-20T11:09:26.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1387000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800afa40 con 0x7f1360003f40 2024-01-20T11:09:26.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1387000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13800aeea0 con 0x7f13801f3680 2024-01-20T11:09:26.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1377200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1380160b40 0x7f138014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1377200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1380160b40 0x7f138014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42614/0 (socket says 172.21.15.162:42614) 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.900+0000 7f1377200640 1 -- 172.21.15.162:0/1940648363 learned_addr learned my addr 172.21.15.162:0/1940648363 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f1385000640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801f3680 0x7f138015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f137fe00640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360003f40 0x7f13801569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f1377200640 1 -- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801f3680 msgr2=0x7f138015fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f1377200640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801f3680 0x7f138015fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f1377200640 1 -- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360003f40 msgr2=0x7f13801569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f1377200640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360003f40 0x7f13801569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f1377200640 1 -- 172.21.15.162:0/1940648363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800af110 con 0x7f1380160b40 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f137fe00640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360003f40 0x7f13801569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f1377200640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1380160b40 0x7f138014c9a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1368009af0 tx=0x7f1368004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.901+0000 7f137cc00640 1 -- 172.21.15.162:0/1940648363 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368003810 con 0x7f1380160b40 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.902+0000 7f137cc00640 1 -- 172.21.15.162:0/1940648363 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368003970 con 0x7f1380160b40 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.902+0000 7f137cc00640 1 -- 172.21.15.162:0/1940648363 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368003d00 con 0x7f1380160b40 2024-01-20T11:09:26.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.902+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13800af3f0 con 0x7f1380160b40 2024-01-20T11:09:26.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.902+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1380160fc0 con 0x7f1380160b40 2024-01-20T11:09:26.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.903+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138004e970 con 0x7f1380160b40 2024-01-20T11:09:26.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.904+0000 7f137cc00640 1 -- 172.21.15.162:0/1940648363 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1368040450 con 0x7f1380160b40 2024-01-20T11:09:26.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.905+0000 7f137cc00640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f135806aed0 0x7f135806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:26.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.905+0000 7f137cc00640 1 -- 172.21.15.162:0/1940648363 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13680ab460 con 0x7f1380160b40 2024-01-20T11:09:26.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.905+0000 7f137fe00640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f135806aed0 0x7f135806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:26.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.906+0000 7f137fe00640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f135806aed0 0x7f135806d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1370009b20 tx=0x7f1370008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:26.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:26.909+0000 7f137cc00640 1 -- 172.21.15.162:0/1940648363 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1368076310 con 0x7f1380160b40 2024-01-20T11:09:27.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.103+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13800afb80 con 0x7f1380160b40 2024-01-20T11:09:27.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.106+0000 7f137cc00640 1 -- 172.21.15.162:0/1940648363 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16551 (secure 0 0 0) 0x7f136807ee60 con 0x7f1380160b40 2024-01-20T11:09:27.107 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:27.107 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":46,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:26.112075+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:09:23.943994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-20T11:09:25.120343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f135806aed0 msgr2=0x7f135806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f135806aed0 0x7f135806d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1370009b20 tx=0x7f1370008040 comp rx=0 tx=0).stop 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1380160b40 msgr2=0x7f138014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1380160b40 0x7f138014c9a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1368009af0 tx=0x7f1368004730 comp rx=0 tx=0).stop 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 shutdown_connections 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801f3680 0x7f138015fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1380160b40 0x7f138014c9a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f135806aed0 0x7f135806d390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 --2- 172.21.15.162:0/1940648363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1360003f40 0x7f13801569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.108+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 >> 172.21.15.162:0/1940648363 conn(0x7f13800b0cd0 msgr2=0x7f138015e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:27.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.109+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 shutdown_connections 2024-01-20T11:09:27.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.109+0000 7f1387000640 1 -- 172.21.15.162:0/1940648363 wait complete. 2024-01-20T11:09:27.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:27.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.338+0000 7f90ba200640 1 Processor -- start 2024-01-20T11:09:27.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.338+0000 7f90ba200640 1 -- start start 2024-01-20T11:09:27.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.339+0000 7f90ba200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90b4155a30 0x7f90b40ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.339+0000 7f90ba200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f90b40ae6b0 0x7f90b406c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90ba200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b4070b60 con 0x7f90b4070630 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90ba200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b415ba10 con 0x7f90b40ae6b0 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90ba200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b415bc00 con 0x7f90b4155a30 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90b3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f90b40ae6b0 0x7f90b406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90b3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f90b40ae6b0 0x7f90b406c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42624/0 (socket says 172.21.15.162:42624) 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90aa800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f90b4070630 0x7f90b40adfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:34170/0 (socket says 172.21.15.162:34170) 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90b3e00640 1 -- 172.21.15.162:0/2200221077 learned_addr learned my addr 172.21.15.162:0/2200221077 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90b3400640 1 --2- 172.21.15.162:0/2200221077 >> v2:172.21.15.179:3300/0 conn(0x7f90b4155a30 0x7f90b40ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90b3e00640 1 -- 172.21.15.162:0/2200221077 >> v2:172.21.15.179:3300/0 conn(0x7f90b4155a30 msgr2=0x7f90b40ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:27.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90b3e00640 1 --2- 172.21.15.162:0/2200221077 >> v2:172.21.15.179:3300/0 conn(0x7f90b4155a30 0x7f90b40ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.340+0000 7f90b3e00640 1 -- 172.21.15.162:0/2200221077 >> v1:172.21.15.162:6789/0 conn(0x7f90b4070630 legacy=0x7f90b40adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.341+0000 7f90b3e00640 1 -- 172.21.15.162:0/2200221077 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b415bee0 con 0x7f90b40ae6b0 2024-01-20T11:09:27.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.342+0000 7f90b3e00640 1 --2- 172.21.15.162:0/2200221077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b40ae6b0 0x7f90b406c690 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f90b40ccb20 tx=0x7f90ac02b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9a340e5939444a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:27.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.342+0000 7f90b2a00640 1 -- 172.21.15.162:0/2200221077 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac030710 con 0x7f90b40ae6b0 2024-01-20T11:09:27.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.342+0000 7f90b2a00640 1 -- 172.21.15.162:0/2200221077 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac02e050 con 0x7f90b40ae6b0 2024-01-20T11:09:27.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.342+0000 7f90b2a00640 1 -- 172.21.15.162:0/2200221077 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac030a90 con 0x7f90b40ae6b0 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 -- 172.21.15.162:0/2200221077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b40ae6b0 msgr2=0x7f90b406c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 --2- 172.21.15.162:0/2200221077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b40ae6b0 0x7f90b406c690 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f90b40ccb20 tx=0x7f90ac02b760 comp rx=0 tx=0).stop 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 -- 172.21.15.162:0/2200221077 shutdown_connections 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 --2- 172.21.15.162:0/2200221077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b40ae6b0 0x7f90b406c690 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 --2- 172.21.15.162:0/2200221077 >> v2:172.21.15.179:3300/0 conn(0x7f90b4155a30 0x7f90b40ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 -- 172.21.15.162:0/2200221077 >> 172.21.15.162:0/2200221077 conn(0x7f90b40b0cd0 msgr2=0x7f90b40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 -- 172.21.15.162:0/2200221077 shutdown_connections 2024-01-20T11:09:27.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.343+0000 7f90ba200640 1 -- 172.21.15.162:0/2200221077 wait complete. 2024-01-20T11:09:27.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.345+0000 7f90ba200640 1 Processor -- start 2024-01-20T11:09:27.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.345+0000 7f90ba200640 1 -- start start 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90ba200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b4070630 0x7f90b40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90ba200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40ae6b0 0x7f90b41f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90ba200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b4155a30 0x7f90b4148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90ba200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41f1810 con 0x7f90b4070630 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90ba200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40b4ec0 con 0x7f90b40ae6b0 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90ba200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b409b220 con 0x7f90b4155a30 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90b3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b4070630 0x7f90b40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90b3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b4070630 0x7f90b40b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42640/0 (socket says 172.21.15.162:42640) 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.346+0000 7f90b3400640 1 -- 172.21.15.162:0/3353607718 learned_addr learned my addr 172.21.15.162:0/3353607718 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:27.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90b3e00640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b4155a30 0x7f90b4148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90aa800640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40ae6b0 0x7f90b41f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90b3400640 1 -- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b4155a30 msgr2=0x7f90b4148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90b3400640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b4155a30 0x7f90b4148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90b3400640 1 -- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40ae6b0 msgr2=0x7f90b41f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90b3400640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40ae6b0 0x7f90b41f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90b3400640 1 -- 172.21.15.162:0/3353607718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0094d0 con 0x7f90b4070630 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90aa800640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40ae6b0 0x7f90b41f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90b3400640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b4070630 0x7f90b40b1d90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f90a4007ef0 tx=0x7f90a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90abe00640 1 -- 172.21.15.162:0/3353607718 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4014620 con 0x7f90b4070630 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90abe00640 1 -- 172.21.15.162:0/3353607718 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a4014780 con 0x7f90b4070630 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90abe00640 1 -- 172.21.15.162:0/3353607718 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4014b30 con 0x7f90b4070630 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b409b500 con 0x7f90b4070630 2024-01-20T11:09:27.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.347+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b409bac0 con 0x7f90b4070630 2024-01-20T11:09:27.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.349+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b409bc80 con 0x7f90b4070630 2024-01-20T11:09:27.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.349+0000 7f90abe00640 1 -- 172.21.15.162:0/3353607718 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f90a4014c90 con 0x7f90b4070630 2024-01-20T11:09:27.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.350+0000 7f90abe00640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f908c06af20 0x7f908c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.350+0000 7f90abe00640 1 -- 172.21.15.162:0/3353607718 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90a4089fe0 con 0x7f90b4070630 2024-01-20T11:09:27.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.351+0000 7f90aa800640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f908c06af20 0x7f908c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.351+0000 7f90aa800640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f908c06af20 0x7f908c06d3e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b22d0 tx=0x7f909c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:27.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.354+0000 7f90abe00640 1 -- 172.21.15.162:0/3353607718 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f90a40bd0d0 con 0x7f90b4070630 2024-01-20T11:09:27.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.548+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90b404e970 con 0x7f90b4070630 2024-01-20T11:09:27.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.551+0000 7f90abe00640 1 -- 172.21.15.162:0/3353607718 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16551 (secure 0 0 0) 0x7f90a4054ef0 con 0x7f90b4070630 2024-01-20T11:09:27.552 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:27.552 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":46,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:26.112075+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:09:23.943994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-20T11:09:25.120343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:27.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f908c06af20 msgr2=0x7f908c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f908c06af20 0x7f908c06d3e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b22d0 tx=0x7f909c009040 comp rx=0 tx=0).stop 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b4070630 msgr2=0x7f90b40b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b4070630 0x7f90b40b1d90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f90a4007ef0 tx=0x7f90a400e4b0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 shutdown_connections 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b4155a30 0x7f90b4148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f908c06af20 0x7f908c06d3e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40ae6b0 0x7f90b41f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 --2- 172.21.15.162:0/3353607718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b4070630 0x7f90b40b1d90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 >> 172.21.15.162:0/3353607718 conn(0x7f90b40b0cd0 msgr2=0x7f90b40aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 shutdown_connections 2024-01-20T11:09:27.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.554+0000 7f90ba200640 1 -- 172.21.15.162:0/3353607718 wait complete. 2024-01-20T11:09:27.574 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-20T11:09:27.590 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:09:27.622 INFO:tasks.ceph.mds.b.smithi179.stderr:2024-01-20T11:09:27.622+0000 7f2005e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T11:09:27.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:09:27.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.785+0000 7ff70b000640 1 Processor -- start 2024-01-20T11:09:27.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.785+0000 7ff70b000640 1 -- start start 2024-01-20T11:09:27.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff70b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7040cf770 0x7ff70415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff70b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040b2ec0 con 0x7ff70415a380 2024-01-20T11:09:27.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff70b000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040ce700 con 0x7ff7040b2040 2024-01-20T11:09:27.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff70b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff704070eb0 con 0x7ff7040cf770 2024-01-20T11:09:27.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff709000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7040cf770 0x7ff70415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff703e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff70415a380 0x7ff7040707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:34180/0 (socket says 172.21.15.162:34180) 2024-01-20T11:09:27.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff709000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7040cf770 0x7ff70415e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42644/0 (socket says 172.21.15.162:42644) 2024-01-20T11:09:27.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff703e00640 1 -- 172.21.15.162:0/2508142452 learned_addr learned my addr 172.21.15.162:0/2508142452 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:27.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff709000640 1 -- 172.21.15.162:0/2508142452 >> v1:172.21.15.179:6789/0 conn(0x7ff7040b2040 legacy=0x7ff7040cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:27.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff709000640 1 -- 172.21.15.162:0/2508142452 >> v1:172.21.15.162:6789/0 conn(0x7ff70415a380 legacy=0x7ff7040707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.787+0000 7ff702a00640 1 -- 172.21.15.162:0/2508142452 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327765637 0 0) 0x7ff6f4001490 con 0x7ff70415a380 2024-01-20T11:09:27.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.788+0000 7ff709000640 1 -- 172.21.15.162:0/2508142452 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040b2590 con 0x7ff7040cf770 2024-01-20T11:09:27.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff709000640 1 --2- 172.21.15.162:0/2508142452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040cf770 0x7ff70415e8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0097a0 tx=0x7ff6fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee8cbad8f8758d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:27.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff702a00640 1 -- 172.21.15.162:0/2508142452 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc02e070 con 0x7ff7040cf770 2024-01-20T11:09:27.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff702a00640 1 -- 172.21.15.162:0/2508142452 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc0315a0 con 0x7ff7040cf770 2024-01-20T11:09:27.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff702a00640 1 -- 172.21.15.162:0/2508142452 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc031930 con 0x7ff7040cf770 2024-01-20T11:09:27.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff70b000640 1 -- 172.21.15.162:0/2508142452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040cf770 msgr2=0x7ff70415e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff70b000640 1 --2- 172.21.15.162:0/2508142452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040cf770 0x7ff70415e8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0097a0 tx=0x7ff6fc02b840 comp rx=0 tx=0).stop 2024-01-20T11:09:27.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff70b000640 1 -- 172.21.15.162:0/2508142452 shutdown_connections 2024-01-20T11:09:27.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff70b000640 1 --2- 172.21.15.162:0/2508142452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040cf770 0x7ff70415e8f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff70b000640 1 -- 172.21.15.162:0/2508142452 >> 172.21.15.162:0/2508142452 conn(0x7ff70406a600 msgr2=0x7ff70406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:27.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.789+0000 7ff70b000640 1 -- 172.21.15.162:0/2508142452 shutdown_connections 2024-01-20T11:09:27.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.790+0000 7ff70b000640 1 -- 172.21.15.162:0/2508142452 wait complete. 2024-01-20T11:09:27.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.791+0000 7ff70b000640 1 Processor -- start 2024-01-20T11:09:27.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.791+0000 7ff70b000640 1 -- start start 2024-01-20T11:09:27.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.792+0000 7ff70b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040b2040 0x7ff7040aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.792+0000 7ff70b000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7040cf770 0x7ff7041f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.792+0000 7ff70b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70415a380 0x7ff7041449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.792+0000 7ff70b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040af1f0 con 0x7ff7040b2040 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.792+0000 7ff70b000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7041f59a0 con 0x7ff7040cf770 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.792+0000 7ff70b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040afc80 con 0x7ff70415a380 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040b2040 0x7ff7040aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040b2040 0x7ff7040aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42660/0 (socket says 172.21.15.162:42660) 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 -- 172.21.15.162:0/3297367352 learned_addr learned my addr 172.21.15.162:0/3297367352 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 -- 172.21.15.162:0/3297367352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70415a380 msgr2=0x7ff7041449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70415a380 0x7ff7041449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 -- 172.21.15.162:0/3297367352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7040cf770 msgr2=0x7ff7041f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7040cf770 0x7ff7041f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 -- 172.21.15.162:0/3297367352 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc009400 con 0x7ff7040b2040 2024-01-20T11:09:27.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.793+0000 7ff703e00640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040b2040 0x7ff7040aecb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400c7c0 tx=0x7ff6f400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:27.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.794+0000 7ff6fbe00640 1 -- 172.21.15.162:0/3297367352 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400a640 con 0x7ff7040b2040 2024-01-20T11:09:27.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.794+0000 7ff6fbe00640 1 -- 172.21.15.162:0/3297367352 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400a7c0 con 0x7ff7040b2040 2024-01-20T11:09:27.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.794+0000 7ff6fbe00640 1 -- 172.21.15.162:0/3297367352 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400ab70 con 0x7ff7040b2040 2024-01-20T11:09:27.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.794+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040af3e0 con 0x7ff7040b2040 2024-01-20T11:09:27.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.794+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7040af9a0 con 0x7ff7040b2040 2024-01-20T11:09:27.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.795+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70404e970 con 0x7ff7040b2040 2024-01-20T11:09:27.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.796+0000 7ff6fbe00640 1 -- 172.21.15.162:0/3297367352 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff6f400acd0 con 0x7ff7040b2040 2024-01-20T11:09:27.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.797+0000 7ff6fbe00640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff6dc06aed0 0x7ff6dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:27.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.797+0000 7ff6fbe00640 1 -- 172.21.15.162:0/3297367352 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6f4088a30 con 0x7ff7040b2040 2024-01-20T11:09:27.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.797+0000 7ff703400640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff6dc06aed0 0x7ff6dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:27.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.798+0000 7ff703400640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff6dc06aed0 0x7ff6dc06d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff7041459b0 tx=0x7ff6ec0079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:27.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:27.801+0000 7ff6fbe00640 1 -- 172.21.15.162:0/3297367352 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff6f40538f0 con 0x7ff7040b2040 2024-01-20T11:09:28.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.032+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff7040b2ec0 con 0x7ff7040b2040 2024-01-20T11:09:28.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.685+0000 7ff6fbe00640 1 -- 172.21.15.162:0/3297367352 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff7040b2ec0 con 0x7ff7040b2040 2024-01-20T11:09:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff6dc06aed0 msgr2=0x7ff6dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff6dc06aed0 0x7ff6dc06d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff7041459b0 tx=0x7ff6ec0079b0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040b2040 msgr2=0x7ff7040aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:28.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040b2040 0x7ff7040aecb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400c7c0 tx=0x7ff6f400cc80 comp rx=0 tx=0).stop 2024-01-20T11:09:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 shutdown_connections 2024-01-20T11:09:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70415a380 0x7ff7041449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ff6dc06aed0 0x7ff6dc06d390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7040cf770 0x7ff7041f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 --2- 172.21.15.162:0/3297367352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7040b2040 0x7ff7040aecb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 >> 172.21.15.162:0/3297367352 conn(0x7ff70406a600 msgr2=0x7ff704071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:28.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 shutdown_connections 2024-01-20T11:09:28.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.689+0000 7ff70b000640 1 -- 172.21.15.162:0/3297367352 wait complete. 2024-01-20T11:09:28.711 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T11:09:28.711 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-20T11:09:28.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.922+0000 7f125fc00640 1 Processor -- start 2024-01-20T11:09:28.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.922+0000 7f125fc00640 1 -- start start 2024-01-20T11:09:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.923+0000 7f125fc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1258141bb0 0x7f12580ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.923+0000 7f125fc00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12580ce6a0 0x7f125806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125fc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580cee70 con 0x7f12580cdc30 2024-01-20T11:09:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125fc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12580cd7a0 con 0x7f1258141bb0 2024-01-20T11:09:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125fc00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12580ceb90 con 0x7f12580ce6a0 2024-01-20T11:09:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125d200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1258141bb0 0x7f12580ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125d200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1258141bb0 0x7f12580ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42662/0 (socket says 172.21.15.162:42662) 2024-01-20T11:09:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125d200640 1 -- 172.21.15.162:0/3489698255 learned_addr learned my addr 172.21.15.162:0/3489698255 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125dc00640 1 --1- 172.21.15.162:0/3489698255 >> v1:172.21.15.162:6789/0 conn(0x7f12580cdc30 0x7f125815f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:34188/0 (socket says 172.21.15.162:34188) 2024-01-20T11:09:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f124fc00640 1 --2- 172.21.15.162:0/3489698255 >> v2:172.21.15.179:3300/0 conn(0x7f12580ce6a0 0x7f125806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125d200640 1 -- 172.21.15.162:0/3489698255 >> v2:172.21.15.179:3300/0 conn(0x7f12580ce6a0 msgr2=0x7f125806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125d200640 1 --2- 172.21.15.162:0/3489698255 >> v2:172.21.15.179:3300/0 conn(0x7f12580ce6a0 0x7f125806c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.924+0000 7f125d200640 1 -- 172.21.15.162:0/3489698255 >> v1:172.21.15.162:6789/0 conn(0x7f12580cdc30 legacy=0x7f125815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.925+0000 7f125d200640 1 -- 172.21.15.162:0/3489698255 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580cd150 con 0x7f1258141bb0 2024-01-20T11:09:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.925+0000 7f1257e00640 1 -- 172.21.15.162:0/3489698255 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513437674 0 0) 0x7f1250001110 con 0x7f12580cdc30 2024-01-20T11:09:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.926+0000 7f125d200640 1 --2- 172.21.15.162:0/3489698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258141bb0 0x7f12580ce160 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f125806e8c0 tx=0x7f124802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da4ebdd765fed2e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.926+0000 7f1257e00640 1 -- 172.21.15.162:0/3489698255 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124802ca80 con 0x7f1258141bb0 2024-01-20T11:09:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.926+0000 7f1257e00640 1 -- 172.21.15.162:0/3489698255 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124802cbe0 con 0x7f1258141bb0 2024-01-20T11:09:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.926+0000 7f1257e00640 1 -- 172.21.15.162:0/3489698255 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480343f0 con 0x7f1258141bb0 2024-01-20T11:09:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 -- 172.21.15.162:0/3489698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258141bb0 msgr2=0x7f12580ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 --2- 172.21.15.162:0/3489698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258141bb0 0x7f12580ce160 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f125806e8c0 tx=0x7f124802bee0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 -- 172.21.15.162:0/3489698255 shutdown_connections 2024-01-20T11:09:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 --2- 172.21.15.162:0/3489698255 >> v2:172.21.15.179:3300/0 conn(0x7f12580ce6a0 0x7f125806c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 --2- 172.21.15.162:0/3489698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258141bb0 0x7f12580ce160 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 -- 172.21.15.162:0/3489698255 >> 172.21.15.162:0/3489698255 conn(0x7f125806a600 msgr2=0x7f125806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 -- 172.21.15.162:0/3489698255 shutdown_connections 2024-01-20T11:09:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.927+0000 7f125fc00640 1 -- 172.21.15.162:0/3489698255 wait complete. 2024-01-20T11:09:28.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.929+0000 7f125fc00640 1 Processor -- start 2024-01-20T11:09:28.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.929+0000 7f125fc00640 1 -- start start 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125fc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12580cdc30 0x7f1258143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12580ce6a0 0x7f12581f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125fc00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1258141bb0 0x7f12581f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125fc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12581f3100 con 0x7f12580ce6a0 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125fc00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b0920 con 0x7f1258141bb0 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125fc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580af880 con 0x7f12580cdc30 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12580ce6a0 0x7f12581f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12580ce6a0 0x7f12581f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42676/0 (socket says 172.21.15.162:42676) 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 -- 172.21.15.162:0/2144563912 learned_addr learned my addr 172.21.15.162:0/2144563912 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:28.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125d200640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12580cdc30 0x7f1258143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125dc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1258141bb0 0x7f12581f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 -- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12580cdc30 msgr2=0x7f1258143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12580cdc30 0x7f1258143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 -- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1258141bb0 msgr2=0x7f12581f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1258141bb0 0x7f12581f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f124fc00640 1 -- 172.21.15.162:0/2144563912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248009b30 con 0x7f12580ce6a0 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.930+0000 7f125dc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1258141bb0 0x7f12581f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.931+0000 7f124fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12580ce6a0 0x7f12581f2680 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f124000d800 tx=0x7f124000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:28.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.931+0000 7f1255600640 1 -- 172.21.15.162:0/2144563912 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124000b6c0 con 0x7f12580ce6a0 2024-01-20T11:09:28.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.931+0000 7f1255600640 1 -- 172.21.15.162:0/2144563912 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124000b820 con 0x7f12580ce6a0 2024-01-20T11:09:28.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.931+0000 7f1255600640 1 -- 172.21.15.162:0/2144563912 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124000bbb0 con 0x7f12580ce6a0 2024-01-20T11:09:28.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.931+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12580afb60 con 0x7f12580ce6a0 2024-01-20T11:09:28.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.931+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12580b0120 con 0x7f12580ce6a0 2024-01-20T11:09:28.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.932+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125804e970 con 0x7f12580ce6a0 2024-01-20T11:09:28.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.933+0000 7f1255600640 1 -- 172.21.15.162:0/2144563912 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f124000bd10 con 0x7f12580ce6a0 2024-01-20T11:09:28.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.935+0000 7f1255600640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f123006aed0 0x7f123006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:28.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.935+0000 7f1255600640 1 -- 172.21.15.162:0/2144563912 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1240089bb0 con 0x7f12580ce6a0 2024-01-20T11:09:28.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.935+0000 7f125d200640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f123006aed0 0x7f123006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:28.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.936+0000 7f125d200640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f123006aed0 0x7f123006d390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1248035000 tx=0x7f1248030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:28.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:28.939+0000 7f1255600640 1 -- 172.21.15.162:0/2144563912 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1240054ab0 con 0x7f12580ce6a0 2024-01-20T11:09:29.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.171+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f125815b720 con 0x7f12580ce6a0 2024-01-20T11:09:29.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.688+0000 7f1255600640 1 -- 172.21.15.162:0/2144563912 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f12400580d0 con 0x7f12580ce6a0 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f123006aed0 msgr2=0x7f123006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f123006aed0 0x7f123006d390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1248035000 tx=0x7f1248030000 comp rx=0 tx=0).stop 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12580ce6a0 msgr2=0x7f12581f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12580ce6a0 0x7f12581f2680 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f124000d800 tx=0x7f124000dcc0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 shutdown_connections 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f123006aed0 0x7f123006d390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1258141bb0 0x7f12581f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12580ce6a0 0x7f12581f2680 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 --2- 172.21.15.162:0/2144563912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12580cdc30 0x7f1258143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 >> 172.21.15.162:0/2144563912 conn(0x7f125806a600 msgr2=0x7f12580ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 shutdown_connections 2024-01-20T11:09:29.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.692+0000 7f125fc00640 1 -- 172.21.15.162:0/2144563912 wait complete. 2024-01-20T11:09:29.715 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-20T11:09:29.715 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:29.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.918+0000 7feafea00640 1 Processor -- start 2024-01-20T11:09:29.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.918+0000 7feafea00640 1 -- start start 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feafea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 0x7feaf80cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feafea00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feaf806deb0 0x7feaf80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feafea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf815a910 con 0x7feaf8071260 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feafea00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80ca390 con 0x7feaf806deb0 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feafea00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8072960 con 0x7feaf815a530 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feaefe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7feaf8071260 0x7feaf806d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:34190/0 (socket says 172.21.15.162:34190) 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feaefe00640 1 -- 172.21.15.162:0/2125975532 learned_addr learned my addr 172.21.15.162:0/2125975532 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feaf7e00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 0x7feaf80cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.920+0000 7feafca00640 1 --2- 172.21.15.162:0/2125975532 >> v2:172.21.15.179:3300/0 conn(0x7feaf806deb0 0x7feaf80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339432483 0 0) 0x7feaf815a910 con 0x7feaf8071260 2024-01-20T11:09:29.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead8003520 con 0x7feaf8071260 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2034667520 0 0) 0x7fead8003520 con 0x7feaf8071260 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 msgr2=0x7feaf80cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 0x7feaf80cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 >> v2:172.21.15.179:3300/0 conn(0x7feaf806deb0 msgr2=0x7feaf80716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 --2- 172.21.15.162:0/2125975532 >> v2:172.21.15.179:3300/0 conn(0x7feaf806deb0 0x7feaf80716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80ce730 con 0x7feaf8071260 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7feae0001670 con 0x7feaf8071260 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 >> v1:172.21.15.162:6789/0 conn(0x7feaf8071260 legacy=0x7feaf806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7fead8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fead80047c0 0x7fead8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 0x7fead8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80ca390 con 0x7fead8003970 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8072960 con 0x7fead80047c0 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.921+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead800b9d0 con 0x7feaf815a530 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaf7e00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7fead8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feafca00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 0x7fead8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaf7e00640 1 -- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 msgr2=0x7fead8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaf7e00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf815a530 0x7fead8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaefe00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fead80047c0 0x7fead8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaf7e00640 1 -- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fead80047c0 msgr2=0x7fead8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaf7e00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fead80047c0 0x7fead8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaf7e00640 1 -- 172.21.15.162:0/2125975532 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8003520 con 0x7fead8003970 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.922+0000 7feaefe00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fead80047c0 0x7fead8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.923+0000 7feaf7e00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7fead8003d90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feae8009af0 tx=0x7fead80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9b316a63267b64 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.923+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae802c6b0 con 0x7fead8003970 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.923+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae802c810 con 0x7fead8003970 2024-01-20T11:09:29.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.923+0000 7feaf7400640 1 -- 172.21.15.162:0/2125975532 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae802cba0 con 0x7fead8003970 2024-01-20T11:09:29.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.924+0000 7feafea00640 1 -- 172.21.15.162:0/2125975532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 msgr2=0x7fead8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:29.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.924+0000 7feafea00640 1 --2- 172.21.15.162:0/2125975532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7fead8003d90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feae8009af0 tx=0x7fead80057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.924+0000 7feafca00640 1 -- 172.21.15.162:0/2125975532 reap_dead start 2024-01-20T11:09:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.924+0000 7feafea00640 1 -- 172.21.15.162:0/2125975532 shutdown_connections 2024-01-20T11:09:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.924+0000 7feafea00640 1 -- 172.21.15.162:0/2125975532 >> 172.21.15.162:0/2125975532 conn(0x7feaf80b0cd0 msgr2=0x7feaf80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.924+0000 7feafea00640 1 -- 172.21.15.162:0/2125975532 shutdown_connections 2024-01-20T11:09:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.924+0000 7feafea00640 1 -- 172.21.15.162:0/2125975532 wait complete. 2024-01-20T11:09:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.926+0000 7feafea00640 1 Processor -- start 2024-01-20T11:09:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.926+0000 7feafea00640 1 -- start start 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feafea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7feaf8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feafea00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaf8158670 0x7feaf8099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feafea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf809a970 0x7feaf814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feafea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80b3020 con 0x7fead8003970 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feafea00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8156230 con 0x7feaf8158670 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feafea00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80b3200 con 0x7feaf809a970 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7feaf8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7feaf8155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42694/0 (socket says 172.21.15.162:42694) 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.927+0000 7feaf7e00640 1 -- 172.21.15.162:0/648508369 learned_addr learned my addr 172.21.15.162:0/648508369 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaefe00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaf8158670 0x7feaf8099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf7e00640 1 -- 172.21.15.162:0/648508369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf809a970 msgr2=0x7feaf814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf7e00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf809a970 0x7feaf814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf7e00640 1 -- 172.21.15.162:0/648508369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaf8158670 msgr2=0x7feaf8099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf7e00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaf8158670 0x7feaf8099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf7e00640 1 -- 172.21.15.162:0/648508369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80b34e0 con 0x7fead8003970 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf7e00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7feaf8155cf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feae8009a90 tx=0x7feae8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf4c00640 1 -- 172.21.15.162:0/648508369 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8003810 con 0x7fead8003970 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf4c00640 1 -- 172.21.15.162:0/648508369 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8003970 con 0x7fead8003970 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feaf4c00640 1 -- 172.21.15.162:0/648508369 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8003d20 con 0x7fead8003970 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.928+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf80b37c0 con 0x7fead8003970 2024-01-20T11:09:29.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.929+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf8099f90 con 0x7fead8003970 2024-01-20T11:09:29.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.930+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf804e970 con 0x7fead8003970 2024-01-20T11:09:29.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.930+0000 7feaf4c00640 1 -- 172.21.15.162:0/648508369 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feae8034440 con 0x7fead8003970 2024-01-20T11:09:29.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.931+0000 7feaf4c00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fead006af00 0x7fead006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:29.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.931+0000 7feaf4c00640 1 -- 172.21.15.162:0/648508369 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feae80ab590 con 0x7fead8003970 2024-01-20T11:09:29.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.932+0000 7feaefe00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fead006af00 0x7fead006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:29.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.932+0000 7feaefe00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fead006af00 0x7fead006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feae0001eb0 tx=0x7feae0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:29.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:29.936+0000 7feaf4c00640 1 -- 172.21.15.162:0/648508369 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feae8076470 con 0x7fead8003970 2024-01-20T11:09:30.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.168+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaf80cd680 con 0x7fead8003970 2024-01-20T11:09:30.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.169+0000 7feaf4c00640 1 -- 172.21.15.162:0/648508369 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7feae8079a90 con 0x7fead8003970 2024-01-20T11:09:30.170 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:30.170 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3643822826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3643822826},{"type":"v1","addr":"172.21.15.162:6837","nonce":3643822826}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3084491175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3084491175},{"type":"v1","addr":"172.21.15.179:6834","nonce":3084491175}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3459133230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3459133230},{"type":"v1","addr":"172.21.15.162:6836","nonce":3459133230}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:09:26.112913+0000","modified":"2024-01-20T11:09:29.172569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/4241600456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4241600456},{"type":"v1","addr":"172.21.15.179:6835","nonce":4241600456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T11:09:30.171 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 23 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fead006af00 msgr2=0x7fead006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fead006af00 0x7fead006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feae0001eb0 tx=0x7feae0009040 comp rx=0 tx=0).stop 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 msgr2=0x7feaf8155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7feaf8155cf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feae8009a90 tx=0x7feae8004730 comp rx=0 tx=0).stop 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 shutdown_connections 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feaf809a970 0x7feaf814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fead006af00 0x7fead006d3c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaf8158670 0x7feaf8099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 --2- 172.21.15.162:0/648508369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead8003970 0x7feaf8155cf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 >> 172.21.15.162:0/648508369 conn(0x7feaf80b0cd0 msgr2=0x7feaf80ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:30.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.172+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 shutdown_connections 2024-01-20T11:09:30.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.173+0000 7feafea00640 1 -- 172.21.15.162:0/648508369 wait complete. 2024-01-20T11:09:30.192 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.403+0000 7f9235800640 1 Processor -- start 2024-01-20T11:09:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.403+0000 7f9235800640 1 -- start start 2024-01-20T11:09:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f9235800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9230160c60 0x7f92300d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f9235800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92300d40d0 0x7f92300d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f9235800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92300d19b0 0x7f92300ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f9235800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92300d2af0 con 0x7f9230160c60 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f9235800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92300d1ee0 con 0x7f92300d40d0 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f9235800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92300d21c0 con 0x7f92300d19b0 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f922ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9230160c60 0x7f92300d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f922ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9230160c60 0x7f92300d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42700/0 (socket says 172.21.15.162:42700) 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.405+0000 7f922ea00640 1 -- 172.21.15.162:0/98832257 learned_addr learned my addr 172.21.15.162:0/98832257 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922e000640 1 --2- 172.21.15.162:0/98832257 >> v2:172.21.15.179:3300/0 conn(0x7f92300d40d0 0x7f92300d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922f400640 1 --2- 172.21.15.162:0/98832257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92300d19b0 0x7f92300ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922ea00640 1 -- 172.21.15.162:0/98832257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92300d19b0 msgr2=0x7f92300ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922ea00640 1 --2- 172.21.15.162:0/98832257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92300d19b0 0x7f92300ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922ea00640 1 -- 172.21.15.162:0/98832257 >> v2:172.21.15.179:3300/0 conn(0x7f92300d40d0 msgr2=0x7f92300d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922ea00640 1 --2- 172.21.15.162:0/98832257 >> v2:172.21.15.179:3300/0 conn(0x7f92300d40d0 0x7f92300d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922ea00640 1 -- 172.21.15.162:0/98832257 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300d24a0 con 0x7f9230160c60 2024-01-20T11:09:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.406+0000 7f922f400640 1 --2- 172.21.15.162:0/98832257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92300d19b0 0x7f92300ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.407+0000 7f922ea00640 1 --2- 172.21.15.162:0/98832257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9230160c60 0x7f92300d2f80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f92300b2ef0 tx=0x7f921802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05e648ec8c20708 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f922d600640 1 -- 172.21.15.162:0/98832257 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218031870 con 0x7f9230160c60 2024-01-20T11:09:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f922d600640 1 -- 172.21.15.162:0/98832257 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92180319d0 con 0x7f9230160c60 2024-01-20T11:09:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f922d600640 1 -- 172.21.15.162:0/98832257 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218031d60 con 0x7f9230160c60 2024-01-20T11:09:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f9235800640 1 -- 172.21.15.162:0/98832257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9230160c60 msgr2=0x7f92300d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f9235800640 1 --2- 172.21.15.162:0/98832257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9230160c60 0x7f92300d2f80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f92300b2ef0 tx=0x7f921802b910 comp rx=0 tx=0).stop 2024-01-20T11:09:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f9235800640 1 -- 172.21.15.162:0/98832257 shutdown_connections 2024-01-20T11:09:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f9235800640 1 --2- 172.21.15.162:0/98832257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92300d19b0 0x7f92300ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f9235800640 1 --2- 172.21.15.162:0/98832257 >> v2:172.21.15.179:3300/0 conn(0x7f92300d40d0 0x7f92300d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f9235800640 1 --2- 172.21.15.162:0/98832257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9230160c60 0x7f92300d2f80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.408+0000 7f9235800640 1 -- 172.21.15.162:0/98832257 >> 172.21.15.162:0/98832257 conn(0x7f923009c790 msgr2=0x7f92300d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.409+0000 7f9235800640 1 -- 172.21.15.162:0/98832257 shutdown_connections 2024-01-20T11:09:30.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.409+0000 7f9235800640 1 -- 172.21.15.162:0/98832257 wait complete. 2024-01-20T11:09:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.410+0000 7f9235800640 1 Processor -- start 2024-01-20T11:09:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.411+0000 7f9235800640 1 -- start start 2024-01-20T11:09:30.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.411+0000 7f9235800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92300d19b0 0x7f92300ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f9235800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92300d40d0 0x7f92300b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f9235800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9230160c60 0x7f92300c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f9235800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300cb800 con 0x7f92300d40d0 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f9235800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300cbae0 con 0x7f92300d19b0 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f9235800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92300cbdc0 con 0x7f9230160c60 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92300d40d0 0x7f92300b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92300d40d0 0x7f92300b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42706/0 (socket says 172.21.15.162:42706) 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 -- 172.21.15.162:0/1847083756 learned_addr learned my addr 172.21.15.162:0/1847083756 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922f400640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9230160c60 0x7f92300c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922ea00640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92300d19b0 0x7f92300ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 -- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9230160c60 msgr2=0x7f92300c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9230160c60 0x7f92300c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 -- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92300d19b0 msgr2=0x7f92300ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92300d19b0 0x7f92300ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922e000640 1 -- 172.21.15.162:0/1847083756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180094d0 con 0x7f92300d40d0 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.412+0000 7f922ea00640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92300d19b0 0x7f92300ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.413+0000 7f922e000640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92300d40d0 0x7f92300b41a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9220007ef0 tx=0x7f922000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.413+0000 7f9226a00640 1 -- 172.21.15.162:0/1847083756 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220014620 con 0x7f92300d40d0 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.413+0000 7f9226a00640 1 -- 172.21.15.162:0/1847083756 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9220014780 con 0x7f92300d40d0 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.413+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92300cc0a0 con 0x7f92300d40d0 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.413+0000 7f9226a00640 1 -- 172.21.15.162:0/1847083756 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220014b30 con 0x7f92300d40d0 2024-01-20T11:09:30.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.413+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92300cc660 con 0x7f92300d40d0 2024-01-20T11:09:30.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.414+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92300cc820 con 0x7f92300d40d0 2024-01-20T11:09:30.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.415+0000 7f9226a00640 1 -- 172.21.15.162:0/1847083756 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9220014c90 con 0x7f92300d40d0 2024-01-20T11:09:30.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.416+0000 7f9226a00640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f920806aed0 0x7f920806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.416+0000 7f9226a00640 1 -- 172.21.15.162:0/1847083756 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9220089f90 con 0x7f92300d40d0 2024-01-20T11:09:30.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.416+0000 7f922ea00640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f920806aed0 0x7f920806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.417+0000 7f922ea00640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f920806aed0 0x7f920806d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9218036000 tx=0x7f921803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:30.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.421+0000 7f9226a00640 1 -- 172.21.15.162:0/1847083756 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f92200bd0d0 con 0x7f92300d40d0 2024-01-20T11:09:30.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.617+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92300b1860 con 0x7f92300d40d0 2024-01-20T11:09:30.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.618+0000 7f9226a00640 1 -- 172.21.15.162:0/1847083756 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16538 (secure 0 0 0) 0x7f9220054ef0 con 0x7f92300d40d0 2024-01-20T11:09:30.619 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:30.620 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":47,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:27.671415+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:09:23.943994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-20T11:09:25.120343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f920806aed0 msgr2=0x7f920806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f920806aed0 0x7f920806d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9218036000 tx=0x7f921803c040 comp rx=0 tx=0).stop 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92300d40d0 msgr2=0x7f92300b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92300d40d0 0x7f92300b41a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9220007ef0 tx=0x7f922000e4b0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 shutdown_connections 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9230160c60 0x7f92300c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92300d40d0 0x7f92300b41a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f920806aed0 0x7f920806d390 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 --2- 172.21.15.162:0/1847083756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92300d19b0 0x7f92300ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.621+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 >> 172.21.15.162:0/1847083756 conn(0x7f923009c790 msgr2=0x7f92300d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:30.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.622+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 shutdown_connections 2024-01-20T11:09:30.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.622+0000 7f9235800640 1 -- 172.21.15.162:0/1847083756 wait complete. 2024-01-20T11:09:30.642 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T11:09:30.642 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:09:30.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.852+0000 7f97a6000640 1 Processor -- start 2024-01-20T11:09:30.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.852+0000 7f97a6000640 1 -- start start 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.853+0000 7f97a6000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97a0155a30 0x7f97a00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.853+0000 7f97a6000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a0070630 0x7f97a00adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.853+0000 7f97a6000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a0070b60 con 0x7f97a015c6e0 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.853+0000 7f97a6000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a015ba10 con 0x7f97a0155a30 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.853+0000 7f97a6000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a015bc00 con 0x7f97a0070630 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97a0155a30 0x7f97a00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97a0155a30 0x7f97a00ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42710/0 (socket says 172.21.15.162:42710) 2024-01-20T11:09:30.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979fe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f97a015c6e0 0x7f97a006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:34192/0 (socket says 172.21.15.162:34192) 2024-01-20T11:09:30.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979f400640 1 -- 172.21.15.162:0/2433802698 learned_addr learned my addr 172.21.15.162:0/2433802698 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:30.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f9797e00640 1 --2- 172.21.15.162:0/2433802698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a0070630 0x7f97a00adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979f400640 1 -- 172.21.15.162:0/2433802698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a0070630 msgr2=0x7f97a00adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:30.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979f400640 1 --2- 172.21.15.162:0/2433802698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a0070630 0x7f97a00adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979f400640 1 -- 172.21.15.162:0/2433802698 >> v1:172.21.15.162:6789/0 conn(0x7f97a015c6e0 legacy=0x7f97a006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979f400640 1 -- 172.21.15.162:0/2433802698 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a015bee0 con 0x7f97a0155a30 2024-01-20T11:09:30.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f9797e00640 1 --2- 172.21.15.162:0/2433802698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a0070630 0x7f97a00adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:30.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.854+0000 7f979ea00640 1 -- 172.21.15.162:0/2433802698 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195574132 0 0) 0x7f97a0070b60 con 0x7f97a015c6e0 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.855+0000 7f979f400640 1 --2- 172.21.15.162:0/2433802698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0155a30 0x7f97a00ce800 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9790009870 tx=0x7f979002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20080d5e612b9b53 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f979ea00640 1 -- 172.21.15.162:0/2433802698 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790031640 con 0x7f97a0155a30 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f979ea00640 1 -- 172.21.15.162:0/2433802698 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97900317a0 con 0x7f97a0155a30 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f979ea00640 1 -- 172.21.15.162:0/2433802698 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790031b30 con 0x7f97a0155a30 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f97a6000640 1 -- 172.21.15.162:0/2433802698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0155a30 msgr2=0x7f97a00ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f97a6000640 1 --2- 172.21.15.162:0/2433802698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0155a30 0x7f97a00ce800 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9790009870 tx=0x7f979002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f97a6000640 1 -- 172.21.15.162:0/2433802698 shutdown_connections 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f97a6000640 1 --2- 172.21.15.162:0/2433802698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a0070630 0x7f97a00adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f97a6000640 1 --2- 172.21.15.162:0/2433802698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0155a30 0x7f97a00ce800 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.856+0000 7f97a6000640 1 -- 172.21.15.162:0/2433802698 >> 172.21.15.162:0/2433802698 conn(0x7f97a00b0cd0 msgr2=0x7f97a00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:30.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.857+0000 7f97a6000640 1 -- 172.21.15.162:0/2433802698 shutdown_connections 2024-01-20T11:09:30.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.857+0000 7f97a6000640 1 -- 172.21.15.162:0/2433802698 wait complete. 2024-01-20T11:09:30.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.858+0000 7f97a6000640 1 Processor -- start 2024-01-20T11:09:30.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.858+0000 7f97a6000640 1 -- start start 2024-01-20T11:09:30.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.859+0000 7f97a6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0070630 0x7f97a0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.859+0000 7f97a6000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97a0155a30 0x7f97a0150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.859+0000 7f97a6000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a015c6e0 0x7f97a00af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.859+0000 7f97a6000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00adb40 con 0x7f97a0070630 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.859+0000 7f97a6000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00aff80 con 0x7f97a0155a30 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.859+0000 7f97a6000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00ad210 con 0x7f97a015c6e0 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.859+0000 7f979f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0070630 0x7f97a0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0070630 0x7f97a0150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42722/0 (socket says 172.21.15.162:42722) 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 -- 172.21.15.162:0/3204199391 learned_addr learned my addr 172.21.15.162:0/3204199391 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 -- 172.21.15.162:0/3204199391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a015c6e0 msgr2=0x7f97a00af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a015c6e0 0x7f97a00af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 -- 172.21.15.162:0/3204199391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97a0155a30 msgr2=0x7f97a0150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97a0155a30 0x7f97a0150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 -- 172.21.15.162:0/3204199391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900094d0 con 0x7f97a0070630 2024-01-20T11:09:30.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.860+0000 7f979f400640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0070630 0x7f97a0150ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9790009870 tx=0x7f97900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:30.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.861+0000 7f9797400640 1 -- 172.21.15.162:0/3204199391 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979003ac60 con 0x7f97a0070630 2024-01-20T11:09:30.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.861+0000 7f9797400640 1 -- 172.21.15.162:0/3204199391 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979003ade0 con 0x7f97a0070630 2024-01-20T11:09:30.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.861+0000 7f9797400640 1 -- 172.21.15.162:0/3204199391 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790044630 con 0x7f97a0070630 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.861+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a00ad4f0 con 0x7f97a0070630 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.861+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a01511e0 con 0x7f97a0070630 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.862+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a004e970 con 0x7f97a0070630 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.863+0000 7f9797400640 1 -- 172.21.15.162:0/3204199391 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f979002f050 con 0x7f97a0070630 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.864+0000 7f9797400640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f977806aed0 0x7f977806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.864+0000 7f9797400640 1 -- 172.21.15.162:0/3204199391 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97900ab710 con 0x7f97a0070630 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.864+0000 7f9797e00640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f977806aed0 0x7f977806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:30.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.865+0000 7f9797e00640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f977806aed0 0x7f977806d390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9788006fd0 tx=0x7f9788008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:30.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:30.868+0000 7f9797400640 1 -- 172.21.15.162:0/3204199391 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9790076670 con 0x7f97a0070630 2024-01-20T11:09:31.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.058+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97a0067a50 con 0x7f977806aed0 2024-01-20T11:09:31.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.071+0000 7f9797400640 1 -- 172.21.15.162:0/3204199391 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274669 (secure 0 0 0) 0x7f97a0067a50 con 0x7f977806aed0 2024-01-20T11:09:31.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:31.077 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:09:31.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.077+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f977806aed0 msgr2=0x7f977806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f977806aed0 0x7f977806d390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9788006fd0 tx=0x7f9788008040 comp rx=0 tx=0).stop 2024-01-20T11:09:31.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0070630 msgr2=0x7f97a0150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0070630 0x7f97a0150ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9790009870 tx=0x7f97900046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 shutdown_connections 2024-01-20T11:09:31.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97a015c6e0 0x7f97a00af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f977806aed0 0x7f977806d390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97a0155a30 0x7f97a0150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 --2- 172.21.15.162:0/3204199391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97a0070630 0x7f97a0150ca0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 >> 172.21.15.162:0/3204199391 conn(0x7f97a00b0cd0 msgr2=0x7f97a006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:31.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 shutdown_connections 2024-01-20T11:09:31.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.078+0000 7f97a6000640 1 -- 172.21.15.162:0/3204199391 wait complete. 2024-01-20T11:09:31.097 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-01-20T11:09:29.616309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":242056,"kb_used_data":5052,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732664,"statfs":{"total":773094113280,"available":772846247936,"internally_reserved":0,"allocated":5173248,"data_stored":2757743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985476"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.637348+0000","last_change":"2024-01-20T11:09:24.637348+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.637348+0000","last_undegraded":"2024-01-20T11:09:24.637348+0000","last_fullsized":"2024-01-20T11:09:24.637348+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.647595+0000","last_change":"2024-01-20T11:09:24.647595+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.647595+0000","last_undegraded":"2024-01-20T11:09:24.647595+0000","last_fullsized":"2024-01-20T11:09:24.647595+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633011+0000","last_change":"2024-01-20T11:09:24.633011+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633011+0000","last_undegraded":"2024-01-20T11:09:24.633011+0000","last_fullsized":"2024-01-20T11:09:24.633011+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640698+0000","last_change":"2024-01-20T11:09:24.640698+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640698+0000","last_undegraded":"2024-01-20T11:09:24.640698+0000","last_fullsized":"2024-01-20T11:09:24.640698+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.635498+0000","last_change":"2024-01-20T11:09:24.635498+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.635498+0000","last_undegraded":"2024-01-20T11:09:24.635498+0000","last_fullsized":"2024-01-20T11:09:24.635498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.646553+0000","last_change":"2024-01-20T11:09:24.646553+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.646553+0000","last_undegraded":"2024-01-20T11:09:24.646553+0000","last_fullsized":"2024-01-20T11:09:24.646553+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.641952+0000","last_change":"2024-01-20T11:09:24.641952+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.641952+0000","last_undegraded":"2024-01-20T11:09:24.641952+0000","last_fullsized":"2024-01-20T11:09:24.641952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.636681+0000","last_change":"2024-01-20T11:09:24.636681+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.636681+0000","last_undegraded":"2024-01-20T11:09:24.636681+0000","last_fullsized":"2024-01-20T11:09:24.636681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.646166+0000","last_change":"2024-01-20T11:09:24.646166+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.646166+0000","last_undegraded":"2024-01-20T11:09:24.646166+0000","last_fullsized":"2024-01-20T11:09:24.646166+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.636103+0000","last_change":"2024-01-20T11:09:24.636103+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.636103+0000","last_undegraded":"2024-01-20T11:09:24.636103+0000","last_fullsized":"2024-01-20T11:09:24.636103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.642135+0000","last_change":"2024-01-20T11:09:24.642135+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.642135+0000","last_undegraded":"2024-01-20T11:09:24.642135+0000","last_fullsized":"2024-01-20T11:09:24.642135+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.644032+0000","last_change":"2024-01-20T11:09:24.644032+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.644032+0000","last_undegraded":"2024-01-20T11:09:24.644032+0000","last_fullsized":"2024-01-20T11:09:24.644032+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.634977+0000","last_change":"2024-01-20T11:09:24.634977+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.634977+0000","last_undegraded":"2024-01-20T11:09:24.634977+0000","last_fullsized":"2024-01-20T11:09:24.634977+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.641679+0000","last_change":"2024-01-20T11:09:24.641679+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.641679+0000","last_undegraded":"2024-01-20T11:09:24.641679+0000","last_fullsized":"2024-01-20T11:09:24.641679+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.635617+0000","last_change":"2024-01-20T11:09:24.635617+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.635617+0000","last_undegraded":"2024-01-20T11:09:24.635617+0000","last_fullsized":"2024-01-20T11:09:24.635617+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.635995+0000","last_change":"2024-01-20T11:09:24.635995+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.635995+0000","last_undegraded":"2024-01-20T11:09:24.635995+0000","last_fullsized":"2024-01-20T11:09:24.635995+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.644392+0000","last_change":"2024-01-20T11:09:24.644392+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.644392+0000","last_undegraded":"2024-01-20T11:09:24.644392+0000","last_fullsized":"2024-01-20T11:09:24.644392+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.645127+0000","last_change":"2024-01-20T11:09:24.645127+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.645127+0000","last_undegraded":"2024-01-20T11:09:24.645127+0000","last_fullsized":"2024-01-20T11:09:24.645127+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640404+0000","last_change":"2024-01-20T11:09:24.640404+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640404+0000","last_undegraded":"2024-01-20T11:09:24.640404+0000","last_fullsized":"2024-01-20T11:09:24.640404+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.637732+0000","last_change":"2024-01-20T11:09:24.637732+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.637732+0000","last_undegraded":"2024-01-20T11:09:24.637732+0000","last_fullsized":"2024-01-20T11:09:24.637732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633638+0000","last_change":"2024-01-20T11:09:24.633638+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633638+0000","last_undegraded":"2024-01-20T11:09:24.633638+0000","last_fullsized":"2024-01-20T11:09:24.633638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640548+0000","last_change":"2024-01-20T11:09:24.640548+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640548+0000","last_undegraded":"2024-01-20T11:09:24.640548+0000","last_fullsized":"2024-01-20T11:09:24.640548+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.634880+0000","last_change":"2024-01-20T11:09:24.634880+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.634880+0000","last_undegraded":"2024-01-20T11:09:24.634880+0000","last_fullsized":"2024-01-20T11:09:24.634880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640459+0000","last_change":"2024-01-20T11:09:24.640459+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640459+0000","last_undegraded":"2024-01-20T11:09:24.640459+0000","last_fullsized":"2024-01-20T11:09:24.640459+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.637181+0000","last_change":"2024-01-20T11:09:24.637181+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.637181+0000","last_undegraded":"2024-01-20T11:09:24.637181+0000","last_fullsized":"2024-01-20T11:09:24.637181+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640892+0000","last_change":"2024-01-20T11:09:24.640892+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640892+0000","last_undegraded":"2024-01-20T11:09:24.640892+0000","last_fullsized":"2024-01-20T11:09:24.640892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633244+0000","last_change":"2024-01-20T11:09:24.633244+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633244+0000","last_undegraded":"2024-01-20T11:09:24.633244+0000","last_fullsized":"2024-01-20T11:09:24.633244+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.642212+0000","last_change":"2024-01-20T11:09:24.642212+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.642212+0000","last_undegraded":"2024-01-20T11:09:24.642212+0000","last_fullsized":"2024-01-20T11:09:24.642212+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.645487+0000","last_change":"2024-01-20T11:09:24.645487+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.645487+0000","last_undegraded":"2024-01-20T11:09:24.645487+0000","last_fullsized":"2024-01-20T11:09:24.645487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633036+0000","last_change":"2024-01-20T11:09:24.633036+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633036+0000","last_undegraded":"2024-01-20T11:09:24.633036+0000","last_fullsized":"2024-01-20T11:09:24.633036+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.634950+0000","last_change":"2024-01-20T11:09:24.634950+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.634950+0000","last_undegraded":"2024-01-20T11:09:24.634950+0000","last_fullsized":"2024-01-20T11:09:24.634950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640291+0000","last_change":"2024-01-20T11:09:24.640291+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640291+0000","last_undegraded":"2024-01-20T11:09:24.640291+0000","last_fullsized":"2024-01-20T11:09:24.640291+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":183,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-20T11:09:22.027187+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:09:22.027187+0000","last_peered":"2024-01-20T11:09:22.027187+0000","last_clean":"2024-01-20T11:09:22.027187+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:09:22.027187+0000","last_undegraded":"2024-01-20T11:09:22.027187+0000","last_fullsized":"2024-01-20T11:09:22.027187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":788126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.306},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.5720000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.476},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.7030000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.8759999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.623}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.425}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":2.2810000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.794},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.9770000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":192701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.296},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.675},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.448},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":1.3660000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.121},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.546}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.238}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.615}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":3.0289999999999999,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.399}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.878}]},{"osd":1,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.72899999999999998}]},{"osd":2,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.81599999999999995}]},{"osd":4,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.85799999999999998}]},{"osd":7,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.391,"5min":1.391,"15min":1.391},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.83899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.478},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.2350000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.04},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.1180000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.93400000000000005}]},{"osd":3,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.4339999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.536},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.3979999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.339}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.92300000000000004}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.88800000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.3759999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.595}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.728}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.758}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.671},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.845}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.80500000000000005}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.93000000000000005}]},{"osd":3,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.321},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":1.0820000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":1.4710000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.427}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.226},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2689999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.5149999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.4729999999999999,"5min":5.4729999999999999,"15min":5.4729999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.0579999999999998,"5min":5.0579999999999998,"15min":5.0579999999999998},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":5.0010000000000003,"5min":5.0010000000000003,"15min":5.0010000000000003},"last":0.628},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.3399999999999999,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":0.871}]},{"osd":5,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":1.0449999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":5.1769999999999996,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.1439999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":5.391,"5min":5.391,"15min":5.391},"last":1.073},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":5.5469999999999997,"5min":5.5469999999999997,"15min":5.5469999999999997},"last":0.99399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":788126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.089},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.2969999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.872}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.236},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.373}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.5780000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.542},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.339}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.403},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.615}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.643}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:09:31.103 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:09:31.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.359+0000 7f833bc00640 1 Processor -- start 2024-01-20T11:09:31.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.359+0000 7f833bc00640 1 -- start start 2024-01-20T11:09:31.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f833bc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f83340cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f833bc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f833406deb0 0x7f83340716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f833bc00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833415a910 con 0x7f8334071260 2024-01-20T11:09:31.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f833bc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83340ca390 con 0x7f833406deb0 2024-01-20T11:09:31.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f833bc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8334072960 con 0x7f833415a530 2024-01-20T11:09:31.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f8339c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f833406deb0 0x7f83340716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f8339c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f833406deb0 0x7f83340716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42730/0 (socket says 172.21.15.162:42730) 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.361+0000 7f8339c00640 1 -- 172.21.15.162:0/1231301893 learned_addr learned my addr 172.21.15.162:0/1231301893 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.362+0000 7f8339200640 1 --2- 172.21.15.162:0/1231301893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f83340cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.362+0000 7f8339c00640 1 -- 172.21.15.162:0/1231301893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 msgr2=0x7f83340cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.362+0000 7f8339c00640 1 --2- 172.21.15.162:0/1231301893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f83340cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.362+0000 7f8339c00640 1 -- 172.21.15.162:0/1231301893 >> v1:172.21.15.179:6789/0 conn(0x7f8334071260 legacy=0x7f833406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.362+0000 7f8339c00640 1 -- 172.21.15.162:0/1231301893 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83340ce730 con 0x7f833406deb0 2024-01-20T11:09:31.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.363+0000 7f8339c00640 1 --2- 172.21.15.162:0/1231301893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340716a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f832c009e50 tx=0x7f832c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c8c4535080edbe server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:31.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.363+0000 7f8333e00640 1 -- 172.21.15.162:0/1231301893 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c02c9e0 con 0x7f833406deb0 2024-01-20T11:09:31.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.363+0000 7f8333e00640 1 -- 172.21.15.162:0/1231301893 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c02cb40 con 0x7f833406deb0 2024-01-20T11:09:31.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.363+0000 7f8333e00640 1 -- 172.21.15.162:0/1231301893 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0343f0 con 0x7f833406deb0 2024-01-20T11:09:31.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 -- 172.21.15.162:0/1231301893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 msgr2=0x7f83340716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 --2- 172.21.15.162:0/1231301893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340716a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f832c009e50 tx=0x7f832c02be40 comp rx=0 tx=0).stop 2024-01-20T11:09:31.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 -- 172.21.15.162:0/1231301893 shutdown_connections 2024-01-20T11:09:31.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 --2- 172.21.15.162:0/1231301893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340716a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 --2- 172.21.15.162:0/1231301893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f83340cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 -- 172.21.15.162:0/1231301893 >> 172.21.15.162:0/1231301893 conn(0x7f83340b0cd0 msgr2=0x7f83340b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:31.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 -- 172.21.15.162:0/1231301893 shutdown_connections 2024-01-20T11:09:31.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.364+0000 7f833bc00640 1 -- 172.21.15.162:0/1231301893 wait complete. 2024-01-20T11:09:31.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.366+0000 7f833bc00640 1 Processor -- start 2024-01-20T11:09:31.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.366+0000 7f833bc00640 1 -- start start 2024-01-20T11:09:31.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f833bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f833bc00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8334071260 0x7f83340b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f833bc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f8334147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f833bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833415c560 con 0x7f833406deb0 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f833bc00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8334148150 con 0x7f8334071260 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f833bc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8334148430 con 0x7f833415a530 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f8339200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f8339200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340afca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42740/0 (socket says 172.21.15.162:42740) 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f8339200640 1 -- 172.21.15.162:0/3917040252 learned_addr learned my addr 172.21.15.162:0/3917040252 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.367+0000 7f832bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8334071260 0x7f83340b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8339200640 1 -- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 msgr2=0x7f8334147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8339c00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f8334147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8339200640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f8334147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8339200640 1 -- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8334071260 msgr2=0x7f83340b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8339200640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8334071260 0x7f83340b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8339200640 1 -- 172.21.15.162:0/3917040252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c009b30 con 0x7f833406deb0 2024-01-20T11:09:31.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f832bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8334071260 0x7f83340b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:31.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8339200640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340afca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f832400d5f0 tx=0x7f832400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:31.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8331600640 1 -- 172.21.15.162:0/3917040252 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83240125f0 con 0x7f833406deb0 2024-01-20T11:09:31.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8331600640 1 -- 172.21.15.162:0/3917040252 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8324012750 con 0x7f833406deb0 2024-01-20T11:09:31.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f8331600640 1 -- 172.21.15.162:0/3917040252 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324012b00 con 0x7f833406deb0 2024-01-20T11:09:31.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833415c180 con 0x7f833406deb0 2024-01-20T11:09:31.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.368+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83341457e0 con 0x7f833406deb0 2024-01-20T11:09:31.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.369+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833415bfe0 con 0x7f833406deb0 2024-01-20T11:09:31.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.370+0000 7f8331600640 1 -- 172.21.15.162:0/3917040252 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8324012c60 con 0x7f833406deb0 2024-01-20T11:09:31.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.371+0000 7f8331600640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f830c06aed0 0x7f830c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.371+0000 7f8331600640 1 -- 172.21.15.162:0/3917040252 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8324089a80 con 0x7f833406deb0 2024-01-20T11:09:31.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.371+0000 7f832bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f830c06aed0 0x7f830c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.372+0000 7f832bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f830c06aed0 0x7f830c06d390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f833409bf50 tx=0x7f831c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:31.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.375+0000 7f8331600640 1 -- 172.21.15.162:0/3917040252 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f833415bfe0 con 0x7f833406deb0 2024-01-20T11:09:31.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.565+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83340c9fb0 con 0x7f830c06aed0 2024-01-20T11:09:31.574 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.573+0000 7f8331600640 1 -- 172.21.15.162:0/3917040252 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274669 (secure 0 0 0) 0x7f831c005030 con 0x7f830c06aed0 2024-01-20T11:09:31.578 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:31.579 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:09:31.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.579+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f830c06aed0 msgr2=0x7f830c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.579+0000 7f833bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f830c06aed0 0x7f830c06d390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f833409bf50 tx=0x7f831c009040 comp rx=0 tx=0).stop 2024-01-20T11:09:31.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.579+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 msgr2=0x7f83340afca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.579+0000 7f833bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340afca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f832400d5f0 tx=0x7f832400dab0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 shutdown_connections 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833415a530 0x7f8334147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f830c06aed0 0x7f830c06d390 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8334071260 0x7f83340b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 --2- 172.21.15.162:0/3917040252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f833406deb0 0x7f83340afca0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 >> 172.21.15.162:0/3917040252 conn(0x7f83340b0cd0 msgr2=0x7f833406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 shutdown_connections 2024-01-20T11:09:31.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.580+0000 7f833bc00640 1 -- 172.21.15.162:0/3917040252 wait complete. 2024-01-20T11:09:31.599 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-01-20T11:09:29.616309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":242056,"kb_used_data":5052,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732664,"statfs":{"total":773094113280,"available":772846247936,"internally_reserved":0,"allocated":5173248,"data_stored":2757743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985476"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.637348+0000","last_change":"2024-01-20T11:09:24.637348+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.637348+0000","last_undegraded":"2024-01-20T11:09:24.637348+0000","last_fullsized":"2024-01-20T11:09:24.637348+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.647595+0000","last_change":"2024-01-20T11:09:24.647595+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.647595+0000","last_undegraded":"2024-01-20T11:09:24.647595+0000","last_fullsized":"2024-01-20T11:09:24.647595+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633011+0000","last_change":"2024-01-20T11:09:24.633011+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633011+0000","last_undegraded":"2024-01-20T11:09:24.633011+0000","last_fullsized":"2024-01-20T11:09:24.633011+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640698+0000","last_change":"2024-01-20T11:09:24.640698+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640698+0000","last_undegraded":"2024-01-20T11:09:24.640698+0000","last_fullsized":"2024-01-20T11:09:24.640698+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.635498+0000","last_change":"2024-01-20T11:09:24.635498+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.635498+0000","last_undegraded":"2024-01-20T11:09:24.635498+0000","last_fullsized":"2024-01-20T11:09:24.635498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.646553+0000","last_change":"2024-01-20T11:09:24.646553+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.646553+0000","last_undegraded":"2024-01-20T11:09:24.646553+0000","last_fullsized":"2024-01-20T11:09:24.646553+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.641952+0000","last_change":"2024-01-20T11:09:24.641952+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.641952+0000","last_undegraded":"2024-01-20T11:09:24.641952+0000","last_fullsized":"2024-01-20T11:09:24.641952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.636681+0000","last_change":"2024-01-20T11:09:24.636681+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.636681+0000","last_undegraded":"2024-01-20T11:09:24.636681+0000","last_fullsized":"2024-01-20T11:09:24.636681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.646166+0000","last_change":"2024-01-20T11:09:24.646166+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.646166+0000","last_undegraded":"2024-01-20T11:09:24.646166+0000","last_fullsized":"2024-01-20T11:09:24.646166+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.636103+0000","last_change":"2024-01-20T11:09:24.636103+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.636103+0000","last_undegraded":"2024-01-20T11:09:24.636103+0000","last_fullsized":"2024-01-20T11:09:24.636103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.642135+0000","last_change":"2024-01-20T11:09:24.642135+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.642135+0000","last_undegraded":"2024-01-20T11:09:24.642135+0000","last_fullsized":"2024-01-20T11:09:24.642135+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.644032+0000","last_change":"2024-01-20T11:09:24.644032+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.644032+0000","last_undegraded":"2024-01-20T11:09:24.644032+0000","last_fullsized":"2024-01-20T11:09:24.644032+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.634977+0000","last_change":"2024-01-20T11:09:24.634977+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.634977+0000","last_undegraded":"2024-01-20T11:09:24.634977+0000","last_fullsized":"2024-01-20T11:09:24.634977+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.641679+0000","last_change":"2024-01-20T11:09:24.641679+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.641679+0000","last_undegraded":"2024-01-20T11:09:24.641679+0000","last_fullsized":"2024-01-20T11:09:24.641679+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.635617+0000","last_change":"2024-01-20T11:09:24.635617+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.635617+0000","last_undegraded":"2024-01-20T11:09:24.635617+0000","last_fullsized":"2024-01-20T11:09:24.635617+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.635995+0000","last_change":"2024-01-20T11:09:24.635995+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.635995+0000","last_undegraded":"2024-01-20T11:09:24.635995+0000","last_fullsized":"2024-01-20T11:09:24.635995+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.644392+0000","last_change":"2024-01-20T11:09:24.644392+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.644392+0000","last_undegraded":"2024-01-20T11:09:24.644392+0000","last_fullsized":"2024-01-20T11:09:24.644392+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.645127+0000","last_change":"2024-01-20T11:09:24.645127+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.645127+0000","last_undegraded":"2024-01-20T11:09:24.645127+0000","last_fullsized":"2024-01-20T11:09:24.645127+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640404+0000","last_change":"2024-01-20T11:09:24.640404+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640404+0000","last_undegraded":"2024-01-20T11:09:24.640404+0000","last_fullsized":"2024-01-20T11:09:24.640404+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.637732+0000","last_change":"2024-01-20T11:09:24.637732+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.637732+0000","last_undegraded":"2024-01-20T11:09:24.637732+0000","last_fullsized":"2024-01-20T11:09:24.637732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633638+0000","last_change":"2024-01-20T11:09:24.633638+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633638+0000","last_undegraded":"2024-01-20T11:09:24.633638+0000","last_fullsized":"2024-01-20T11:09:24.633638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640548+0000","last_change":"2024-01-20T11:09:24.640548+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640548+0000","last_undegraded":"2024-01-20T11:09:24.640548+0000","last_fullsized":"2024-01-20T11:09:24.640548+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.634880+0000","last_change":"2024-01-20T11:09:24.634880+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.634880+0000","last_undegraded":"2024-01-20T11:09:24.634880+0000","last_fullsized":"2024-01-20T11:09:24.634880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640459+0000","last_change":"2024-01-20T11:09:24.640459+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640459+0000","last_undegraded":"2024-01-20T11:09:24.640459+0000","last_fullsized":"2024-01-20T11:09:24.640459+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.637181+0000","last_change":"2024-01-20T11:09:24.637181+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.637181+0000","last_undegraded":"2024-01-20T11:09:24.637181+0000","last_fullsized":"2024-01-20T11:09:24.637181+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640892+0000","last_change":"2024-01-20T11:09:24.640892+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640892+0000","last_undegraded":"2024-01-20T11:09:24.640892+0000","last_fullsized":"2024-01-20T11:09:24.640892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633244+0000","last_change":"2024-01-20T11:09:24.633244+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633244+0000","last_undegraded":"2024-01-20T11:09:24.633244+0000","last_fullsized":"2024-01-20T11:09:24.633244+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.642212+0000","last_change":"2024-01-20T11:09:24.642212+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.642212+0000","last_undegraded":"2024-01-20T11:09:24.642212+0000","last_fullsized":"2024-01-20T11:09:24.642212+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.645487+0000","last_change":"2024-01-20T11:09:24.645487+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.645487+0000","last_undegraded":"2024-01-20T11:09:24.645487+0000","last_fullsized":"2024-01-20T11:09:24.645487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.633036+0000","last_change":"2024-01-20T11:09:24.633036+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.633036+0000","last_undegraded":"2024-01-20T11:09:24.633036+0000","last_fullsized":"2024-01-20T11:09:24.633036+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.634950+0000","last_change":"2024-01-20T11:09:24.634950+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.634950+0000","last_undegraded":"2024-01-20T11:09:24.634950+0000","last_fullsized":"2024-01-20T11:09:24.634950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T11:09:25.626088+0000","last_change":"2024-01-20T11:09:25.626088+0000","last_active":"2024-01-20T11:09:25.626088+0000","last_peered":"2024-01-20T11:09:25.626088+0000","last_clean":"2024-01-20T11:09:25.626088+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:25.626088+0000","last_undegraded":"2024-01-20T11:09:25.626088+0000","last_fullsized":"2024-01-20T11:09:25.626088+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-01-20T11:09:24.640291+0000","last_change":"2024-01-20T11:09:24.640291+0000","last_active":"2024-01-20T11:09:24.612377+0000","last_peered":"2024-01-20T11:09:24.612377+0000","last_clean":"2024-01-20T11:09:24.612377+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T11:09:24.640291+0000","last_undegraded":"2024-01-20T11:09:24.640291+0000","last_fullsized":"2024-01-20T11:09:24.640291+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":183,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-20T11:09:22.027187+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:09:22.027187+0000","last_peered":"2024-01-20T11:09:22.027187+0000","last_clean":"2024-01-20T11:09:22.027187+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:09:22.027187+0000","last_undegraded":"2024-01-20T11:09:22.027187+0000","last_fullsized":"2024-01-20T11:09:22.027187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":788126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.306},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.5720000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.476},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.7030000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.8759999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.623}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.425}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":2.2810000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.794},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.9770000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":192701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.296},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.675},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.448},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":1.3660000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.121},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.546}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.238}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.615}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":3.0289999999999999,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.399}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.878}]},{"osd":1,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.72899999999999998}]},{"osd":2,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.81599999999999995}]},{"osd":4,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.85799999999999998}]},{"osd":7,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.391,"5min":1.391,"15min":1.391},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.83899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.478},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.2350000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.04},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.1180000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.93400000000000005}]},{"osd":3,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.4339999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.536},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.3979999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.339}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.92300000000000004}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.88800000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.3759999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.595}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.728}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.758}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.671},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.845}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.80500000000000005}]},{"osd":1,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.93000000000000005}]},{"osd":3,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.321},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":1.0820000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":1.4710000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.427}]},{"osd":6,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.226},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2689999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.6480000000000001,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.5149999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":499712,"data_stored":197758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":5.0919999999999996,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.4729999999999999,"5min":5.4729999999999999,"15min":5.4729999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1440000000000001,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.0579999999999998,"5min":5.0579999999999998,"15min":5.0579999999999998},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":5.0010000000000003,"5min":5.0010000000000003,"15min":5.0010000000000003},"last":0.628},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.3399999999999999,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":0.871}]},{"osd":5,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":1.0449999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":5.1769999999999996,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.1439999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":5.391,"5min":5.391,"15min":5.391},"last":1.073},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":5.5469999999999997,"5min":5.5469999999999997,"15min":5.5469999999999997},"last":0.99399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1093632,"data_stored":788126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.089},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.2969999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.872}]},{"osd":3,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.236},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.373}]},{"osd":4,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.5780000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.542},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.339}]},{"osd":6,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.403},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.615}]},{"osd":7,"last update":"Sat Jan 20 11:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.643}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:09:31.603 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:09:31.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.846+0000 7f01fea00640 1 Processor -- start 2024-01-20T11:09:31.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.846+0000 7f01fea00640 1 -- start start 2024-01-20T11:09:31.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01fea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f815a530 0x7f01f80cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01fea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f01f8071260 0x7f01f80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01fea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f815a910 con 0x7f01f806d7a0 2024-01-20T11:09:31.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01fea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f80ca390 con 0x7f01f8071260 2024-01-20T11:09:31.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01fea00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f8072960 con 0x7f01f815a530 2024-01-20T11:09:31.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01efe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f01f8071260 0x7f01f80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01efe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f01f8071260 0x7f01f80716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42752/0 (socket says 172.21.15.162:42752) 2024-01-20T11:09:31.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01efe00640 1 -- 172.21.15.162:0/3020263306 learned_addr learned my addr 172.21.15.162:0/3020263306 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:31.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01fca00640 1 --1- 172.21.15.162:0/3020263306 >> v1:172.21.15.162:6789/0 conn(0x7f01f806d7a0 0x7f01f80ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:34206/0 (socket says 172.21.15.162:34206) 2024-01-20T11:09:31.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.848+0000 7f01f7e00640 1 --2- 172.21.15.162:0/3020263306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f815a530 0x7f01f80cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.849+0000 7f01efe00640 1 -- 172.21.15.162:0/3020263306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f815a530 msgr2=0x7f01f80cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:31.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.849+0000 7f01efe00640 1 --2- 172.21.15.162:0/3020263306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f815a530 0x7f01f80cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.849+0000 7f01efe00640 1 -- 172.21.15.162:0/3020263306 >> v1:172.21.15.162:6789/0 conn(0x7f01f806d7a0 legacy=0x7f01f80ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.849+0000 7f01efe00640 1 -- 172.21.15.162:0/3020263306 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f80ce730 con 0x7f01f8071260 2024-01-20T11:09:31.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.849+0000 7f01f7400640 1 -- 172.21.15.162:0/3020263306 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665415173 0 0) 0x7f01f815a910 con 0x7f01f806d7a0 2024-01-20T11:09:31.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.850+0000 7f01efe00640 1 --2- 172.21.15.162:0/3020263306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f80716a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f01e00098a0 tx=0x7f01e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7a7481790766a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:31.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.850+0000 7f01f7400640 1 -- 172.21.15.162:0/3020263306 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0031640 con 0x7f01f8071260 2024-01-20T11:09:31.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.850+0000 7f01f7400640 1 -- 172.21.15.162:0/3020263306 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00317a0 con 0x7f01f8071260 2024-01-20T11:09:31.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.850+0000 7f01f7400640 1 -- 172.21.15.162:0/3020263306 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0031b30 con 0x7f01f8071260 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 -- 172.21.15.162:0/3020263306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 msgr2=0x7f01f80716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 --2- 172.21.15.162:0/3020263306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f80716a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f01e00098a0 tx=0x7f01e002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 -- 172.21.15.162:0/3020263306 shutdown_connections 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 --2- 172.21.15.162:0/3020263306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f80716a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 --2- 172.21.15.162:0/3020263306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f815a530 0x7f01f80cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 -- 172.21.15.162:0/3020263306 >> 172.21.15.162:0/3020263306 conn(0x7f01f80b0cd0 msgr2=0x7f01f80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 -- 172.21.15.162:0/3020263306 shutdown_connections 2024-01-20T11:09:31.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.851+0000 7f01fea00640 1 -- 172.21.15.162:0/3020263306 wait complete. 2024-01-20T11:09:31.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.853+0000 7f01fea00640 1 Processor -- start 2024-01-20T11:09:31.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.853+0000 7f01fea00640 1 -- start start 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01fea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f806d7a0 0x7f01f8150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01fea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01fea00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f815a530 0x7f01f80b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01fea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f8153550 con 0x7f01f8071260 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01fea00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f8152f90 con 0x7f01f815a530 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01fea00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f8153270 con 0x7f01f806d7a0 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01efe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01efe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f8151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42756/0 (socket says 172.21.15.162:42756) 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.854+0000 7f01efe00640 1 -- 172.21.15.162:0/862769278 learned_addr learned my addr 172.21.15.162:0/862769278 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:31.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01f7e00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f806d7a0 0x7f01f8150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01fca00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f815a530 0x7f01f80b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01efe00640 1 -- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f806d7a0 msgr2=0x7f01f8150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01efe00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f806d7a0 0x7f01f8150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01efe00640 1 -- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f815a530 msgr2=0x7f01f80b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01efe00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f815a530 0x7f01f80b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01efe00640 1 -- 172.21.15.162:0/862769278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e00094d0 con 0x7f01f8071260 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01fca00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f815a530 0x7f01f80b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01efe00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f8151e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f01e0000c00 tx=0x7f01e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.855+0000 7f01f4c00640 1 -- 172.21.15.162:0/862769278 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e003ac60 con 0x7f01f8071260 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.856+0000 7f01f4c00640 1 -- 172.21.15.162:0/862769278 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e003adc0 con 0x7f01f8071260 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.856+0000 7f01f4c00640 1 -- 172.21.15.162:0/862769278 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0044630 con 0x7f01f8071260 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.856+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f81518e0 con 0x7f01f8071260 2024-01-20T11:09:31.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.856+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f8150910 con 0x7f01f8071260 2024-01-20T11:09:31.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.857+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f8151ad0 con 0x7f01f8071260 2024-01-20T11:09:31.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.858+0000 7f01f4c00640 1 -- 172.21.15.162:0/862769278 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f01e002f050 con 0x7f01f8071260 2024-01-20T11:09:31.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.858+0000 7f01f4c00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f01d006aed0 0x7f01d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:31.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.859+0000 7f01f4c00640 1 -- 172.21.15.162:0/862769278 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01e00ab4b0 con 0x7f01f8071260 2024-01-20T11:09:31.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.859+0000 7f01f7e00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f01d006aed0 0x7f01d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:31.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.860+0000 7f01f7e00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f01d006aed0 0x7f01d006d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006fd0 tx=0x7f01e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:31.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:31.863+0000 7f01f4c00640 1 -- 172.21.15.162:0/862769278 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f01e0076370 con 0x7f01f8071260 2024-01-20T11:09:32.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.051+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01f80c9fb0 con 0x7f01d006aed0 2024-01-20T11:09:32.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.073+0000 7f01f4c00640 1 -- 172.21.15.162:0/862769278 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286548 (secure 0 0 0) 0x7f01e800f860 con 0x7f01d006aed0 2024-01-20T11:09:32.078 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:32.080 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:09:32.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.080+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f01d006aed0 msgr2=0x7f01d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.080+0000 7f01fea00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f01d006aed0 0x7f01d006d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006fd0 tx=0x7f01e8008040 comp rx=0 tx=0).stop 2024-01-20T11:09:32.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.080+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 msgr2=0x7f01f8151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.080+0000 7f01fea00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f8151e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f01e0000c00 tx=0x7f01e00046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 shutdown_connections 2024-01-20T11:09:32.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f01d006aed0 0x7f01d006d390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f815a530 0x7f01f80b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01f8071260 0x7f01f8151e00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 --2- 172.21.15.162:0/862769278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f806d7a0 0x7f01f8150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 >> 172.21.15.162:0/862769278 conn(0x7f01f80b0cd0 msgr2=0x7f01f806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:32.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 shutdown_connections 2024-01-20T11:09:32.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.081+0000 7f01fea00640 1 -- 172.21.15.162:0/862769278 wait complete. 2024-01-20T11:09:32.100 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-01-20T11:09:31.617032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246652,"kb_used_data":5512,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728068,"statfs":{"total":773094113280,"available":772841541632,"internally_reserved":0,"allocated":5644288,"data_stored":2968892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001847"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679698+0000","last_change":"2024-01-20T11:09:26.704261+0000","last_active":"2024-01-20T11:09:27.679698+0000","last_peered":"2024-01-20T11:09:27.679698+0000","last_clean":"2024-01-20T11:09:27.679698+0000","last_became_active":"2024-01-20T11:09:26.696063+0000","last_became_peered":"2024-01-20T11:09:26.696063+0000","last_unstale":"2024-01-20T11:09:27.679698+0000","last_undegraded":"2024-01-20T11:09:27.679698+0000","last_fullsized":"2024-01-20T11:09:27.679698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:05.315505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678398+0000","last_change":"2024-01-20T11:09:26.672672+0000","last_active":"2024-01-20T11:09:27.678398+0000","last_peered":"2024-01-20T11:09:27.678398+0000","last_clean":"2024-01-20T11:09:27.678398+0000","last_became_active":"2024-01-20T11:09:26.671885+0000","last_became_peered":"2024-01-20T11:09:26.671885+0000","last_unstale":"2024-01-20T11:09:27.678398+0000","last_undegraded":"2024-01-20T11:09:27.678398+0000","last_fullsized":"2024-01-20T11:09:27.678398+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:57.604746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429184+0000","last_change":"2024-01-20T11:09:26.689755+0000","last_active":"2024-01-20T11:09:28.429184+0000","last_peered":"2024-01-20T11:09:28.429184+0000","last_clean":"2024-01-20T11:09:28.429184+0000","last_became_active":"2024-01-20T11:09:26.689458+0000","last_became_peered":"2024-01-20T11:09:26.689458+0000","last_unstale":"2024-01-20T11:09:28.429184+0000","last_undegraded":"2024-01-20T11:09:28.429184+0000","last_fullsized":"2024-01-20T11:09:28.429184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:21:59.383614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192164+0000","last_change":"2024-01-20T11:09:26.685585+0000","last_active":"2024-01-20T11:09:28.192164+0000","last_peered":"2024-01-20T11:09:28.192164+0000","last_clean":"2024-01-20T11:09:28.192164+0000","last_became_active":"2024-01-20T11:09:26.683586+0000","last_became_peered":"2024-01-20T11:09:26.683586+0000","last_unstale":"2024-01-20T11:09:28.192164+0000","last_undegraded":"2024-01-20T11:09:28.192164+0000","last_fullsized":"2024-01-20T11:09:28.192164+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678174+0000","last_change":"2024-01-20T11:09:26.675354+0000","last_active":"2024-01-20T11:09:27.678174+0000","last_peered":"2024-01-20T11:09:27.678174+0000","last_clean":"2024-01-20T11:09:27.678174+0000","last_became_active":"2024-01-20T11:09:26.674942+0000","last_became_peered":"2024-01-20T11:09:26.674942+0000","last_unstale":"2024-01-20T11:09:27.678174+0000","last_undegraded":"2024-01-20T11:09:27.678174+0000","last_fullsized":"2024-01-20T11:09:27.678174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:26.979517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430774+0000","last_change":"2024-01-20T11:09:26.695334+0000","last_active":"2024-01-20T11:09:28.430774+0000","last_peered":"2024-01-20T11:09:28.430774+0000","last_clean":"2024-01-20T11:09:28.430774+0000","last_became_active":"2024-01-20T11:09:26.695044+0000","last_became_peered":"2024-01-20T11:09:26.695044+0000","last_unstale":"2024-01-20T11:09:28.430774+0000","last_undegraded":"2024-01-20T11:09:28.430774+0000","last_fullsized":"2024-01-20T11:09:28.430774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:18:44.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678120+0000","last_change":"2024-01-20T11:09:26.705212+0000","last_active":"2024-01-20T11:09:27.678120+0000","last_peered":"2024-01-20T11:09:27.678120+0000","last_clean":"2024-01-20T11:09:27.678120+0000","last_became_active":"2024-01-20T11:09:26.702807+0000","last_became_peered":"2024-01-20T11:09:26.702807+0000","last_unstale":"2024-01-20T11:09:27.678120+0000","last_undegraded":"2024-01-20T11:09:27.678120+0000","last_fullsized":"2024-01-20T11:09:27.678120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191291+0000","last_change":"2024-01-20T11:09:26.688539+0000","last_active":"2024-01-20T11:09:28.191291+0000","last_peered":"2024-01-20T11:09:28.191291+0000","last_clean":"2024-01-20T11:09:28.191291+0000","last_became_active":"2024-01-20T11:09:26.688265+0000","last_became_peered":"2024-01-20T11:09:26.688265+0000","last_unstale":"2024-01-20T11:09:28.191291+0000","last_undegraded":"2024-01-20T11:09:28.191291+0000","last_fullsized":"2024-01-20T11:09:28.191291+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:28.827941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192807+0000","last_change":"2024-01-20T11:09:26.680892+0000","last_active":"2024-01-20T11:09:28.192807+0000","last_peered":"2024-01-20T11:09:28.192807+0000","last_clean":"2024-01-20T11:09:28.192807+0000","last_became_active":"2024-01-20T11:09:26.680592+0000","last_became_peered":"2024-01-20T11:09:26.680592+0000","last_unstale":"2024-01-20T11:09:28.192807+0000","last_undegraded":"2024-01-20T11:09:28.192807+0000","last_fullsized":"2024-01-20T11:09:28.192807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:27:21.085164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192500+0000","last_change":"2024-01-20T11:09:26.687226+0000","last_active":"2024-01-20T11:09:28.192500+0000","last_peered":"2024-01-20T11:09:28.192500+0000","last_clean":"2024-01-20T11:09:28.192500+0000","last_became_active":"2024-01-20T11:09:26.686979+0000","last_became_peered":"2024-01-20T11:09:26.686979+0000","last_unstale":"2024-01-20T11:09:28.192500+0000","last_undegraded":"2024-01-20T11:09:28.192500+0000","last_fullsized":"2024-01-20T11:09:28.192500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:24:12.697565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192120+0000","last_change":"2024-01-20T11:09:26.693786+0000","last_active":"2024-01-20T11:09:28.192120+0000","last_peered":"2024-01-20T11:09:28.192120+0000","last_clean":"2024-01-20T11:09:28.192120+0000","last_became_active":"2024-01-20T11:09:26.693524+0000","last_became_peered":"2024-01-20T11:09:26.693524+0000","last_unstale":"2024-01-20T11:09:28.192120+0000","last_undegraded":"2024-01-20T11:09:28.192120+0000","last_fullsized":"2024-01-20T11:09:28.192120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:26.979517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678672+0000","last_change":"2024-01-20T11:09:26.683665+0000","last_active":"2024-01-20T11:09:27.678672+0000","last_peered":"2024-01-20T11:09:27.678672+0000","last_clean":"2024-01-20T11:09:27.678672+0000","last_became_active":"2024-01-20T11:09:26.683369+0000","last_became_peered":"2024-01-20T11:09:26.683369+0000","last_unstale":"2024-01-20T11:09:27.678672+0000","last_undegraded":"2024-01-20T11:09:27.678672+0000","last_fullsized":"2024-01-20T11:09:27.678672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677024+0000","last_change":"2024-01-20T11:09:26.695303+0000","last_active":"2024-01-20T11:09:27.677024+0000","last_peered":"2024-01-20T11:09:27.677024+0000","last_clean":"2024-01-20T11:09:27.677024+0000","last_became_active":"2024-01-20T11:09:26.695018+0000","last_became_peered":"2024-01-20T11:09:26.695018+0000","last_unstale":"2024-01-20T11:09:27.677024+0000","last_undegraded":"2024-01-20T11:09:27.677024+0000","last_fullsized":"2024-01-20T11:09:27.677024+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:16:14.451123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191741+0000","last_change":"2024-01-20T11:09:26.684122+0000","last_active":"2024-01-20T11:09:28.191741+0000","last_peered":"2024-01-20T11:09:28.191741+0000","last_clean":"2024-01-20T11:09:28.191741+0000","last_became_active":"2024-01-20T11:09:26.683772+0000","last_became_peered":"2024-01-20T11:09:26.683772+0000","last_unstale":"2024-01-20T11:09:28.191741+0000","last_undegraded":"2024-01-20T11:09:28.191741+0000","last_fullsized":"2024-01-20T11:09:28.191741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:34:36.188038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430653+0000","last_change":"2024-01-20T11:09:26.679970+0000","last_active":"2024-01-20T11:09:28.430653+0000","last_peered":"2024-01-20T11:09:28.430653+0000","last_clean":"2024-01-20T11:09:28.430653+0000","last_became_active":"2024-01-20T11:09:26.679604+0000","last_became_peered":"2024-01-20T11:09:26.679604+0000","last_unstale":"2024-01-20T11:09:28.430653+0000","last_undegraded":"2024-01-20T11:09:28.430653+0000","last_fullsized":"2024-01-20T11:09:28.430653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:09:57.629408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.719963+0000","last_change":"2024-01-20T11:09:26.681801+0000","last_active":"2024-01-20T11:09:27.719963+0000","last_peered":"2024-01-20T11:09:27.719963+0000","last_clean":"2024-01-20T11:09:27.719963+0000","last_became_active":"2024-01-20T11:09:26.681407+0000","last_became_peered":"2024-01-20T11:09:26.681407+0000","last_unstale":"2024-01-20T11:09:27.719963+0000","last_undegraded":"2024-01-20T11:09:27.719963+0000","last_fullsized":"2024-01-20T11:09:27.719963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:00:48.815425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429351+0000","last_change":"2024-01-20T11:09:26.691803+0000","last_active":"2024-01-20T11:09:28.429351+0000","last_peered":"2024-01-20T11:09:28.429351+0000","last_clean":"2024-01-20T11:09:28.429351+0000","last_became_active":"2024-01-20T11:09:26.690812+0000","last_became_peered":"2024-01-20T11:09:26.690812+0000","last_unstale":"2024-01-20T11:09:28.429351+0000","last_undegraded":"2024-01-20T11:09:28.429351+0000","last_fullsized":"2024-01-20T11:09:28.429351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:25.665790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429392+0000","last_change":"2024-01-20T11:09:26.682398+0000","last_active":"2024-01-20T11:09:28.429392+0000","last_peered":"2024-01-20T11:09:28.429392+0000","last_clean":"2024-01-20T11:09:28.429392+0000","last_became_active":"2024-01-20T11:09:26.680035+0000","last_became_peered":"2024-01-20T11:09:26.680035+0000","last_unstale":"2024-01-20T11:09:28.429392+0000","last_undegraded":"2024-01-20T11:09:28.429392+0000","last_fullsized":"2024-01-20T11:09:28.429392+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:35.069387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.721088+0000","last_change":"2024-01-20T11:09:26.683156+0000","last_active":"2024-01-20T11:09:27.721088+0000","last_peered":"2024-01-20T11:09:27.721088+0000","last_clean":"2024-01-20T11:09:27.721088+0000","last_became_active":"2024-01-20T11:09:26.682878+0000","last_became_peered":"2024-01-20T11:09:26.682878+0000","last_unstale":"2024-01-20T11:09:27.721088+0000","last_undegraded":"2024-01-20T11:09:27.721088+0000","last_fullsized":"2024-01-20T11:09:27.721088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:49.465712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677274+0000","last_change":"2024-01-20T11:09:26.692694+0000","last_active":"2024-01-20T11:09:27.677274+0000","last_peered":"2024-01-20T11:09:27.677274+0000","last_clean":"2024-01-20T11:09:27.677274+0000","last_became_active":"2024-01-20T11:09:26.692380+0000","last_became_peered":"2024-01-20T11:09:26.692380+0000","last_unstale":"2024-01-20T11:09:27.677274+0000","last_undegraded":"2024-01-20T11:09:27.677274+0000","last_fullsized":"2024-01-20T11:09:27.677274+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:13:25.098120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431101+0000","last_change":"2024-01-20T11:09:26.685828+0000","last_active":"2024-01-20T11:09:28.431101+0000","last_peered":"2024-01-20T11:09:28.431101+0000","last_clean":"2024-01-20T11:09:28.431101+0000","last_became_active":"2024-01-20T11:09:26.685539+0000","last_became_peered":"2024-01-20T11:09:26.685539+0000","last_unstale":"2024-01-20T11:09:28.431101+0000","last_undegraded":"2024-01-20T11:09:28.431101+0000","last_fullsized":"2024-01-20T11:09:28.431101+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:20:01.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192172+0000","last_change":"2024-01-20T11:09:26.698211+0000","last_active":"2024-01-20T11:09:28.192172+0000","last_peered":"2024-01-20T11:09:28.192172+0000","last_clean":"2024-01-20T11:09:28.192172+0000","last_became_active":"2024-01-20T11:09:26.698031+0000","last_became_peered":"2024-01-20T11:09:26.698031+0000","last_unstale":"2024-01-20T11:09:28.192172+0000","last_undegraded":"2024-01-20T11:09:28.192172+0000","last_fullsized":"2024-01-20T11:09:28.192172+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720053+0000","last_change":"2024-01-20T11:09:26.691953+0000","last_active":"2024-01-20T11:09:27.720053+0000","last_peered":"2024-01-20T11:09:27.720053+0000","last_clean":"2024-01-20T11:09:27.720053+0000","last_became_active":"2024-01-20T11:09:26.691320+0000","last_became_peered":"2024-01-20T11:09:26.691320+0000","last_unstale":"2024-01-20T11:09:27.720053+0000","last_undegraded":"2024-01-20T11:09:27.720053+0000","last_fullsized":"2024-01-20T11:09:27.720053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:56:22.681327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.719993+0000","last_change":"2024-01-20T11:09:26.693837+0000","last_active":"2024-01-20T11:09:27.719993+0000","last_peered":"2024-01-20T11:09:27.719993+0000","last_clean":"2024-01-20T11:09:27.719993+0000","last_became_active":"2024-01-20T11:09:26.690047+0000","last_became_peered":"2024-01-20T11:09:26.690047+0000","last_unstale":"2024-01-20T11:09:27.719993+0000","last_undegraded":"2024-01-20T11:09:27.719993+0000","last_fullsized":"2024-01-20T11:09:27.719993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:09.839957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720709+0000","last_change":"2024-01-20T11:09:26.695991+0000","last_active":"2024-01-20T11:09:27.720709+0000","last_peered":"2024-01-20T11:09:27.720709+0000","last_clean":"2024-01-20T11:09:27.720709+0000","last_became_active":"2024-01-20T11:09:26.695701+0000","last_became_peered":"2024-01-20T11:09:26.695701+0000","last_unstale":"2024-01-20T11:09:27.720709+0000","last_undegraded":"2024-01-20T11:09:27.720709+0000","last_fullsized":"2024-01-20T11:09:27.720709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:48.713928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677754+0000","last_change":"2024-01-20T11:09:26.686603+0000","last_active":"2024-01-20T11:09:27.677754+0000","last_peered":"2024-01-20T11:09:27.677754+0000","last_clean":"2024-01-20T11:09:27.677754+0000","last_became_active":"2024-01-20T11:09:26.686326+0000","last_became_peered":"2024-01-20T11:09:26.686326+0000","last_unstale":"2024-01-20T11:09:27.677754+0000","last_undegraded":"2024-01-20T11:09:27.677754+0000","last_fullsized":"2024-01-20T11:09:27.677754+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:47.399814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429500+0000","last_change":"2024-01-20T11:09:26.690872+0000","last_active":"2024-01-20T11:09:28.429500+0000","last_peered":"2024-01-20T11:09:28.429500+0000","last_clean":"2024-01-20T11:09:28.429500+0000","last_became_active":"2024-01-20T11:09:26.690548+0000","last_became_peered":"2024-01-20T11:09:26.690548+0000","last_unstale":"2024-01-20T11:09:28.429500+0000","last_undegraded":"2024-01-20T11:09:28.429500+0000","last_fullsized":"2024-01-20T11:09:28.429500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:09:35.885362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678798+0000","last_change":"2024-01-20T11:09:26.683619+0000","last_active":"2024-01-20T11:09:27.678798+0000","last_peered":"2024-01-20T11:09:27.678798+0000","last_clean":"2024-01-20T11:09:27.678798+0000","last_became_active":"2024-01-20T11:09:26.682936+0000","last_became_peered":"2024-01-20T11:09:26.682936+0000","last_unstale":"2024-01-20T11:09:27.678798+0000","last_undegraded":"2024-01-20T11:09:27.678798+0000","last_fullsized":"2024-01-20T11:09:27.678798+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720425+0000","last_change":"2024-01-20T11:09:26.681935+0000","last_active":"2024-01-20T11:09:27.720425+0000","last_peered":"2024-01-20T11:09:27.720425+0000","last_clean":"2024-01-20T11:09:27.720425+0000","last_became_active":"2024-01-20T11:09:26.681629+0000","last_became_peered":"2024-01-20T11:09:26.681629+0000","last_unstale":"2024-01-20T11:09:27.720425+0000","last_undegraded":"2024-01-20T11:09:27.720425+0000","last_fullsized":"2024-01-20T11:09:27.720425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:37:37.827422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429138+0000","last_change":"2024-01-20T11:09:26.691057+0000","last_active":"2024-01-20T11:09:28.429138+0000","last_peered":"2024-01-20T11:09:28.429138+0000","last_clean":"2024-01-20T11:09:28.429138+0000","last_became_active":"2024-01-20T11:09:26.690775+0000","last_became_peered":"2024-01-20T11:09:26.690775+0000","last_unstale":"2024-01-20T11:09:28.429138+0000","last_undegraded":"2024-01-20T11:09:28.429138+0000","last_fullsized":"2024-01-20T11:09:28.429138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:22:40.795037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430947+0000","last_change":"2024-01-20T11:09:26.669802+0000","last_active":"2024-01-20T11:09:28.430947+0000","last_peered":"2024-01-20T11:09:28.430947+0000","last_clean":"2024-01-20T11:09:28.430947+0000","last_became_active":"2024-01-20T11:09:26.669511+0000","last_became_peered":"2024-01-20T11:09:26.669511+0000","last_unstale":"2024-01-20T11:09:28.430947+0000","last_undegraded":"2024-01-20T11:09:28.430947+0000","last_fullsized":"2024-01-20T11:09:28.430947+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:54.684647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.676810+0000","last_change":"2024-01-20T11:09:26.698320+0000","last_active":"2024-01-20T11:09:27.676810+0000","last_peered":"2024-01-20T11:09:27.676810+0000","last_clean":"2024-01-20T11:09:27.676810+0000","last_became_active":"2024-01-20T11:09:26.697279+0000","last_became_peered":"2024-01-20T11:09:26.697279+0000","last_unstale":"2024-01-20T11:09:27.676810+0000","last_undegraded":"2024-01-20T11:09:27.676810+0000","last_fullsized":"2024-01-20T11:09:27.676810+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:40:37.036709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429981+0000","last_change":"2024-01-20T11:09:26.685625+0000","last_active":"2024-01-20T11:09:28.429981+0000","last_peered":"2024-01-20T11:09:28.429981+0000","last_clean":"2024-01-20T11:09:28.429981+0000","last_became_active":"2024-01-20T11:09:26.685352+0000","last_became_peered":"2024-01-20T11:09:26.685352+0000","last_unstale":"2024-01-20T11:09:28.429981+0000","last_undegraded":"2024-01-20T11:09:28.429981+0000","last_fullsized":"2024-01-20T11:09:28.429981+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:50.567638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.706029+0000","last_change":"2024-01-20T11:09:25.667528+0000","last_active":"2024-01-20T11:09:26.706029+0000","last_peered":"2024-01-20T11:09:26.706029+0000","last_clean":"2024-01-20T11:09:26.706029+0000","last_became_active":"2024-01-20T11:09:25.667261+0000","last_became_peered":"2024-01-20T11:09:25.667261+0000","last_unstale":"2024-01-20T11:09:26.706029+0000","last_undegraded":"2024-01-20T11:09:26.706029+0000","last_fullsized":"2024-01-20T11:09:26.706029+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:25.965805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720688+0000","last_change":"2024-01-20T11:09:26.695261+0000","last_active":"2024-01-20T11:09:27.720688+0000","last_peered":"2024-01-20T11:09:27.720688+0000","last_clean":"2024-01-20T11:09:27.720688+0000","last_became_active":"2024-01-20T11:09:26.694955+0000","last_became_peered":"2024-01-20T11:09:26.694955+0000","last_unstale":"2024-01-20T11:09:27.720688+0000","last_undegraded":"2024-01-20T11:09:27.720688+0000","last_fullsized":"2024-01-20T11:09:27.720688+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:33:51.492845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.703179+0000","last_change":"2024-01-20T11:09:25.666647+0000","last_active":"2024-01-20T11:09:26.703179+0000","last_peered":"2024-01-20T11:09:26.703179+0000","last_clean":"2024-01-20T11:09:26.703179+0000","last_became_active":"2024-01-20T11:09:25.666288+0000","last_became_peered":"2024-01-20T11:09:25.666288+0000","last_unstale":"2024-01-20T11:09:26.703179+0000","last_undegraded":"2024-01-20T11:09:26.703179+0000","last_fullsized":"2024-01-20T11:09:26.703179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:33:39.669648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678930+0000","last_change":"2024-01-20T11:09:26.676550+0000","last_active":"2024-01-20T11:09:27.678930+0000","last_peered":"2024-01-20T11:09:27.678930+0000","last_clean":"2024-01-20T11:09:27.678930+0000","last_became_active":"2024-01-20T11:09:26.675866+0000","last_became_peered":"2024-01-20T11:09:26.675866+0000","last_unstale":"2024-01-20T11:09:27.678930+0000","last_undegraded":"2024-01-20T11:09:27.678930+0000","last_fullsized":"2024-01-20T11:09:27.678930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.705952+0000","last_change":"2024-01-20T11:09:25.668001+0000","last_active":"2024-01-20T11:09:26.705952+0000","last_peered":"2024-01-20T11:09:26.705952+0000","last_clean":"2024-01-20T11:09:26.705952+0000","last_became_active":"2024-01-20T11:09:25.666885+0000","last_became_peered":"2024-01-20T11:09:25.666885+0000","last_unstale":"2024-01-20T11:09:26.705952+0000","last_undegraded":"2024-01-20T11:09:26.705952+0000","last_fullsized":"2024-01-20T11:09:26.705952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:33:39.669648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429983+0000","last_change":"2024-01-20T11:09:26.697162+0000","last_active":"2024-01-20T11:09:28.429983+0000","last_peered":"2024-01-20T11:09:28.429983+0000","last_clean":"2024-01-20T11:09:28.429983+0000","last_became_active":"2024-01-20T11:09:26.696896+0000","last_became_peered":"2024-01-20T11:09:26.696896+0000","last_unstale":"2024-01-20T11:09:28.429983+0000","last_undegraded":"2024-01-20T11:09:28.429983+0000","last_fullsized":"2024-01-20T11:09:28.429983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:13:02.857985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.704804+0000","last_change":"2024-01-20T11:09:25.675465+0000","last_active":"2024-01-20T11:09:26.704804+0000","last_peered":"2024-01-20T11:09:26.704804+0000","last_clean":"2024-01-20T11:09:26.704804+0000","last_became_active":"2024-01-20T11:09:25.675109+0000","last_became_peered":"2024-01-20T11:09:25.675109+0000","last_unstale":"2024-01-20T11:09:26.704804+0000","last_undegraded":"2024-01-20T11:09:26.704804+0000","last_fullsized":"2024-01-20T11:09:26.704804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:27.814229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429038+0000","last_change":"2024-01-20T11:09:26.700874+0000","last_active":"2024-01-20T11:09:28.429038+0000","last_peered":"2024-01-20T11:09:28.429038+0000","last_clean":"2024-01-20T11:09:28.429038+0000","last_became_active":"2024-01-20T11:09:26.700576+0000","last_became_peered":"2024-01-20T11:09:26.700576+0000","last_unstale":"2024-01-20T11:09:28.429038+0000","last_undegraded":"2024-01-20T11:09:28.429038+0000","last_fullsized":"2024-01-20T11:09:28.429038+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:04:10.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707269+0000","last_change":"2024-01-20T11:09:25.668050+0000","last_active":"2024-01-20T11:09:26.707269+0000","last_peered":"2024-01-20T11:09:26.707269+0000","last_clean":"2024-01-20T11:09:26.707269+0000","last_became_active":"2024-01-20T11:09:25.667619+0000","last_became_peered":"2024-01-20T11:09:25.667619+0000","last_unstale":"2024-01-20T11:09:26.707269+0000","last_undegraded":"2024-01-20T11:09:26.707269+0000","last_fullsized":"2024-01-20T11:09:26.707269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:18:54.420184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191827+0000","last_change":"2024-01-20T11:09:26.686513+0000","last_active":"2024-01-20T11:09:28.191827+0000","last_peered":"2024-01-20T11:09:28.191827+0000","last_clean":"2024-01-20T11:09:28.191827+0000","last_became_active":"2024-01-20T11:09:26.686105+0000","last_became_peered":"2024-01-20T11:09:26.686105+0000","last_unstale":"2024-01-20T11:09:28.191827+0000","last_undegraded":"2024-01-20T11:09:28.191827+0000","last_fullsized":"2024-01-20T11:09:28.191827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:49.930023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.705873+0000","last_change":"2024-01-20T11:09:25.670665+0000","last_active":"2024-01-20T11:09:26.705873+0000","last_peered":"2024-01-20T11:09:26.705873+0000","last_clean":"2024-01-20T11:09:26.705873+0000","last_became_active":"2024-01-20T11:09:25.668663+0000","last_became_peered":"2024-01-20T11:09:25.668663+0000","last_unstale":"2024-01-20T11:09:26.705873+0000","last_undegraded":"2024-01-20T11:09:26.705873+0000","last_fullsized":"2024-01-20T11:09:26.705873+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:46:18.356782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191548+0000","last_change":"2024-01-20T11:09:26.689081+0000","last_active":"2024-01-20T11:09:28.191548+0000","last_peered":"2024-01-20T11:09:28.191548+0000","last_clean":"2024-01-20T11:09:28.191548+0000","last_became_active":"2024-01-20T11:09:26.683874+0000","last_became_peered":"2024-01-20T11:09:26.683874+0000","last_unstale":"2024-01-20T11:09:28.191548+0000","last_undegraded":"2024-01-20T11:09:28.191548+0000","last_fullsized":"2024-01-20T11:09:28.191548+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:13.179098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.658217+0000","last_change":"2024-01-20T11:09:25.665896+0000","last_active":"2024-01-20T11:09:26.658217+0000","last_peered":"2024-01-20T11:09:26.658217+0000","last_clean":"2024-01-20T11:09:26.658217+0000","last_became_active":"2024-01-20T11:09:25.665634+0000","last_became_peered":"2024-01-20T11:09:25.665634+0000","last_unstale":"2024-01-20T11:09:26.658217+0000","last_undegraded":"2024-01-20T11:09:26.658217+0000","last_fullsized":"2024-01-20T11:09:26.658217+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:48.452000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720142+0000","last_change":"2024-01-20T11:09:26.692166+0000","last_active":"2024-01-20T11:09:27.720142+0000","last_peered":"2024-01-20T11:09:27.720142+0000","last_clean":"2024-01-20T11:09:27.720142+0000","last_became_active":"2024-01-20T11:09:26.691691+0000","last_became_peered":"2024-01-20T11:09:26.691691+0000","last_unstale":"2024-01-20T11:09:27.720142+0000","last_undegraded":"2024-01-20T11:09:27.720142+0000","last_fullsized":"2024-01-20T11:09:27.720142+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:10:42.934886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655288+0000","last_change":"2024-01-20T11:09:25.653806+0000","last_active":"2024-01-20T11:09:26.655288+0000","last_peered":"2024-01-20T11:09:26.655288+0000","last_clean":"2024-01-20T11:09:26.655288+0000","last_became_active":"2024-01-20T11:09:25.653522+0000","last_became_peered":"2024-01-20T11:09:25.653522+0000","last_unstale":"2024-01-20T11:09:26.655288+0000","last_undegraded":"2024-01-20T11:09:26.655288+0000","last_fullsized":"2024-01-20T11:09:26.655288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:55:51.642082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429710+0000","last_change":"2024-01-20T11:09:26.681612+0000","last_active":"2024-01-20T11:09:28.429710+0000","last_peered":"2024-01-20T11:09:28.429710+0000","last_clean":"2024-01-20T11:09:28.429710+0000","last_became_active":"2024-01-20T11:09:26.679392+0000","last_became_peered":"2024-01-20T11:09:26.679392+0000","last_unstale":"2024-01-20T11:09:28.429710+0000","last_undegraded":"2024-01-20T11:09:28.429710+0000","last_fullsized":"2024-01-20T11:09:28.429710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:37.076431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.683513+0000","last_change":"2024-01-20T11:09:25.662752+0000","last_active":"2024-01-20T11:09:26.683513+0000","last_peered":"2024-01-20T11:09:26.683513+0000","last_clean":"2024-01-20T11:09:26.683513+0000","last_became_active":"2024-01-20T11:09:25.660279+0000","last_became_peered":"2024-01-20T11:09:25.660279+0000","last_unstale":"2024-01-20T11:09:26.683513+0000","last_undegraded":"2024-01-20T11:09:26.683513+0000","last_fullsized":"2024-01-20T11:09:26.683513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:56:07.984070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679739+0000","last_change":"2024-01-20T11:09:26.698206+0000","last_active":"2024-01-20T11:09:27.679739+0000","last_peered":"2024-01-20T11:09:27.679739+0000","last_clean":"2024-01-20T11:09:27.679739+0000","last_became_active":"2024-01-20T11:09:26.697932+0000","last_became_peered":"2024-01-20T11:09:26.697932+0000","last_unstale":"2024-01-20T11:09:27.679739+0000","last_undegraded":"2024-01-20T11:09:27.679739+0000","last_fullsized":"2024-01-20T11:09:27.679739+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:25.570747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.658862+0000","last_change":"2024-01-20T11:09:25.667320+0000","last_active":"2024-01-20T11:09:26.658862+0000","last_peered":"2024-01-20T11:09:26.658862+0000","last_clean":"2024-01-20T11:09:26.658862+0000","last_became_active":"2024-01-20T11:09:25.667040+0000","last_became_peered":"2024-01-20T11:09:25.667040+0000","last_unstale":"2024-01-20T11:09:26.658862+0000","last_undegraded":"2024-01-20T11:09:26.658862+0000","last_fullsized":"2024-01-20T11:09:26.658862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:56.671058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431867+0000","last_change":"2024-01-20T11:09:26.684466+0000","last_active":"2024-01-20T11:09:28.431867+0000","last_peered":"2024-01-20T11:09:28.431867+0000","last_clean":"2024-01-20T11:09:28.431867+0000","last_became_active":"2024-01-20T11:09:26.684167+0000","last_became_peered":"2024-01-20T11:09:26.684167+0000","last_unstale":"2024-01-20T11:09:28.431867+0000","last_undegraded":"2024-01-20T11:09:28.431867+0000","last_fullsized":"2024-01-20T11:09:28.431867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:12:58.697408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707590+0000","last_change":"2024-01-20T11:09:25.674319+0000","last_active":"2024-01-20T11:09:26.707590+0000","last_peered":"2024-01-20T11:09:26.707590+0000","last_clean":"2024-01-20T11:09:26.707590+0000","last_became_active":"2024-01-20T11:09:25.674029+0000","last_became_peered":"2024-01-20T11:09:25.674029+0000","last_unstale":"2024-01-20T11:09:26.707590+0000","last_undegraded":"2024-01-20T11:09:26.707590+0000","last_fullsized":"2024-01-20T11:09:26.707590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:52.561712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679055+0000","last_change":"2024-01-20T11:09:26.705707+0000","last_active":"2024-01-20T11:09:27.679055+0000","last_peered":"2024-01-20T11:09:27.679055+0000","last_clean":"2024-01-20T11:09:27.679055+0000","last_became_active":"2024-01-20T11:09:26.705132+0000","last_became_peered":"2024-01-20T11:09:26.705132+0000","last_unstale":"2024-01-20T11:09:27.679055+0000","last_undegraded":"2024-01-20T11:09:27.679055+0000","last_fullsized":"2024-01-20T11:09:27.679055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.714184+0000","last_change":"2024-01-20T11:09:25.657996+0000","last_active":"2024-01-20T11:09:26.714184+0000","last_peered":"2024-01-20T11:09:26.714184+0000","last_clean":"2024-01-20T11:09:26.714184+0000","last_became_active":"2024-01-20T11:09:25.657691+0000","last_became_peered":"2024-01-20T11:09:25.657691+0000","last_unstale":"2024-01-20T11:09:26.714184+0000","last_undegraded":"2024-01-20T11:09:26.714184+0000","last_fullsized":"2024-01-20T11:09:26.714184+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:16.297500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720209+0000","last_change":"2024-01-20T11:09:26.678786+0000","last_active":"2024-01-20T11:09:27.720209+0000","last_peered":"2024-01-20T11:09:27.720209+0000","last_clean":"2024-01-20T11:09:27.720209+0000","last_became_active":"2024-01-20T11:09:26.678485+0000","last_became_peered":"2024-01-20T11:09:26.678485+0000","last_unstale":"2024-01-20T11:09:27.720209+0000","last_undegraded":"2024-01-20T11:09:27.720209+0000","last_fullsized":"2024-01-20T11:09:27.720209+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:20:22.030550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707366+0000","last_change":"2024-01-20T11:09:25.659501+0000","last_active":"2024-01-20T11:09:26.707366+0000","last_peered":"2024-01-20T11:09:26.707366+0000","last_clean":"2024-01-20T11:09:26.707366+0000","last_became_active":"2024-01-20T11:09:25.659195+0000","last_became_peered":"2024-01-20T11:09:25.659195+0000","last_unstale":"2024-01-20T11:09:26.707366+0000","last_undegraded":"2024-01-20T11:09:26.707366+0000","last_fullsized":"2024-01-20T11:09:26.707366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:12.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192151+0000","last_change":"2024-01-20T11:09:26.697813+0000","last_active":"2024-01-20T11:09:28.192151+0000","last_peered":"2024-01-20T11:09:28.192151+0000","last_clean":"2024-01-20T11:09:28.192151+0000","last_became_active":"2024-01-20T11:09:26.695970+0000","last_became_peered":"2024-01-20T11:09:26.695970+0000","last_unstale":"2024-01-20T11:09:28.192151+0000","last_undegraded":"2024-01-20T11:09:28.192151+0000","last_fullsized":"2024-01-20T11:09:28.192151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:57.604746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.682452+0000","last_change":"2024-01-20T11:09:25.672264+0000","last_active":"2024-01-20T11:09:26.682452+0000","last_peered":"2024-01-20T11:09:26.682452+0000","last_clean":"2024-01-20T11:09:26.682452+0000","last_became_active":"2024-01-20T11:09:25.671493+0000","last_became_peered":"2024-01-20T11:09:25.671493+0000","last_unstale":"2024-01-20T11:09:26.682452+0000","last_undegraded":"2024-01-20T11:09:26.682452+0000","last_fullsized":"2024-01-20T11:09:26.682452+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:48.452000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430204+0000","last_change":"2024-01-20T11:09:26.686494+0000","last_active":"2024-01-20T11:09:28.430204+0000","last_peered":"2024-01-20T11:09:28.430204+0000","last_clean":"2024-01-20T11:09:28.430204+0000","last_became_active":"2024-01-20T11:09:26.686013+0000","last_became_peered":"2024-01-20T11:09:26.686013+0000","last_unstale":"2024-01-20T11:09:28.430204+0000","last_undegraded":"2024-01-20T11:09:28.430204+0000","last_fullsized":"2024-01-20T11:09:28.430204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:43:46.695969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.664493+0000","last_change":"2024-01-20T11:09:25.659237+0000","last_active":"2024-01-20T11:09:26.664493+0000","last_peered":"2024-01-20T11:09:26.664493+0000","last_clean":"2024-01-20T11:09:26.664493+0000","last_became_active":"2024-01-20T11:09:25.658993+0000","last_became_peered":"2024-01-20T11:09:25.658993+0000","last_unstale":"2024-01-20T11:09:26.664493+0000","last_undegraded":"2024-01-20T11:09:26.664493+0000","last_fullsized":"2024-01-20T11:09:26.664493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:52:34.016988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678420+0000","last_change":"2024-01-20T11:09:26.700000+0000","last_active":"2024-01-20T11:09:27.678420+0000","last_peered":"2024-01-20T11:09:27.678420+0000","last_clean":"2024-01-20T11:09:27.678420+0000","last_became_active":"2024-01-20T11:09:26.699728+0000","last_became_peered":"2024-01-20T11:09:26.699728+0000","last_unstale":"2024-01-20T11:09:27.678420+0000","last_undegraded":"2024-01-20T11:09:27.678420+0000","last_fullsized":"2024-01-20T11:09:27.678420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.711587+0000","last_change":"2024-01-20T11:09:25.662705+0000","last_active":"2024-01-20T11:09:26.711587+0000","last_peered":"2024-01-20T11:09:26.711587+0000","last_clean":"2024-01-20T11:09:26.711587+0000","last_became_active":"2024-01-20T11:09:25.662103+0000","last_became_peered":"2024-01-20T11:09:25.662103+0000","last_unstale":"2024-01-20T11:09:26.711587+0000","last_undegraded":"2024-01-20T11:09:26.711587+0000","last_fullsized":"2024-01-20T11:09:26.711587+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:21.987470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677731+0000","last_change":"2024-01-20T11:09:26.684940+0000","last_active":"2024-01-20T11:09:27.677731+0000","last_peered":"2024-01-20T11:09:27.677731+0000","last_clean":"2024-01-20T11:09:27.677731+0000","last_became_active":"2024-01-20T11:09:26.684642+0000","last_became_peered":"2024-01-20T11:09:26.684642+0000","last_unstale":"2024-01-20T11:09:27.677731+0000","last_undegraded":"2024-01-20T11:09:27.677731+0000","last_fullsized":"2024-01-20T11:09:27.677731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:38.197779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707085+0000","last_change":"2024-01-20T11:09:25.660178+0000","last_active":"2024-01-20T11:09:26.707085+0000","last_peered":"2024-01-20T11:09:26.707085+0000","last_clean":"2024-01-20T11:09:26.707085+0000","last_became_active":"2024-01-20T11:09:25.659658+0000","last_became_peered":"2024-01-20T11:09:25.659658+0000","last_unstale":"2024-01-20T11:09:26.707085+0000","last_undegraded":"2024-01-20T11:09:26.707085+0000","last_fullsized":"2024-01-20T11:09:26.707085+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:49:45.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192778+0000","last_change":"2024-01-20T11:09:26.684848+0000","last_active":"2024-01-20T11:09:28.192778+0000","last_peered":"2024-01-20T11:09:28.192778+0000","last_clean":"2024-01-20T11:09:28.192778+0000","last_became_active":"2024-01-20T11:09:26.682804+0000","last_became_peered":"2024-01-20T11:09:26.682804+0000","last_unstale":"2024-01-20T11:09:28.192778+0000","last_undegraded":"2024-01-20T11:09:28.192778+0000","last_fullsized":"2024-01-20T11:09:28.192778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:25.570747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.701168+0000","last_change":"2024-01-20T11:09:25.661453+0000","last_active":"2024-01-20T11:09:26.701168+0000","last_peered":"2024-01-20T11:09:26.701168+0000","last_clean":"2024-01-20T11:09:26.701168+0000","last_became_active":"2024-01-20T11:09:25.660834+0000","last_became_peered":"2024-01-20T11:09:25.660834+0000","last_unstale":"2024-01-20T11:09:26.701168+0000","last_undegraded":"2024-01-20T11:09:26.701168+0000","last_fullsized":"2024-01-20T11:09:26.701168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:10.081431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720680+0000","last_change":"2024-01-20T11:09:26.679749+0000","last_active":"2024-01-20T11:09:27.720680+0000","last_peered":"2024-01-20T11:09:27.720680+0000","last_clean":"2024-01-20T11:09:27.720680+0000","last_became_active":"2024-01-20T11:09:26.679362+0000","last_became_peered":"2024-01-20T11:09:26.679362+0000","last_unstale":"2024-01-20T11:09:27.720680+0000","last_undegraded":"2024-01-20T11:09:27.720680+0000","last_fullsized":"2024-01-20T11:09:27.720680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:02:22.740219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.704508+0000","last_change":"2024-01-20T11:09:25.664841+0000","last_active":"2024-01-20T11:09:26.704508+0000","last_peered":"2024-01-20T11:09:26.704508+0000","last_clean":"2024-01-20T11:09:26.704508+0000","last_became_active":"2024-01-20T11:09:25.664637+0000","last_became_peered":"2024-01-20T11:09:25.664637+0000","last_unstale":"2024-01-20T11:09:26.704508+0000","last_undegraded":"2024-01-20T11:09:26.704508+0000","last_fullsized":"2024-01-20T11:09:26.704508+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.538731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720709+0000","last_change":"2024-01-20T11:09:26.684239+0000","last_active":"2024-01-20T11:09:27.720709+0000","last_peered":"2024-01-20T11:09:27.720709+0000","last_clean":"2024-01-20T11:09:27.720709+0000","last_became_active":"2024-01-20T11:09:26.683937+0000","last_became_peered":"2024-01-20T11:09:26.683937+0000","last_unstale":"2024-01-20T11:09:27.720709+0000","last_undegraded":"2024-01-20T11:09:27.720709+0000","last_fullsized":"2024-01-20T11:09:27.720709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:08:57.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.666904+0000","last_change":"2024-01-20T11:09:25.668814+0000","last_active":"2024-01-20T11:09:26.666904+0000","last_peered":"2024-01-20T11:09:26.666904+0000","last_clean":"2024-01-20T11:09:26.666904+0000","last_became_active":"2024-01-20T11:09:25.668549+0000","last_became_peered":"2024-01-20T11:09:25.668549+0000","last_unstale":"2024-01-20T11:09:26.666904+0000","last_undegraded":"2024-01-20T11:09:26.666904+0000","last_fullsized":"2024-01-20T11:09:26.666904+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:34:35.174326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430905+0000","last_change":"2024-01-20T11:09:26.684150+0000","last_active":"2024-01-20T11:09:28.430905+0000","last_peered":"2024-01-20T11:09:28.430905+0000","last_clean":"2024-01-20T11:09:28.430905+0000","last_became_active":"2024-01-20T11:09:26.683497+0000","last_became_peered":"2024-01-20T11:09:26.683497+0000","last_unstale":"2024-01-20T11:09:28.430905+0000","last_undegraded":"2024-01-20T11:09:28.430905+0000","last_fullsized":"2024-01-20T11:09:28.430905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:30.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707341+0000","last_change":"2024-01-20T11:09:25.664399+0000","last_active":"2024-01-20T11:09:26.707341+0000","last_peered":"2024-01-20T11:09:26.707341+0000","last_clean":"2024-01-20T11:09:26.707341+0000","last_became_active":"2024-01-20T11:09:25.664143+0000","last_became_peered":"2024-01-20T11:09:25.664143+0000","last_unstale":"2024-01-20T11:09:26.707341+0000","last_undegraded":"2024-01-20T11:09:26.707341+0000","last_fullsized":"2024-01-20T11:09:26.707341+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:27.814229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429516+0000","last_change":"2024-01-20T11:09:26.687665+0000","last_active":"2024-01-20T11:09:28.429516+0000","last_peered":"2024-01-20T11:09:28.429516+0000","last_clean":"2024-01-20T11:09:28.429516+0000","last_became_active":"2024-01-20T11:09:26.687432+0000","last_became_peered":"2024-01-20T11:09:26.687432+0000","last_unstale":"2024-01-20T11:09:28.429516+0000","last_undegraded":"2024-01-20T11:09:28.429516+0000","last_fullsized":"2024-01-20T11:09:28.429516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:51:53.803211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.657988+0000","last_change":"2024-01-20T11:09:25.673499+0000","last_active":"2024-01-20T11:09:26.657988+0000","last_peered":"2024-01-20T11:09:26.657988+0000","last_clean":"2024-01-20T11:09:26.657988+0000","last_became_active":"2024-01-20T11:09:25.673220+0000","last_became_peered":"2024-01-20T11:09:25.673220+0000","last_unstale":"2024-01-20T11:09:26.657988+0000","last_undegraded":"2024-01-20T11:09:26.657988+0000","last_fullsized":"2024-01-20T11:09:26.657988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:47.700216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.676887+0000","last_change":"2024-01-20T11:09:26.691210+0000","last_active":"2024-01-20T11:09:27.676887+0000","last_peered":"2024-01-20T11:09:27.676887+0000","last_clean":"2024-01-20T11:09:27.676887+0000","last_became_active":"2024-01-20T11:09:26.690903+0000","last_became_peered":"2024-01-20T11:09:26.690903+0000","last_unstale":"2024-01-20T11:09:27.676887+0000","last_undegraded":"2024-01-20T11:09:27.676887+0000","last_fullsized":"2024-01-20T11:09:27.676887+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:58:56.722085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655609+0000","last_change":"2024-01-20T11:09:25.661232+0000","last_active":"2024-01-20T11:09:26.655609+0000","last_peered":"2024-01-20T11:09:26.655609+0000","last_clean":"2024-01-20T11:09:26.655609+0000","last_became_active":"2024-01-20T11:09:25.660942+0000","last_became_peered":"2024-01-20T11:09:25.660942+0000","last_unstale":"2024-01-20T11:09:26.655609+0000","last_undegraded":"2024-01-20T11:09:26.655609+0000","last_fullsized":"2024-01-20T11:09:26.655609+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:32.999975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191448+0000","last_change":"2024-01-20T11:09:26.684507+0000","last_active":"2024-01-20T11:09:28.191448+0000","last_peered":"2024-01-20T11:09:28.191448+0000","last_clean":"2024-01-20T11:09:28.191448+0000","last_became_active":"2024-01-20T11:09:26.684201+0000","last_became_peered":"2024-01-20T11:09:26.684201+0000","last_unstale":"2024-01-20T11:09:28.191448+0000","last_undegraded":"2024-01-20T11:09:28.191448+0000","last_fullsized":"2024-01-20T11:09:28.191448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:40:39.955372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.678786+0000","last_change":"2024-01-20T11:09:25.673119+0000","last_active":"2024-01-20T11:09:26.678786+0000","last_peered":"2024-01-20T11:09:26.678786+0000","last_clean":"2024-01-20T11:09:26.678786+0000","last_became_active":"2024-01-20T11:09:25.672661+0000","last_became_peered":"2024-01-20T11:09:25.672661+0000","last_unstale":"2024-01-20T11:09:26.678786+0000","last_undegraded":"2024-01-20T11:09:26.678786+0000","last_fullsized":"2024-01-20T11:09:26.678786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.538731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720789+0000","last_change":"2024-01-20T11:09:26.684444+0000","last_active":"2024-01-20T11:09:27.720789+0000","last_peered":"2024-01-20T11:09:27.720789+0000","last_clean":"2024-01-20T11:09:27.720789+0000","last_became_active":"2024-01-20T11:09:26.684134+0000","last_became_peered":"2024-01-20T11:09:26.684134+0000","last_unstale":"2024-01-20T11:09:27.720789+0000","last_undegraded":"2024-01-20T11:09:27.720789+0000","last_fullsized":"2024-01-20T11:09:27.720789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:14.552443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.666196+0000","last_change":"2024-01-20T11:09:25.670430+0000","last_active":"2024-01-20T11:09:26.666196+0000","last_peered":"2024-01-20T11:09:26.666196+0000","last_clean":"2024-01-20T11:09:26.666196+0000","last_became_active":"2024-01-20T11:09:25.670202+0000","last_became_peered":"2024-01-20T11:09:25.670202+0000","last_unstale":"2024-01-20T11:09:26.666196+0000","last_undegraded":"2024-01-20T11:09:26.666196+0000","last_fullsized":"2024-01-20T11:09:26.666196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:40:38.941660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192165+0000","last_change":"2024-01-20T11:09:26.684054+0000","last_active":"2024-01-20T11:09:28.192165+0000","last_peered":"2024-01-20T11:09:28.192165+0000","last_clean":"2024-01-20T11:09:28.192165+0000","last_became_active":"2024-01-20T11:09:26.683673+0000","last_became_peered":"2024-01-20T11:09:26.683673+0000","last_unstale":"2024-01-20T11:09:28.192165+0000","last_undegraded":"2024-01-20T11:09:28.192165+0000","last_fullsized":"2024-01-20T11:09:28.192165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.685235+0000","last_change":"2024-01-20T11:09:25.674337+0000","last_active":"2024-01-20T11:09:26.685235+0000","last_peered":"2024-01-20T11:09:26.685235+0000","last_clean":"2024-01-20T11:09:26.685235+0000","last_became_active":"2024-01-20T11:09:25.674049+0000","last_became_peered":"2024-01-20T11:09:25.674049+0000","last_unstale":"2024-01-20T11:09:26.685235+0000","last_undegraded":"2024-01-20T11:09:26.685235+0000","last_fullsized":"2024-01-20T11:09:26.685235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:52:34.016988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679217+0000","last_change":"2024-01-20T11:09:26.696903+0000","last_active":"2024-01-20T11:09:27.679217+0000","last_peered":"2024-01-20T11:09:27.679217+0000","last_clean":"2024-01-20T11:09:27.679217+0000","last_became_active":"2024-01-20T11:09:26.696637+0000","last_became_peered":"2024-01-20T11:09:26.696637+0000","last_unstale":"2024-01-20T11:09:27.679217+0000","last_undegraded":"2024-01-20T11:09:27.679217+0000","last_fullsized":"2024-01-20T11:09:27.679217+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:24:12.697565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.680340+0000","last_change":"2024-01-20T11:09:25.666513+0000","last_active":"2024-01-20T11:09:26.680340+0000","last_peered":"2024-01-20T11:09:26.680340+0000","last_clean":"2024-01-20T11:09:26.680340+0000","last_became_active":"2024-01-20T11:09:25.666244+0000","last_became_peered":"2024-01-20T11:09:25.666244+0000","last_unstale":"2024-01-20T11:09:26.680340+0000","last_undegraded":"2024-01-20T11:09:26.680340+0000","last_fullsized":"2024-01-20T11:09:26.680340+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:56:07.984070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431152+0000","last_change":"2024-01-20T11:09:26.680250+0000","last_active":"2024-01-20T11:09:28.431152+0000","last_peered":"2024-01-20T11:09:28.431152+0000","last_clean":"2024-01-20T11:09:28.431152+0000","last_became_active":"2024-01-20T11:09:26.679033+0000","last_became_peered":"2024-01-20T11:09:26.679033+0000","last_unstale":"2024-01-20T11:09:28.431152+0000","last_undegraded":"2024-01-20T11:09:28.431152+0000","last_fullsized":"2024-01-20T11:09:28.431152+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:36:27.314299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.686667+0000","last_change":"2024-01-20T11:09:25.674417+0000","last_active":"2024-01-20T11:09:26.686667+0000","last_peered":"2024-01-20T11:09:26.686667+0000","last_clean":"2024-01-20T11:09:26.686667+0000","last_became_active":"2024-01-20T11:09:25.673890+0000","last_became_peered":"2024-01-20T11:09:25.673890+0000","last_unstale":"2024-01-20T11:09:26.686667+0000","last_undegraded":"2024-01-20T11:09:26.686667+0000","last_fullsized":"2024-01-20T11:09:26.686667+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:18:54.420184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431161+0000","last_change":"2024-01-20T11:09:26.689141+0000","last_active":"2024-01-20T11:09:28.431161+0000","last_peered":"2024-01-20T11:09:28.431161+0000","last_clean":"2024-01-20T11:09:28.431161+0000","last_became_active":"2024-01-20T11:09:26.687219+0000","last_became_peered":"2024-01-20T11:09:26.687219+0000","last_unstale":"2024-01-20T11:09:28.431161+0000","last_undegraded":"2024-01-20T11:09:28.431161+0000","last_fullsized":"2024-01-20T11:09:28.431161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:06.885960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.683013+0000","last_change":"2024-01-20T11:09:25.662705+0000","last_active":"2024-01-20T11:09:26.683013+0000","last_peered":"2024-01-20T11:09:26.683013+0000","last_clean":"2024-01-20T11:09:26.683013+0000","last_became_active":"2024-01-20T11:09:25.662444+0000","last_became_peered":"2024-01-20T11:09:25.662444+0000","last_unstale":"2024-01-20T11:09:26.683013+0000","last_undegraded":"2024-01-20T11:09:26.683013+0000","last_fullsized":"2024-01-20T11:09:26.683013+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:21:06.514985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677505+0000","last_change":"2024-01-20T11:09:26.698689+0000","last_active":"2024-01-20T11:09:27.677505+0000","last_peered":"2024-01-20T11:09:27.677505+0000","last_clean":"2024-01-20T11:09:27.677505+0000","last_became_active":"2024-01-20T11:09:26.698392+0000","last_became_peered":"2024-01-20T11:09:26.698392+0000","last_unstale":"2024-01-20T11:09:27.677505+0000","last_undegraded":"2024-01-20T11:09:27.677505+0000","last_fullsized":"2024-01-20T11:09:27.677505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:49.930023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.680077+0000","last_change":"2024-01-20T11:09:25.669178+0000","last_active":"2024-01-20T11:09:26.680077+0000","last_peered":"2024-01-20T11:09:26.680077+0000","last_clean":"2024-01-20T11:09:26.680077+0000","last_became_active":"2024-01-20T11:09:25.668816+0000","last_became_peered":"2024-01-20T11:09:25.668816+0000","last_unstale":"2024-01-20T11:09:26.680077+0000","last_undegraded":"2024-01-20T11:09:26.680077+0000","last_fullsized":"2024-01-20T11:09:26.680077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:21:06.514985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429031+0000","last_change":"2024-01-20T11:09:26.680872+0000","last_active":"2024-01-20T11:09:28.429031+0000","last_peered":"2024-01-20T11:09:28.429031+0000","last_clean":"2024-01-20T11:09:28.429031+0000","last_became_active":"2024-01-20T11:09:26.680017+0000","last_became_peered":"2024-01-20T11:09:26.680017+0000","last_unstale":"2024-01-20T11:09:28.429031+0000","last_undegraded":"2024-01-20T11:09:28.429031+0000","last_fullsized":"2024-01-20T11:09:28.429031+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:50:44.925247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655653+0000","last_change":"2024-01-20T11:09:25.662421+0000","last_active":"2024-01-20T11:09:26.655653+0000","last_peered":"2024-01-20T11:09:26.655653+0000","last_clean":"2024-01-20T11:09:26.655653+0000","last_became_active":"2024-01-20T11:09:25.661713+0000","last_became_peered":"2024-01-20T11:09:25.661713+0000","last_unstale":"2024-01-20T11:09:26.655653+0000","last_undegraded":"2024-01-20T11:09:26.655653+0000","last_fullsized":"2024-01-20T11:09:26.655653+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:55:05.992860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192700+0000","last_change":"2024-01-20T11:09:26.696785+0000","last_active":"2024-01-20T11:09:28.192700+0000","last_peered":"2024-01-20T11:09:28.192700+0000","last_clean":"2024-01-20T11:09:28.192700+0000","last_became_active":"2024-01-20T11:09:26.696524+0000","last_became_peered":"2024-01-20T11:09:26.696524+0000","last_unstale":"2024-01-20T11:09:28.192700+0000","last_undegraded":"2024-01-20T11:09:28.192700+0000","last_fullsized":"2024-01-20T11:09:28.192700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:05.315505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.706883+0000","last_change":"2024-01-20T11:09:25.666038+0000","last_active":"2024-01-20T11:09:26.706883+0000","last_peered":"2024-01-20T11:09:26.706883+0000","last_clean":"2024-01-20T11:09:26.706883+0000","last_became_active":"2024-01-20T11:09:25.663508+0000","last_became_peered":"2024-01-20T11:09:25.663508+0000","last_unstale":"2024-01-20T11:09:26.706883+0000","last_undegraded":"2024-01-20T11:09:26.706883+0000","last_fullsized":"2024-01-20T11:09:26.706883+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:52.561712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677775+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:09:27.677775+0000","last_peered":"2024-01-20T11:09:27.677775+0000","last_clean":"2024-01-20T11:09:27.677775+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:09:27.677775+0000","last_undegraded":"2024-01-20T11:09:27.677775+0000","last_fullsized":"2024-01-20T11:09:27.677775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":813375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.036}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.105},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.335}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.758},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.383}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.7070000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.873},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.28}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2210000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.859}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":223589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.296,"5min":3.343,"15min":3.343},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6830000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.216,"15min":1.2410000000000001},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.675,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4710000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2450000000000001,"15min":1.248},"min":{"1min":0.85699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.514,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.002},{"interface":"front","average":{"1min":1.226,"5min":1.294,"15min":1.3049999999999999},"min":{"1min":0.82299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.694,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.84899999999999998}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.284,"15min":1.2929999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.609,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.4690000000000001,"15min":1.488},"min":{"1min":1.0700000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.708,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.1419999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.4419999999999999},"min":{"1min":0.88600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.6399999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.347,"5min":1.355,"15min":1.3560000000000001},"min":{"1min":0.88100000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.768,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5309999999999999,"15min":1.542},"min":{"1min":1.1180000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9099999999999999,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.5369999999999999,"15min":1.5509999999999999},"min":{"1min":0.94399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9370000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.276}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":1.034,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.853,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.034},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.673,"15min":1.6910000000000001},"min":{"1min":1.0680000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9950000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.0680000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":222987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.1040000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.94699999999999995}]},{"osd":2,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.224},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.4359999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.278}]},{"osd":4,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.546},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.603}]},{"osd":6,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.649},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.4930000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.8149999999999999},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.391,"5min":1.391,"15min":1.391},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.736}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":561152,"data_stored":224529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.89700000000000002}]},{"osd":1,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.704}]},{"osd":2,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.048}]},{"osd":3,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.516},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.365}]},{"osd":5,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.6619999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.278},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.792}]},{"osd":7,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.472}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":223555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.88}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.012},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.532},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.4319999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.292},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.3979999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.343},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.4890000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.577},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.6240000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":224551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92600000000000005,"15min":0.85199999999999998},"min":{"1min":0.622,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":9.8870000000000005,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.1080000000000001,"15min":1.05},"min":{"1min":0.66900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.026,"5min":10.026,"15min":10.026},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.137,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":0.876},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.2090000000000001,"15min":1.129},"min":{"1min":0.66600000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":1.008}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.21,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":11.414999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.4359999999999999,"15min":1.367},"min":{"1min":0.95399999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":10.919,"5min":10.919,"15min":10.919},"last":0.90200000000000002}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.4990000000000001,"15min":1.4350000000000001},"min":{"1min":1.073,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":11.1,"5min":11.1,"15min":11.1},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.996,"5min":1.54,"15min":1.464},"min":{"1min":0.89600000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":11.141999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.4199999999999999,"15min":1.3799999999999999},"min":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":10.077999999999999,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.401,"15min":1.3899999999999999},"min":{"1min":1.0920000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.3}]},{"osd":6,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.6499999999999999,"15min":1.5760000000000001},"min":{"1min":1.22,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":11.185,"5min":11.185,"15min":11.185},"last":1.157},{"interface":"front","average":{"1min":1.845,"5min":1.536,"15min":1.484},"min":{"1min":1.008,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":1.377}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.52,"15min":1.4670000000000001},"min":{"1min":0.96999999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":10.234999999999999,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.234},{"interface":"front","average":{"1min":1.956,"5min":1.512,"15min":1.4379999999999999},"min":{"1min":1.2549999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":9.843,"5min":9.843,"15min":9.843},"last":1.1339999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":222987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.0549999999999999,"15min":1.01},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":12.061,"5min":12.061,"15min":12.061},"last":1.208},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1739999999999999,"15min":1.165},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":1.5009999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.04,"15min":1.054},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.3929999999999998,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.032},{"interface":"front","average":{"1min":1.889,"5min":1.3520000000000001,"15min":1.262},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.204999999999998,"5min":20.204999999999998,"15min":20.204999999999998},"last":1.333}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.278,"15min":1.232},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":11.978999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":1.6539999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.325,"15min":1.3540000000000001},"min":{"1min":0.77900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6839999999999999,"5min":5.21,"15min":5.21},"last":1.147},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.528,"15min":1.46},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":15.596,"5min":15.596,"15min":15.596},"last":1.591}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.5740000000000001,"15min":1.5649999999999999},"min":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.403},{"interface":"front","average":{"1min":1.296,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.966,"5min":5.242,"15min":5.242},"last":1.6220000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.6040000000000001,"15min":1.5900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":10.784000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.756},{"interface":"front","average":{"1min":1.282,"5min":1.423,"15min":1.4470000000000001},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.931,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.26}]},{"osd":7,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.601,"15min":1.5569999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.7150000000000001,"15min":1.6990000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":10.869999999999999,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.903}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":813319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.113,"5min":0.91000000000000003,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.1109999999999998,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":1.0209999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":1.357},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.90400000000000003,"15min":0.85999999999999999},"min":{"1min":0.48999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.976,"5min":5.976,"15min":5.976},"last":0.98199999999999998}]},{"osd":3,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.03,"15min":1.006},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":1.089},{"interface":"front","average":{"1min":1.29,"5min":1.042,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.2110000000000003,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":1.115}]},{"osd":4,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.2450000000000001,"15min":1.2110000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.2640000000000002,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":1.333},{"interface":"front","average":{"1min":1.347,"5min":1.25,"15min":1.234},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.647},{"interface":"front","average":{"1min":1.51,"5min":1.25,"15min":1.206},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":1.2390000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.2949999999999999,"15min":1.2749999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3899999999999999,"15min":1.3620000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5629999999999997,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.7529999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.337,"15min":1.296},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":6.1660000000000004,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.5169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:09:32.105 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-20T11:09:32.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.349+0000 7f4f3ba00640 1 Processor -- start 2024-01-20T11:09:32.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.349+0000 7f4f3ba00640 1 -- start start 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f3ba00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4f3406bc30 0x7f4f340b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f3ba00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3406e2e0 0x7f4f3406e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f3ba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4f3415da50 0x7f4f3415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f3ba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f34161360 con 0x7f4f3415da50 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f3ba00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3406ec80 con 0x7f4f3406bc30 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f3ba00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3415e980 con 0x7f4f3406e2e0 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f39a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4f3415da50 0x7f4f3415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f39a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4f3415da50 0x7f4f3415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42772/0 (socket says 172.21.15.162:42772) 2024-01-20T11:09:32.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.351+0000 7f4f39a00640 1 -- 172.21.15.162:0/272125235 learned_addr learned my addr 172.21.15.162:0/272125235 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:32.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f2bc00640 1 --2- 172.21.15.162:0/272125235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3406e2e0 0x7f4f3406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f39000640 1 --2- 172.21.15.162:0/272125235 >> v2:172.21.15.179:3300/0 conn(0x7f4f3406bc30 0x7f4f340b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f39a00640 1 -- 172.21.15.162:0/272125235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3406e2e0 msgr2=0x7f4f3406e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f39a00640 1 --2- 172.21.15.162:0/272125235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3406e2e0 0x7f4f3406e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f39a00640 1 -- 172.21.15.162:0/272125235 >> v2:172.21.15.179:3300/0 conn(0x7f4f3406bc30 msgr2=0x7f4f340b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f39a00640 1 --2- 172.21.15.162:0/272125235 >> v2:172.21.15.179:3300/0 conn(0x7f4f3406bc30 0x7f4f340b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f39a00640 1 -- 172.21.15.162:0/272125235 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340b39c0 con 0x7f4f3415da50 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f39000640 1 --2- 172.21.15.162:0/272125235 >> v2:172.21.15.179:3300/0 conn(0x7f4f3406bc30 0x7f4f340b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.352+0000 7f4f2bc00640 1 --2- 172.21.15.162:0/272125235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3406e2e0 0x7f4f3406e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.353+0000 7f4f39a00640 1 --2- 172.21.15.162:0/272125235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3415da50 0x7f4f3415dec0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4f340668c0 tx=0x7f4f2c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1064d8d4581bbd65 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.353+0000 7f4f33e00640 1 -- 172.21.15.162:0/272125235 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c02c9f0 con 0x7f4f3415da50 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.353+0000 7f4f33e00640 1 -- 172.21.15.162:0/272125235 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c02cb50 con 0x7f4f3415da50 2024-01-20T11:09:32.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.353+0000 7f4f33e00640 1 -- 172.21.15.162:0/272125235 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0343f0 con 0x7f4f3415da50 2024-01-20T11:09:32.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 -- 172.21.15.162:0/272125235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3415da50 msgr2=0x7f4f3415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/272125235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3415da50 0x7f4f3415dec0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4f340668c0 tx=0x7f4f2c02be50 comp rx=0 tx=0).stop 2024-01-20T11:09:32.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 -- 172.21.15.162:0/272125235 shutdown_connections 2024-01-20T11:09:32.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/272125235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3415da50 0x7f4f3415dec0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/272125235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3406e2e0 0x7f4f3406e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/272125235 >> v2:172.21.15.179:3300/0 conn(0x7f4f3406bc30 0x7f4f340b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 -- 172.21.15.162:0/272125235 >> 172.21.15.162:0/272125235 conn(0x7f4f340cf900 msgr2=0x7f4f340cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:32.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 -- 172.21.15.162:0/272125235 shutdown_connections 2024-01-20T11:09:32.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.354+0000 7f4f3ba00640 1 -- 172.21.15.162:0/272125235 wait complete. 2024-01-20T11:09:32.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.356+0000 7f4f3ba00640 1 Processor -- start 2024-01-20T11:09:32.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.356+0000 7f4f3ba00640 1 -- start start 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f3ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3406bc30 0x7f4f34150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f3ba00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f3406e2e0 0x7f4f340cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f3ba00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3415da50 0x7f4f3415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f3ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34151500 con 0x7f4f3406bc30 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f3ba00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3415eb80 con 0x7f4f3406e2e0 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f3ba00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3415ee60 con 0x7f4f3415da50 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f39000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3406bc30 0x7f4f34150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f39000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3406bc30 0x7f4f34150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42780/0 (socket says 172.21.15.162:42780) 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f39000640 1 -- 172.21.15.162:0/2344080467 learned_addr learned my addr 172.21.15.162:0/2344080467 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f2bc00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f3406e2e0 0x7f4f340cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.357+0000 7f4f39000640 1 -- 172.21.15.162:0/2344080467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3415da50 msgr2=0x7f4f3415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f39000640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3415da50 0x7f4f3415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f39000640 1 -- 172.21.15.162:0/2344080467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f3406e2e0 msgr2=0x7f4f340cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f39000640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f3406e2e0 0x7f4f340cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f39000640 1 -- 172.21.15.162:0/2344080467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c009b30 con 0x7f4f3406bc30 2024-01-20T11:09:32.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f39000640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3406bc30 0x7f4f34150fc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c7c0 tx=0x7f4f2400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:32.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f31600640 1 -- 172.21.15.162:0/2344080467 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24007a30 con 0x7f4f3406bc30 2024-01-20T11:09:32.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f31600640 1 -- 172.21.15.162:0/2344080467 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f24007b90 con 0x7f4f3406bc30 2024-01-20T11:09:32.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3415f140 con 0x7f4f3406bc30 2024-01-20T11:09:32.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f31600640 1 -- 172.21.15.162:0/2344080467 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400ce70 con 0x7f4f3406bc30 2024-01-20T11:09:32.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.358+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3415f700 con 0x7f4f3406bc30 2024-01-20T11:09:32.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.359+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3415f920 con 0x7f4f3406bc30 2024-01-20T11:09:32.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.360+0000 7f4f31600640 1 -- 172.21.15.162:0/2344080467 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4f240113f0 con 0x7f4f3406bc30 2024-01-20T11:09:32.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.361+0000 7f4f31600640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4f0c06aed0 0x7f4f0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.361+0000 7f4f31600640 1 -- 172.21.15.162:0/2344080467 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f24089760 con 0x7f4f3406bc30 2024-01-20T11:09:32.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.362+0000 7f4f2bc00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4f0c06aed0 0x7f4f0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.362+0000 7f4f2bc00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4f0c06aed0 0x7f4f0c06d390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4f34067b40 tx=0x7f4f1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:32.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.366+0000 7f4f31600640 1 -- 172.21.15.162:0/2344080467 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4f24054620 con 0x7f4f3406bc30 2024-01-20T11:09:32.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.631+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4f3404e970 con 0x7f4f3406bc30 2024-01-20T11:09:32.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.632+0000 7f4f31600640 1 -- 172.21.15.162:0/2344080467 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1432 (secure 0 0 0) 0x7f4f2405e020 con 0x7f4f3406bc30 2024-01-20T11:09:32.673 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:32.673 INFO:teuthology.orchestra.run.smithi162.stdout:{"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":140,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1705748844,"num_in_osds":8,"osd_in_since":1705748836,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":252571648,"bytes_avail":772841541632,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5550}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-01-20T11:09:13.612409+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-20T11:09:32.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4f0c06aed0 msgr2=0x7f4f0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4f0c06aed0 0x7f4f0c06d390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4f34067b40 tx=0x7f4f1c008040 comp rx=0 tx=0).stop 2024-01-20T11:09:32.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3406bc30 msgr2=0x7f4f34150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3406bc30 0x7f4f34150fc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c7c0 tx=0x7f4f2400cc80 comp rx=0 tx=0).stop 2024-01-20T11:09:32.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 shutdown_connections 2024-01-20T11:09:32.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f3415da50 0x7f4f3415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4f0c06aed0 0x7f4f0c06d390 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f3406e2e0 0x7f4f340cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 --2- 172.21.15.162:0/2344080467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f3406bc30 0x7f4f34150fc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.635+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 >> 172.21.15.162:0/2344080467 conn(0x7f4f340cf900 msgr2=0x7f4f340b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:32.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.636+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 shutdown_connections 2024-01-20T11:09:32.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.636+0000 7f4f3ba00640 1 -- 172.21.15.162:0/2344080467 wait complete. 2024-01-20T11:09:32.675 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-20T11:09:32.675 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:09:32.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.881+0000 7f933aa00640 1 Processor -- start 2024-01-20T11:09:32.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.881+0000 7f933aa00640 1 -- start start 2024-01-20T11:09:32.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f933aa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d420 0x7f93340d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f933aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f933415d800 0x7f93340d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f933aa00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93340b2880 con 0x7f93340d1dc0 2024-01-20T11:09:32.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f933aa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93340d2250 con 0x7f933415d800 2024-01-20T11:09:32.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f933aa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9334161110 con 0x7f933415d420 2024-01-20T11:09:32.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f9338c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f933415d800 0x7f93340d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f9338c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f933415d800 0x7f93340d1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42786/0 (socket says 172.21.15.162:42786) 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.883+0000 7f9338c00640 1 -- 172.21.15.162:0/2629537953 learned_addr learned my addr 172.21.15.162:0/2629537953 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.884+0000 7f9339600640 1 --2- 172.21.15.162:0/2629537953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d420 0x7f93340d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.884+0000 7f9338c00640 1 -- 172.21.15.162:0/2629537953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d420 msgr2=0x7f93340d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.884+0000 7f9338c00640 1 --2- 172.21.15.162:0/2629537953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d420 0x7f93340d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.884+0000 7f9338c00640 1 -- 172.21.15.162:0/2629537953 >> v1:172.21.15.179:6789/0 conn(0x7f93340d1dc0 legacy=0x7f93340cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.884+0000 7f9338c00640 1 -- 172.21.15.162:0/2629537953 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93341613f0 con 0x7f933415d800 2024-01-20T11:09:32.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.885+0000 7f9338c00640 1 --2- 172.21.15.162:0/2629537953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d800 0x7f93340d1880 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f931c009870 tx=0x7f931c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733543f60f2e4587 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:32.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.885+0000 7f9333e00640 1 -- 172.21.15.162:0/2629537953 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c030840 con 0x7f933415d800 2024-01-20T11:09:32.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.885+0000 7f9333e00640 1 -- 172.21.15.162:0/2629537953 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0309a0 con 0x7f933415d800 2024-01-20T11:09:32.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.885+0000 7f9333e00640 1 -- 172.21.15.162:0/2629537953 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c030d30 con 0x7f933415d800 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 -- 172.21.15.162:0/2629537953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d800 msgr2=0x7f93340d1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 --2- 172.21.15.162:0/2629537953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d800 0x7f93340d1880 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f931c009870 tx=0x7f931c02b980 comp rx=0 tx=0).stop 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 -- 172.21.15.162:0/2629537953 shutdown_connections 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 --2- 172.21.15.162:0/2629537953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d800 0x7f93340d1880 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 --2- 172.21.15.162:0/2629537953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d420 0x7f93340d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 -- 172.21.15.162:0/2629537953 >> 172.21.15.162:0/2629537953 conn(0x7f933408cc50 msgr2=0x7f933409c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 -- 172.21.15.162:0/2629537953 shutdown_connections 2024-01-20T11:09:32.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.886+0000 7f933aa00640 1 -- 172.21.15.162:0/2629537953 wait complete. 2024-01-20T11:09:32.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.888+0000 7f933aa00640 1 Processor -- start 2024-01-20T11:09:32.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.889+0000 7f933aa00640 1 -- start start 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f933aa00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93340d1dc0 0x7f93340cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f933aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d420 0x7f93340b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f933aa00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d800 0x7f93340b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f933aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93340b73b0 con 0x7f933415d420 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f933aa00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93340b6df0 con 0x7f93340d1dc0 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f933aa00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93340b70d0 con 0x7f933415d800 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9338c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d420 0x7f93340b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9338c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d420 0x7f93340b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42802/0 (socket says 172.21.15.162:42802) 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9338c00640 1 -- 172.21.15.162:0/2530190695 learned_addr learned my addr 172.21.15.162:0/2530190695 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9339600640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93340d1dc0 0x7f93340cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9338c00640 1 -- 172.21.15.162:0/2530190695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d800 msgr2=0x7f93340b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9338c00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d800 0x7f93340b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9338c00640 1 -- 172.21.15.162:0/2530190695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93340d1dc0 msgr2=0x7f93340cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.890+0000 7f9338c00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93340d1dc0 0x7f93340cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.891+0000 7f9338c00640 1 -- 172.21.15.162:0/2530190695 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0094d0 con 0x7f933415d420 2024-01-20T11:09:32.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.891+0000 7f9338c00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d420 0x7f93340b7700 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f931c000c00 tx=0x7f931c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:32.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.891+0000 7f9331600640 1 -- 172.21.15.162:0/2530190695 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c039a90 con 0x7f933415d420 2024-01-20T11:09:32.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.891+0000 7f9331600640 1 -- 172.21.15.162:0/2530190695 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c039bf0 con 0x7f933415d420 2024-01-20T11:09:32.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.891+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93340ca4a0 con 0x7f933415d420 2024-01-20T11:09:32.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.891+0000 7f9331600640 1 -- 172.21.15.162:0/2530190695 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c043410 con 0x7f933415d420 2024-01-20T11:09:32.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.891+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93340cc9a0 con 0x7f933415d420 2024-01-20T11:09:32.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.893+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9334074a30 con 0x7f933415d420 2024-01-20T11:09:32.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.893+0000 7f9331600640 1 -- 172.21.15.162:0/2530190695 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f931c04c3b0 con 0x7f933415d420 2024-01-20T11:09:32.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.894+0000 7f9331600640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f930c06aed0 0x7f930c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:32.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.894+0000 7f9331600640 1 -- 172.21.15.162:0/2530190695 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f931c0abb20 con 0x7f933415d420 2024-01-20T11:09:32.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.895+0000 7f9339600640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f930c06aed0 0x7f930c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:32.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.895+0000 7f9339600640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f930c06aed0 0x7f930c06d390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9324006fd0 tx=0x7f9324008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:32.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:32.899+0000 7f9331600640 1 -- 172.21.15.162:0/2530190695 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f931c0769e0 con 0x7f933415d420 2024-01-20T11:09:33.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.090+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9334161c90 con 0x7f930c06aed0 2024-01-20T11:09:33.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.100+0000 7f9331600640 1 -- 172.21.15.162:0/2530190695 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286548 (secure 0 0 0) 0x7f932400b200 con 0x7f930c06aed0 2024-01-20T11:09:33.103 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:33.106 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f930c06aed0 msgr2=0x7f930c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f930c06aed0 0x7f930c06d390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9324006fd0 tx=0x7f9324008040 comp rx=0 tx=0).stop 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d420 msgr2=0x7f93340b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d420 0x7f93340b7700 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f931c000c00 tx=0x7f931c004730 comp rx=0 tx=0).stop 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 shutdown_connections 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933415d800 0x7f93340b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f933415d420 0x7f93340b7700 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f930c06aed0 0x7f930c06d390 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 --2- 172.21.15.162:0/2530190695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93340d1dc0 0x7f93340cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 >> 172.21.15.162:0/2530190695 conn(0x7f933408cc50 msgr2=0x7f93340cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 shutdown_connections 2024-01-20T11:09:33.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:33.107+0000 7f933aa00640 1 -- 172.21.15.162:0/2530190695 wait complete. 2024-01-20T11:09:33.128 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-01-20T11:09:31.617032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246652,"kb_used_data":5512,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728068,"statfs":{"total":773094113280,"available":772841541632,"internally_reserved":0,"allocated":5644288,"data_stored":2968892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001847"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679698+0000","last_change":"2024-01-20T11:09:26.704261+0000","last_active":"2024-01-20T11:09:27.679698+0000","last_peered":"2024-01-20T11:09:27.679698+0000","last_clean":"2024-01-20T11:09:27.679698+0000","last_became_active":"2024-01-20T11:09:26.696063+0000","last_became_peered":"2024-01-20T11:09:26.696063+0000","last_unstale":"2024-01-20T11:09:27.679698+0000","last_undegraded":"2024-01-20T11:09:27.679698+0000","last_fullsized":"2024-01-20T11:09:27.679698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:05.315505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678398+0000","last_change":"2024-01-20T11:09:26.672672+0000","last_active":"2024-01-20T11:09:27.678398+0000","last_peered":"2024-01-20T11:09:27.678398+0000","last_clean":"2024-01-20T11:09:27.678398+0000","last_became_active":"2024-01-20T11:09:26.671885+0000","last_became_peered":"2024-01-20T11:09:26.671885+0000","last_unstale":"2024-01-20T11:09:27.678398+0000","last_undegraded":"2024-01-20T11:09:27.678398+0000","last_fullsized":"2024-01-20T11:09:27.678398+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:57.604746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429184+0000","last_change":"2024-01-20T11:09:26.689755+0000","last_active":"2024-01-20T11:09:28.429184+0000","last_peered":"2024-01-20T11:09:28.429184+0000","last_clean":"2024-01-20T11:09:28.429184+0000","last_became_active":"2024-01-20T11:09:26.689458+0000","last_became_peered":"2024-01-20T11:09:26.689458+0000","last_unstale":"2024-01-20T11:09:28.429184+0000","last_undegraded":"2024-01-20T11:09:28.429184+0000","last_fullsized":"2024-01-20T11:09:28.429184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:21:59.383614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192164+0000","last_change":"2024-01-20T11:09:26.685585+0000","last_active":"2024-01-20T11:09:28.192164+0000","last_peered":"2024-01-20T11:09:28.192164+0000","last_clean":"2024-01-20T11:09:28.192164+0000","last_became_active":"2024-01-20T11:09:26.683586+0000","last_became_peered":"2024-01-20T11:09:26.683586+0000","last_unstale":"2024-01-20T11:09:28.192164+0000","last_undegraded":"2024-01-20T11:09:28.192164+0000","last_fullsized":"2024-01-20T11:09:28.192164+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678174+0000","last_change":"2024-01-20T11:09:26.675354+0000","last_active":"2024-01-20T11:09:27.678174+0000","last_peered":"2024-01-20T11:09:27.678174+0000","last_clean":"2024-01-20T11:09:27.678174+0000","last_became_active":"2024-01-20T11:09:26.674942+0000","last_became_peered":"2024-01-20T11:09:26.674942+0000","last_unstale":"2024-01-20T11:09:27.678174+0000","last_undegraded":"2024-01-20T11:09:27.678174+0000","last_fullsized":"2024-01-20T11:09:27.678174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:26.979517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430774+0000","last_change":"2024-01-20T11:09:26.695334+0000","last_active":"2024-01-20T11:09:28.430774+0000","last_peered":"2024-01-20T11:09:28.430774+0000","last_clean":"2024-01-20T11:09:28.430774+0000","last_became_active":"2024-01-20T11:09:26.695044+0000","last_became_peered":"2024-01-20T11:09:26.695044+0000","last_unstale":"2024-01-20T11:09:28.430774+0000","last_undegraded":"2024-01-20T11:09:28.430774+0000","last_fullsized":"2024-01-20T11:09:28.430774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:18:44.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678120+0000","last_change":"2024-01-20T11:09:26.705212+0000","last_active":"2024-01-20T11:09:27.678120+0000","last_peered":"2024-01-20T11:09:27.678120+0000","last_clean":"2024-01-20T11:09:27.678120+0000","last_became_active":"2024-01-20T11:09:26.702807+0000","last_became_peered":"2024-01-20T11:09:26.702807+0000","last_unstale":"2024-01-20T11:09:27.678120+0000","last_undegraded":"2024-01-20T11:09:27.678120+0000","last_fullsized":"2024-01-20T11:09:27.678120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191291+0000","last_change":"2024-01-20T11:09:26.688539+0000","last_active":"2024-01-20T11:09:28.191291+0000","last_peered":"2024-01-20T11:09:28.191291+0000","last_clean":"2024-01-20T11:09:28.191291+0000","last_became_active":"2024-01-20T11:09:26.688265+0000","last_became_peered":"2024-01-20T11:09:26.688265+0000","last_unstale":"2024-01-20T11:09:28.191291+0000","last_undegraded":"2024-01-20T11:09:28.191291+0000","last_fullsized":"2024-01-20T11:09:28.191291+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:28.827941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192807+0000","last_change":"2024-01-20T11:09:26.680892+0000","last_active":"2024-01-20T11:09:28.192807+0000","last_peered":"2024-01-20T11:09:28.192807+0000","last_clean":"2024-01-20T11:09:28.192807+0000","last_became_active":"2024-01-20T11:09:26.680592+0000","last_became_peered":"2024-01-20T11:09:26.680592+0000","last_unstale":"2024-01-20T11:09:28.192807+0000","last_undegraded":"2024-01-20T11:09:28.192807+0000","last_fullsized":"2024-01-20T11:09:28.192807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:27:21.085164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192500+0000","last_change":"2024-01-20T11:09:26.687226+0000","last_active":"2024-01-20T11:09:28.192500+0000","last_peered":"2024-01-20T11:09:28.192500+0000","last_clean":"2024-01-20T11:09:28.192500+0000","last_became_active":"2024-01-20T11:09:26.686979+0000","last_became_peered":"2024-01-20T11:09:26.686979+0000","last_unstale":"2024-01-20T11:09:28.192500+0000","last_undegraded":"2024-01-20T11:09:28.192500+0000","last_fullsized":"2024-01-20T11:09:28.192500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:24:12.697565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192120+0000","last_change":"2024-01-20T11:09:26.693786+0000","last_active":"2024-01-20T11:09:28.192120+0000","last_peered":"2024-01-20T11:09:28.192120+0000","last_clean":"2024-01-20T11:09:28.192120+0000","last_became_active":"2024-01-20T11:09:26.693524+0000","last_became_peered":"2024-01-20T11:09:26.693524+0000","last_unstale":"2024-01-20T11:09:28.192120+0000","last_undegraded":"2024-01-20T11:09:28.192120+0000","last_fullsized":"2024-01-20T11:09:28.192120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:26.979517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678672+0000","last_change":"2024-01-20T11:09:26.683665+0000","last_active":"2024-01-20T11:09:27.678672+0000","last_peered":"2024-01-20T11:09:27.678672+0000","last_clean":"2024-01-20T11:09:27.678672+0000","last_became_active":"2024-01-20T11:09:26.683369+0000","last_became_peered":"2024-01-20T11:09:26.683369+0000","last_unstale":"2024-01-20T11:09:27.678672+0000","last_undegraded":"2024-01-20T11:09:27.678672+0000","last_fullsized":"2024-01-20T11:09:27.678672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677024+0000","last_change":"2024-01-20T11:09:26.695303+0000","last_active":"2024-01-20T11:09:27.677024+0000","last_peered":"2024-01-20T11:09:27.677024+0000","last_clean":"2024-01-20T11:09:27.677024+0000","last_became_active":"2024-01-20T11:09:26.695018+0000","last_became_peered":"2024-01-20T11:09:26.695018+0000","last_unstale":"2024-01-20T11:09:27.677024+0000","last_undegraded":"2024-01-20T11:09:27.677024+0000","last_fullsized":"2024-01-20T11:09:27.677024+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:16:14.451123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191741+0000","last_change":"2024-01-20T11:09:26.684122+0000","last_active":"2024-01-20T11:09:28.191741+0000","last_peered":"2024-01-20T11:09:28.191741+0000","last_clean":"2024-01-20T11:09:28.191741+0000","last_became_active":"2024-01-20T11:09:26.683772+0000","last_became_peered":"2024-01-20T11:09:26.683772+0000","last_unstale":"2024-01-20T11:09:28.191741+0000","last_undegraded":"2024-01-20T11:09:28.191741+0000","last_fullsized":"2024-01-20T11:09:28.191741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:34:36.188038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430653+0000","last_change":"2024-01-20T11:09:26.679970+0000","last_active":"2024-01-20T11:09:28.430653+0000","last_peered":"2024-01-20T11:09:28.430653+0000","last_clean":"2024-01-20T11:09:28.430653+0000","last_became_active":"2024-01-20T11:09:26.679604+0000","last_became_peered":"2024-01-20T11:09:26.679604+0000","last_unstale":"2024-01-20T11:09:28.430653+0000","last_undegraded":"2024-01-20T11:09:28.430653+0000","last_fullsized":"2024-01-20T11:09:28.430653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:09:57.629408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.719963+0000","last_change":"2024-01-20T11:09:26.681801+0000","last_active":"2024-01-20T11:09:27.719963+0000","last_peered":"2024-01-20T11:09:27.719963+0000","last_clean":"2024-01-20T11:09:27.719963+0000","last_became_active":"2024-01-20T11:09:26.681407+0000","last_became_peered":"2024-01-20T11:09:26.681407+0000","last_unstale":"2024-01-20T11:09:27.719963+0000","last_undegraded":"2024-01-20T11:09:27.719963+0000","last_fullsized":"2024-01-20T11:09:27.719963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:00:48.815425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429351+0000","last_change":"2024-01-20T11:09:26.691803+0000","last_active":"2024-01-20T11:09:28.429351+0000","last_peered":"2024-01-20T11:09:28.429351+0000","last_clean":"2024-01-20T11:09:28.429351+0000","last_became_active":"2024-01-20T11:09:26.690812+0000","last_became_peered":"2024-01-20T11:09:26.690812+0000","last_unstale":"2024-01-20T11:09:28.429351+0000","last_undegraded":"2024-01-20T11:09:28.429351+0000","last_fullsized":"2024-01-20T11:09:28.429351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:25.665790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429392+0000","last_change":"2024-01-20T11:09:26.682398+0000","last_active":"2024-01-20T11:09:28.429392+0000","last_peered":"2024-01-20T11:09:28.429392+0000","last_clean":"2024-01-20T11:09:28.429392+0000","last_became_active":"2024-01-20T11:09:26.680035+0000","last_became_peered":"2024-01-20T11:09:26.680035+0000","last_unstale":"2024-01-20T11:09:28.429392+0000","last_undegraded":"2024-01-20T11:09:28.429392+0000","last_fullsized":"2024-01-20T11:09:28.429392+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:35.069387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.721088+0000","last_change":"2024-01-20T11:09:26.683156+0000","last_active":"2024-01-20T11:09:27.721088+0000","last_peered":"2024-01-20T11:09:27.721088+0000","last_clean":"2024-01-20T11:09:27.721088+0000","last_became_active":"2024-01-20T11:09:26.682878+0000","last_became_peered":"2024-01-20T11:09:26.682878+0000","last_unstale":"2024-01-20T11:09:27.721088+0000","last_undegraded":"2024-01-20T11:09:27.721088+0000","last_fullsized":"2024-01-20T11:09:27.721088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:49.465712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677274+0000","last_change":"2024-01-20T11:09:26.692694+0000","last_active":"2024-01-20T11:09:27.677274+0000","last_peered":"2024-01-20T11:09:27.677274+0000","last_clean":"2024-01-20T11:09:27.677274+0000","last_became_active":"2024-01-20T11:09:26.692380+0000","last_became_peered":"2024-01-20T11:09:26.692380+0000","last_unstale":"2024-01-20T11:09:27.677274+0000","last_undegraded":"2024-01-20T11:09:27.677274+0000","last_fullsized":"2024-01-20T11:09:27.677274+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:13:25.098120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431101+0000","last_change":"2024-01-20T11:09:26.685828+0000","last_active":"2024-01-20T11:09:28.431101+0000","last_peered":"2024-01-20T11:09:28.431101+0000","last_clean":"2024-01-20T11:09:28.431101+0000","last_became_active":"2024-01-20T11:09:26.685539+0000","last_became_peered":"2024-01-20T11:09:26.685539+0000","last_unstale":"2024-01-20T11:09:28.431101+0000","last_undegraded":"2024-01-20T11:09:28.431101+0000","last_fullsized":"2024-01-20T11:09:28.431101+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:20:01.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192172+0000","last_change":"2024-01-20T11:09:26.698211+0000","last_active":"2024-01-20T11:09:28.192172+0000","last_peered":"2024-01-20T11:09:28.192172+0000","last_clean":"2024-01-20T11:09:28.192172+0000","last_became_active":"2024-01-20T11:09:26.698031+0000","last_became_peered":"2024-01-20T11:09:26.698031+0000","last_unstale":"2024-01-20T11:09:28.192172+0000","last_undegraded":"2024-01-20T11:09:28.192172+0000","last_fullsized":"2024-01-20T11:09:28.192172+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720053+0000","last_change":"2024-01-20T11:09:26.691953+0000","last_active":"2024-01-20T11:09:27.720053+0000","last_peered":"2024-01-20T11:09:27.720053+0000","last_clean":"2024-01-20T11:09:27.720053+0000","last_became_active":"2024-01-20T11:09:26.691320+0000","last_became_peered":"2024-01-20T11:09:26.691320+0000","last_unstale":"2024-01-20T11:09:27.720053+0000","last_undegraded":"2024-01-20T11:09:27.720053+0000","last_fullsized":"2024-01-20T11:09:27.720053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:56:22.681327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.719993+0000","last_change":"2024-01-20T11:09:26.693837+0000","last_active":"2024-01-20T11:09:27.719993+0000","last_peered":"2024-01-20T11:09:27.719993+0000","last_clean":"2024-01-20T11:09:27.719993+0000","last_became_active":"2024-01-20T11:09:26.690047+0000","last_became_peered":"2024-01-20T11:09:26.690047+0000","last_unstale":"2024-01-20T11:09:27.719993+0000","last_undegraded":"2024-01-20T11:09:27.719993+0000","last_fullsized":"2024-01-20T11:09:27.719993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:09.839957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720709+0000","last_change":"2024-01-20T11:09:26.695991+0000","last_active":"2024-01-20T11:09:27.720709+0000","last_peered":"2024-01-20T11:09:27.720709+0000","last_clean":"2024-01-20T11:09:27.720709+0000","last_became_active":"2024-01-20T11:09:26.695701+0000","last_became_peered":"2024-01-20T11:09:26.695701+0000","last_unstale":"2024-01-20T11:09:27.720709+0000","last_undegraded":"2024-01-20T11:09:27.720709+0000","last_fullsized":"2024-01-20T11:09:27.720709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:48.713928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677754+0000","last_change":"2024-01-20T11:09:26.686603+0000","last_active":"2024-01-20T11:09:27.677754+0000","last_peered":"2024-01-20T11:09:27.677754+0000","last_clean":"2024-01-20T11:09:27.677754+0000","last_became_active":"2024-01-20T11:09:26.686326+0000","last_became_peered":"2024-01-20T11:09:26.686326+0000","last_unstale":"2024-01-20T11:09:27.677754+0000","last_undegraded":"2024-01-20T11:09:27.677754+0000","last_fullsized":"2024-01-20T11:09:27.677754+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:47.399814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429500+0000","last_change":"2024-01-20T11:09:26.690872+0000","last_active":"2024-01-20T11:09:28.429500+0000","last_peered":"2024-01-20T11:09:28.429500+0000","last_clean":"2024-01-20T11:09:28.429500+0000","last_became_active":"2024-01-20T11:09:26.690548+0000","last_became_peered":"2024-01-20T11:09:26.690548+0000","last_unstale":"2024-01-20T11:09:28.429500+0000","last_undegraded":"2024-01-20T11:09:28.429500+0000","last_fullsized":"2024-01-20T11:09:28.429500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:09:35.885362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678798+0000","last_change":"2024-01-20T11:09:26.683619+0000","last_active":"2024-01-20T11:09:27.678798+0000","last_peered":"2024-01-20T11:09:27.678798+0000","last_clean":"2024-01-20T11:09:27.678798+0000","last_became_active":"2024-01-20T11:09:26.682936+0000","last_became_peered":"2024-01-20T11:09:26.682936+0000","last_unstale":"2024-01-20T11:09:27.678798+0000","last_undegraded":"2024-01-20T11:09:27.678798+0000","last_fullsized":"2024-01-20T11:09:27.678798+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720425+0000","last_change":"2024-01-20T11:09:26.681935+0000","last_active":"2024-01-20T11:09:27.720425+0000","last_peered":"2024-01-20T11:09:27.720425+0000","last_clean":"2024-01-20T11:09:27.720425+0000","last_became_active":"2024-01-20T11:09:26.681629+0000","last_became_peered":"2024-01-20T11:09:26.681629+0000","last_unstale":"2024-01-20T11:09:27.720425+0000","last_undegraded":"2024-01-20T11:09:27.720425+0000","last_fullsized":"2024-01-20T11:09:27.720425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:37:37.827422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429138+0000","last_change":"2024-01-20T11:09:26.691057+0000","last_active":"2024-01-20T11:09:28.429138+0000","last_peered":"2024-01-20T11:09:28.429138+0000","last_clean":"2024-01-20T11:09:28.429138+0000","last_became_active":"2024-01-20T11:09:26.690775+0000","last_became_peered":"2024-01-20T11:09:26.690775+0000","last_unstale":"2024-01-20T11:09:28.429138+0000","last_undegraded":"2024-01-20T11:09:28.429138+0000","last_fullsized":"2024-01-20T11:09:28.429138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:22:40.795037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430947+0000","last_change":"2024-01-20T11:09:26.669802+0000","last_active":"2024-01-20T11:09:28.430947+0000","last_peered":"2024-01-20T11:09:28.430947+0000","last_clean":"2024-01-20T11:09:28.430947+0000","last_became_active":"2024-01-20T11:09:26.669511+0000","last_became_peered":"2024-01-20T11:09:26.669511+0000","last_unstale":"2024-01-20T11:09:28.430947+0000","last_undegraded":"2024-01-20T11:09:28.430947+0000","last_fullsized":"2024-01-20T11:09:28.430947+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:54.684647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.676810+0000","last_change":"2024-01-20T11:09:26.698320+0000","last_active":"2024-01-20T11:09:27.676810+0000","last_peered":"2024-01-20T11:09:27.676810+0000","last_clean":"2024-01-20T11:09:27.676810+0000","last_became_active":"2024-01-20T11:09:26.697279+0000","last_became_peered":"2024-01-20T11:09:26.697279+0000","last_unstale":"2024-01-20T11:09:27.676810+0000","last_undegraded":"2024-01-20T11:09:27.676810+0000","last_fullsized":"2024-01-20T11:09:27.676810+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:40:37.036709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429981+0000","last_change":"2024-01-20T11:09:26.685625+0000","last_active":"2024-01-20T11:09:28.429981+0000","last_peered":"2024-01-20T11:09:28.429981+0000","last_clean":"2024-01-20T11:09:28.429981+0000","last_became_active":"2024-01-20T11:09:26.685352+0000","last_became_peered":"2024-01-20T11:09:26.685352+0000","last_unstale":"2024-01-20T11:09:28.429981+0000","last_undegraded":"2024-01-20T11:09:28.429981+0000","last_fullsized":"2024-01-20T11:09:28.429981+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:50.567638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.706029+0000","last_change":"2024-01-20T11:09:25.667528+0000","last_active":"2024-01-20T11:09:26.706029+0000","last_peered":"2024-01-20T11:09:26.706029+0000","last_clean":"2024-01-20T11:09:26.706029+0000","last_became_active":"2024-01-20T11:09:25.667261+0000","last_became_peered":"2024-01-20T11:09:25.667261+0000","last_unstale":"2024-01-20T11:09:26.706029+0000","last_undegraded":"2024-01-20T11:09:26.706029+0000","last_fullsized":"2024-01-20T11:09:26.706029+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:25.965805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720688+0000","last_change":"2024-01-20T11:09:26.695261+0000","last_active":"2024-01-20T11:09:27.720688+0000","last_peered":"2024-01-20T11:09:27.720688+0000","last_clean":"2024-01-20T11:09:27.720688+0000","last_became_active":"2024-01-20T11:09:26.694955+0000","last_became_peered":"2024-01-20T11:09:26.694955+0000","last_unstale":"2024-01-20T11:09:27.720688+0000","last_undegraded":"2024-01-20T11:09:27.720688+0000","last_fullsized":"2024-01-20T11:09:27.720688+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:33:51.492845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.703179+0000","last_change":"2024-01-20T11:09:25.666647+0000","last_active":"2024-01-20T11:09:26.703179+0000","last_peered":"2024-01-20T11:09:26.703179+0000","last_clean":"2024-01-20T11:09:26.703179+0000","last_became_active":"2024-01-20T11:09:25.666288+0000","last_became_peered":"2024-01-20T11:09:25.666288+0000","last_unstale":"2024-01-20T11:09:26.703179+0000","last_undegraded":"2024-01-20T11:09:26.703179+0000","last_fullsized":"2024-01-20T11:09:26.703179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:33:39.669648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678930+0000","last_change":"2024-01-20T11:09:26.676550+0000","last_active":"2024-01-20T11:09:27.678930+0000","last_peered":"2024-01-20T11:09:27.678930+0000","last_clean":"2024-01-20T11:09:27.678930+0000","last_became_active":"2024-01-20T11:09:26.675866+0000","last_became_peered":"2024-01-20T11:09:26.675866+0000","last_unstale":"2024-01-20T11:09:27.678930+0000","last_undegraded":"2024-01-20T11:09:27.678930+0000","last_fullsized":"2024-01-20T11:09:27.678930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.705952+0000","last_change":"2024-01-20T11:09:25.668001+0000","last_active":"2024-01-20T11:09:26.705952+0000","last_peered":"2024-01-20T11:09:26.705952+0000","last_clean":"2024-01-20T11:09:26.705952+0000","last_became_active":"2024-01-20T11:09:25.666885+0000","last_became_peered":"2024-01-20T11:09:25.666885+0000","last_unstale":"2024-01-20T11:09:26.705952+0000","last_undegraded":"2024-01-20T11:09:26.705952+0000","last_fullsized":"2024-01-20T11:09:26.705952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:33:39.669648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429983+0000","last_change":"2024-01-20T11:09:26.697162+0000","last_active":"2024-01-20T11:09:28.429983+0000","last_peered":"2024-01-20T11:09:28.429983+0000","last_clean":"2024-01-20T11:09:28.429983+0000","last_became_active":"2024-01-20T11:09:26.696896+0000","last_became_peered":"2024-01-20T11:09:26.696896+0000","last_unstale":"2024-01-20T11:09:28.429983+0000","last_undegraded":"2024-01-20T11:09:28.429983+0000","last_fullsized":"2024-01-20T11:09:28.429983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:13:02.857985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.704804+0000","last_change":"2024-01-20T11:09:25.675465+0000","last_active":"2024-01-20T11:09:26.704804+0000","last_peered":"2024-01-20T11:09:26.704804+0000","last_clean":"2024-01-20T11:09:26.704804+0000","last_became_active":"2024-01-20T11:09:25.675109+0000","last_became_peered":"2024-01-20T11:09:25.675109+0000","last_unstale":"2024-01-20T11:09:26.704804+0000","last_undegraded":"2024-01-20T11:09:26.704804+0000","last_fullsized":"2024-01-20T11:09:26.704804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:27.814229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429038+0000","last_change":"2024-01-20T11:09:26.700874+0000","last_active":"2024-01-20T11:09:28.429038+0000","last_peered":"2024-01-20T11:09:28.429038+0000","last_clean":"2024-01-20T11:09:28.429038+0000","last_became_active":"2024-01-20T11:09:26.700576+0000","last_became_peered":"2024-01-20T11:09:26.700576+0000","last_unstale":"2024-01-20T11:09:28.429038+0000","last_undegraded":"2024-01-20T11:09:28.429038+0000","last_fullsized":"2024-01-20T11:09:28.429038+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:04:10.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707269+0000","last_change":"2024-01-20T11:09:25.668050+0000","last_active":"2024-01-20T11:09:26.707269+0000","last_peered":"2024-01-20T11:09:26.707269+0000","last_clean":"2024-01-20T11:09:26.707269+0000","last_became_active":"2024-01-20T11:09:25.667619+0000","last_became_peered":"2024-01-20T11:09:25.667619+0000","last_unstale":"2024-01-20T11:09:26.707269+0000","last_undegraded":"2024-01-20T11:09:26.707269+0000","last_fullsized":"2024-01-20T11:09:26.707269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:18:54.420184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191827+0000","last_change":"2024-01-20T11:09:26.686513+0000","last_active":"2024-01-20T11:09:28.191827+0000","last_peered":"2024-01-20T11:09:28.191827+0000","last_clean":"2024-01-20T11:09:28.191827+0000","last_became_active":"2024-01-20T11:09:26.686105+0000","last_became_peered":"2024-01-20T11:09:26.686105+0000","last_unstale":"2024-01-20T11:09:28.191827+0000","last_undegraded":"2024-01-20T11:09:28.191827+0000","last_fullsized":"2024-01-20T11:09:28.191827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:49.930023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.705873+0000","last_change":"2024-01-20T11:09:25.670665+0000","last_active":"2024-01-20T11:09:26.705873+0000","last_peered":"2024-01-20T11:09:26.705873+0000","last_clean":"2024-01-20T11:09:26.705873+0000","last_became_active":"2024-01-20T11:09:25.668663+0000","last_became_peered":"2024-01-20T11:09:25.668663+0000","last_unstale":"2024-01-20T11:09:26.705873+0000","last_undegraded":"2024-01-20T11:09:26.705873+0000","last_fullsized":"2024-01-20T11:09:26.705873+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:46:18.356782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191548+0000","last_change":"2024-01-20T11:09:26.689081+0000","last_active":"2024-01-20T11:09:28.191548+0000","last_peered":"2024-01-20T11:09:28.191548+0000","last_clean":"2024-01-20T11:09:28.191548+0000","last_became_active":"2024-01-20T11:09:26.683874+0000","last_became_peered":"2024-01-20T11:09:26.683874+0000","last_unstale":"2024-01-20T11:09:28.191548+0000","last_undegraded":"2024-01-20T11:09:28.191548+0000","last_fullsized":"2024-01-20T11:09:28.191548+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:13.179098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.658217+0000","last_change":"2024-01-20T11:09:25.665896+0000","last_active":"2024-01-20T11:09:26.658217+0000","last_peered":"2024-01-20T11:09:26.658217+0000","last_clean":"2024-01-20T11:09:26.658217+0000","last_became_active":"2024-01-20T11:09:25.665634+0000","last_became_peered":"2024-01-20T11:09:25.665634+0000","last_unstale":"2024-01-20T11:09:26.658217+0000","last_undegraded":"2024-01-20T11:09:26.658217+0000","last_fullsized":"2024-01-20T11:09:26.658217+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:48.452000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720142+0000","last_change":"2024-01-20T11:09:26.692166+0000","last_active":"2024-01-20T11:09:27.720142+0000","last_peered":"2024-01-20T11:09:27.720142+0000","last_clean":"2024-01-20T11:09:27.720142+0000","last_became_active":"2024-01-20T11:09:26.691691+0000","last_became_peered":"2024-01-20T11:09:26.691691+0000","last_unstale":"2024-01-20T11:09:27.720142+0000","last_undegraded":"2024-01-20T11:09:27.720142+0000","last_fullsized":"2024-01-20T11:09:27.720142+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:10:42.934886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655288+0000","last_change":"2024-01-20T11:09:25.653806+0000","last_active":"2024-01-20T11:09:26.655288+0000","last_peered":"2024-01-20T11:09:26.655288+0000","last_clean":"2024-01-20T11:09:26.655288+0000","last_became_active":"2024-01-20T11:09:25.653522+0000","last_became_peered":"2024-01-20T11:09:25.653522+0000","last_unstale":"2024-01-20T11:09:26.655288+0000","last_undegraded":"2024-01-20T11:09:26.655288+0000","last_fullsized":"2024-01-20T11:09:26.655288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:55:51.642082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429710+0000","last_change":"2024-01-20T11:09:26.681612+0000","last_active":"2024-01-20T11:09:28.429710+0000","last_peered":"2024-01-20T11:09:28.429710+0000","last_clean":"2024-01-20T11:09:28.429710+0000","last_became_active":"2024-01-20T11:09:26.679392+0000","last_became_peered":"2024-01-20T11:09:26.679392+0000","last_unstale":"2024-01-20T11:09:28.429710+0000","last_undegraded":"2024-01-20T11:09:28.429710+0000","last_fullsized":"2024-01-20T11:09:28.429710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:37.076431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.683513+0000","last_change":"2024-01-20T11:09:25.662752+0000","last_active":"2024-01-20T11:09:26.683513+0000","last_peered":"2024-01-20T11:09:26.683513+0000","last_clean":"2024-01-20T11:09:26.683513+0000","last_became_active":"2024-01-20T11:09:25.660279+0000","last_became_peered":"2024-01-20T11:09:25.660279+0000","last_unstale":"2024-01-20T11:09:26.683513+0000","last_undegraded":"2024-01-20T11:09:26.683513+0000","last_fullsized":"2024-01-20T11:09:26.683513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:56:07.984070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679739+0000","last_change":"2024-01-20T11:09:26.698206+0000","last_active":"2024-01-20T11:09:27.679739+0000","last_peered":"2024-01-20T11:09:27.679739+0000","last_clean":"2024-01-20T11:09:27.679739+0000","last_became_active":"2024-01-20T11:09:26.697932+0000","last_became_peered":"2024-01-20T11:09:26.697932+0000","last_unstale":"2024-01-20T11:09:27.679739+0000","last_undegraded":"2024-01-20T11:09:27.679739+0000","last_fullsized":"2024-01-20T11:09:27.679739+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:25.570747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.658862+0000","last_change":"2024-01-20T11:09:25.667320+0000","last_active":"2024-01-20T11:09:26.658862+0000","last_peered":"2024-01-20T11:09:26.658862+0000","last_clean":"2024-01-20T11:09:26.658862+0000","last_became_active":"2024-01-20T11:09:25.667040+0000","last_became_peered":"2024-01-20T11:09:25.667040+0000","last_unstale":"2024-01-20T11:09:26.658862+0000","last_undegraded":"2024-01-20T11:09:26.658862+0000","last_fullsized":"2024-01-20T11:09:26.658862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:56.671058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431867+0000","last_change":"2024-01-20T11:09:26.684466+0000","last_active":"2024-01-20T11:09:28.431867+0000","last_peered":"2024-01-20T11:09:28.431867+0000","last_clean":"2024-01-20T11:09:28.431867+0000","last_became_active":"2024-01-20T11:09:26.684167+0000","last_became_peered":"2024-01-20T11:09:26.684167+0000","last_unstale":"2024-01-20T11:09:28.431867+0000","last_undegraded":"2024-01-20T11:09:28.431867+0000","last_fullsized":"2024-01-20T11:09:28.431867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:12:58.697408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707590+0000","last_change":"2024-01-20T11:09:25.674319+0000","last_active":"2024-01-20T11:09:26.707590+0000","last_peered":"2024-01-20T11:09:26.707590+0000","last_clean":"2024-01-20T11:09:26.707590+0000","last_became_active":"2024-01-20T11:09:25.674029+0000","last_became_peered":"2024-01-20T11:09:25.674029+0000","last_unstale":"2024-01-20T11:09:26.707590+0000","last_undegraded":"2024-01-20T11:09:26.707590+0000","last_fullsized":"2024-01-20T11:09:26.707590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:52.561712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679055+0000","last_change":"2024-01-20T11:09:26.705707+0000","last_active":"2024-01-20T11:09:27.679055+0000","last_peered":"2024-01-20T11:09:27.679055+0000","last_clean":"2024-01-20T11:09:27.679055+0000","last_became_active":"2024-01-20T11:09:26.705132+0000","last_became_peered":"2024-01-20T11:09:26.705132+0000","last_unstale":"2024-01-20T11:09:27.679055+0000","last_undegraded":"2024-01-20T11:09:27.679055+0000","last_fullsized":"2024-01-20T11:09:27.679055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.714184+0000","last_change":"2024-01-20T11:09:25.657996+0000","last_active":"2024-01-20T11:09:26.714184+0000","last_peered":"2024-01-20T11:09:26.714184+0000","last_clean":"2024-01-20T11:09:26.714184+0000","last_became_active":"2024-01-20T11:09:25.657691+0000","last_became_peered":"2024-01-20T11:09:25.657691+0000","last_unstale":"2024-01-20T11:09:26.714184+0000","last_undegraded":"2024-01-20T11:09:26.714184+0000","last_fullsized":"2024-01-20T11:09:26.714184+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:16.297500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720209+0000","last_change":"2024-01-20T11:09:26.678786+0000","last_active":"2024-01-20T11:09:27.720209+0000","last_peered":"2024-01-20T11:09:27.720209+0000","last_clean":"2024-01-20T11:09:27.720209+0000","last_became_active":"2024-01-20T11:09:26.678485+0000","last_became_peered":"2024-01-20T11:09:26.678485+0000","last_unstale":"2024-01-20T11:09:27.720209+0000","last_undegraded":"2024-01-20T11:09:27.720209+0000","last_fullsized":"2024-01-20T11:09:27.720209+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:20:22.030550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707366+0000","last_change":"2024-01-20T11:09:25.659501+0000","last_active":"2024-01-20T11:09:26.707366+0000","last_peered":"2024-01-20T11:09:26.707366+0000","last_clean":"2024-01-20T11:09:26.707366+0000","last_became_active":"2024-01-20T11:09:25.659195+0000","last_became_peered":"2024-01-20T11:09:25.659195+0000","last_unstale":"2024-01-20T11:09:26.707366+0000","last_undegraded":"2024-01-20T11:09:26.707366+0000","last_fullsized":"2024-01-20T11:09:26.707366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:12.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192151+0000","last_change":"2024-01-20T11:09:26.697813+0000","last_active":"2024-01-20T11:09:28.192151+0000","last_peered":"2024-01-20T11:09:28.192151+0000","last_clean":"2024-01-20T11:09:28.192151+0000","last_became_active":"2024-01-20T11:09:26.695970+0000","last_became_peered":"2024-01-20T11:09:26.695970+0000","last_unstale":"2024-01-20T11:09:28.192151+0000","last_undegraded":"2024-01-20T11:09:28.192151+0000","last_fullsized":"2024-01-20T11:09:28.192151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:57.604746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.682452+0000","last_change":"2024-01-20T11:09:25.672264+0000","last_active":"2024-01-20T11:09:26.682452+0000","last_peered":"2024-01-20T11:09:26.682452+0000","last_clean":"2024-01-20T11:09:26.682452+0000","last_became_active":"2024-01-20T11:09:25.671493+0000","last_became_peered":"2024-01-20T11:09:25.671493+0000","last_unstale":"2024-01-20T11:09:26.682452+0000","last_undegraded":"2024-01-20T11:09:26.682452+0000","last_fullsized":"2024-01-20T11:09:26.682452+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:48.452000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430204+0000","last_change":"2024-01-20T11:09:26.686494+0000","last_active":"2024-01-20T11:09:28.430204+0000","last_peered":"2024-01-20T11:09:28.430204+0000","last_clean":"2024-01-20T11:09:28.430204+0000","last_became_active":"2024-01-20T11:09:26.686013+0000","last_became_peered":"2024-01-20T11:09:26.686013+0000","last_unstale":"2024-01-20T11:09:28.430204+0000","last_undegraded":"2024-01-20T11:09:28.430204+0000","last_fullsized":"2024-01-20T11:09:28.430204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:43:46.695969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.664493+0000","last_change":"2024-01-20T11:09:25.659237+0000","last_active":"2024-01-20T11:09:26.664493+0000","last_peered":"2024-01-20T11:09:26.664493+0000","last_clean":"2024-01-20T11:09:26.664493+0000","last_became_active":"2024-01-20T11:09:25.658993+0000","last_became_peered":"2024-01-20T11:09:25.658993+0000","last_unstale":"2024-01-20T11:09:26.664493+0000","last_undegraded":"2024-01-20T11:09:26.664493+0000","last_fullsized":"2024-01-20T11:09:26.664493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:52:34.016988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678420+0000","last_change":"2024-01-20T11:09:26.700000+0000","last_active":"2024-01-20T11:09:27.678420+0000","last_peered":"2024-01-20T11:09:27.678420+0000","last_clean":"2024-01-20T11:09:27.678420+0000","last_became_active":"2024-01-20T11:09:26.699728+0000","last_became_peered":"2024-01-20T11:09:26.699728+0000","last_unstale":"2024-01-20T11:09:27.678420+0000","last_undegraded":"2024-01-20T11:09:27.678420+0000","last_fullsized":"2024-01-20T11:09:27.678420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.711587+0000","last_change":"2024-01-20T11:09:25.662705+0000","last_active":"2024-01-20T11:09:26.711587+0000","last_peered":"2024-01-20T11:09:26.711587+0000","last_clean":"2024-01-20T11:09:26.711587+0000","last_became_active":"2024-01-20T11:09:25.662103+0000","last_became_peered":"2024-01-20T11:09:25.662103+0000","last_unstale":"2024-01-20T11:09:26.711587+0000","last_undegraded":"2024-01-20T11:09:26.711587+0000","last_fullsized":"2024-01-20T11:09:26.711587+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:21.987470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677731+0000","last_change":"2024-01-20T11:09:26.684940+0000","last_active":"2024-01-20T11:09:27.677731+0000","last_peered":"2024-01-20T11:09:27.677731+0000","last_clean":"2024-01-20T11:09:27.677731+0000","last_became_active":"2024-01-20T11:09:26.684642+0000","last_became_peered":"2024-01-20T11:09:26.684642+0000","last_unstale":"2024-01-20T11:09:27.677731+0000","last_undegraded":"2024-01-20T11:09:27.677731+0000","last_fullsized":"2024-01-20T11:09:27.677731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:38.197779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707085+0000","last_change":"2024-01-20T11:09:25.660178+0000","last_active":"2024-01-20T11:09:26.707085+0000","last_peered":"2024-01-20T11:09:26.707085+0000","last_clean":"2024-01-20T11:09:26.707085+0000","last_became_active":"2024-01-20T11:09:25.659658+0000","last_became_peered":"2024-01-20T11:09:25.659658+0000","last_unstale":"2024-01-20T11:09:26.707085+0000","last_undegraded":"2024-01-20T11:09:26.707085+0000","last_fullsized":"2024-01-20T11:09:26.707085+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:49:45.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192778+0000","last_change":"2024-01-20T11:09:26.684848+0000","last_active":"2024-01-20T11:09:28.192778+0000","last_peered":"2024-01-20T11:09:28.192778+0000","last_clean":"2024-01-20T11:09:28.192778+0000","last_became_active":"2024-01-20T11:09:26.682804+0000","last_became_peered":"2024-01-20T11:09:26.682804+0000","last_unstale":"2024-01-20T11:09:28.192778+0000","last_undegraded":"2024-01-20T11:09:28.192778+0000","last_fullsized":"2024-01-20T11:09:28.192778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:25.570747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.701168+0000","last_change":"2024-01-20T11:09:25.661453+0000","last_active":"2024-01-20T11:09:26.701168+0000","last_peered":"2024-01-20T11:09:26.701168+0000","last_clean":"2024-01-20T11:09:26.701168+0000","last_became_active":"2024-01-20T11:09:25.660834+0000","last_became_peered":"2024-01-20T11:09:25.660834+0000","last_unstale":"2024-01-20T11:09:26.701168+0000","last_undegraded":"2024-01-20T11:09:26.701168+0000","last_fullsized":"2024-01-20T11:09:26.701168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:10.081431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720680+0000","last_change":"2024-01-20T11:09:26.679749+0000","last_active":"2024-01-20T11:09:27.720680+0000","last_peered":"2024-01-20T11:09:27.720680+0000","last_clean":"2024-01-20T11:09:27.720680+0000","last_became_active":"2024-01-20T11:09:26.679362+0000","last_became_peered":"2024-01-20T11:09:26.679362+0000","last_unstale":"2024-01-20T11:09:27.720680+0000","last_undegraded":"2024-01-20T11:09:27.720680+0000","last_fullsized":"2024-01-20T11:09:27.720680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:02:22.740219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.704508+0000","last_change":"2024-01-20T11:09:25.664841+0000","last_active":"2024-01-20T11:09:26.704508+0000","last_peered":"2024-01-20T11:09:26.704508+0000","last_clean":"2024-01-20T11:09:26.704508+0000","last_became_active":"2024-01-20T11:09:25.664637+0000","last_became_peered":"2024-01-20T11:09:25.664637+0000","last_unstale":"2024-01-20T11:09:26.704508+0000","last_undegraded":"2024-01-20T11:09:26.704508+0000","last_fullsized":"2024-01-20T11:09:26.704508+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.538731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720709+0000","last_change":"2024-01-20T11:09:26.684239+0000","last_active":"2024-01-20T11:09:27.720709+0000","last_peered":"2024-01-20T11:09:27.720709+0000","last_clean":"2024-01-20T11:09:27.720709+0000","last_became_active":"2024-01-20T11:09:26.683937+0000","last_became_peered":"2024-01-20T11:09:26.683937+0000","last_unstale":"2024-01-20T11:09:27.720709+0000","last_undegraded":"2024-01-20T11:09:27.720709+0000","last_fullsized":"2024-01-20T11:09:27.720709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:08:57.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.666904+0000","last_change":"2024-01-20T11:09:25.668814+0000","last_active":"2024-01-20T11:09:26.666904+0000","last_peered":"2024-01-20T11:09:26.666904+0000","last_clean":"2024-01-20T11:09:26.666904+0000","last_became_active":"2024-01-20T11:09:25.668549+0000","last_became_peered":"2024-01-20T11:09:25.668549+0000","last_unstale":"2024-01-20T11:09:26.666904+0000","last_undegraded":"2024-01-20T11:09:26.666904+0000","last_fullsized":"2024-01-20T11:09:26.666904+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:34:35.174326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430905+0000","last_change":"2024-01-20T11:09:26.684150+0000","last_active":"2024-01-20T11:09:28.430905+0000","last_peered":"2024-01-20T11:09:28.430905+0000","last_clean":"2024-01-20T11:09:28.430905+0000","last_became_active":"2024-01-20T11:09:26.683497+0000","last_became_peered":"2024-01-20T11:09:26.683497+0000","last_unstale":"2024-01-20T11:09:28.430905+0000","last_undegraded":"2024-01-20T11:09:28.430905+0000","last_fullsized":"2024-01-20T11:09:28.430905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:30.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707341+0000","last_change":"2024-01-20T11:09:25.664399+0000","last_active":"2024-01-20T11:09:26.707341+0000","last_peered":"2024-01-20T11:09:26.707341+0000","last_clean":"2024-01-20T11:09:26.707341+0000","last_became_active":"2024-01-20T11:09:25.664143+0000","last_became_peered":"2024-01-20T11:09:25.664143+0000","last_unstale":"2024-01-20T11:09:26.707341+0000","last_undegraded":"2024-01-20T11:09:26.707341+0000","last_fullsized":"2024-01-20T11:09:26.707341+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:27.814229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429516+0000","last_change":"2024-01-20T11:09:26.687665+0000","last_active":"2024-01-20T11:09:28.429516+0000","last_peered":"2024-01-20T11:09:28.429516+0000","last_clean":"2024-01-20T11:09:28.429516+0000","last_became_active":"2024-01-20T11:09:26.687432+0000","last_became_peered":"2024-01-20T11:09:26.687432+0000","last_unstale":"2024-01-20T11:09:28.429516+0000","last_undegraded":"2024-01-20T11:09:28.429516+0000","last_fullsized":"2024-01-20T11:09:28.429516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:51:53.803211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.657988+0000","last_change":"2024-01-20T11:09:25.673499+0000","last_active":"2024-01-20T11:09:26.657988+0000","last_peered":"2024-01-20T11:09:26.657988+0000","last_clean":"2024-01-20T11:09:26.657988+0000","last_became_active":"2024-01-20T11:09:25.673220+0000","last_became_peered":"2024-01-20T11:09:25.673220+0000","last_unstale":"2024-01-20T11:09:26.657988+0000","last_undegraded":"2024-01-20T11:09:26.657988+0000","last_fullsized":"2024-01-20T11:09:26.657988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:47.700216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.676887+0000","last_change":"2024-01-20T11:09:26.691210+0000","last_active":"2024-01-20T11:09:27.676887+0000","last_peered":"2024-01-20T11:09:27.676887+0000","last_clean":"2024-01-20T11:09:27.676887+0000","last_became_active":"2024-01-20T11:09:26.690903+0000","last_became_peered":"2024-01-20T11:09:26.690903+0000","last_unstale":"2024-01-20T11:09:27.676887+0000","last_undegraded":"2024-01-20T11:09:27.676887+0000","last_fullsized":"2024-01-20T11:09:27.676887+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:58:56.722085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655609+0000","last_change":"2024-01-20T11:09:25.661232+0000","last_active":"2024-01-20T11:09:26.655609+0000","last_peered":"2024-01-20T11:09:26.655609+0000","last_clean":"2024-01-20T11:09:26.655609+0000","last_became_active":"2024-01-20T11:09:25.660942+0000","last_became_peered":"2024-01-20T11:09:25.660942+0000","last_unstale":"2024-01-20T11:09:26.655609+0000","last_undegraded":"2024-01-20T11:09:26.655609+0000","last_fullsized":"2024-01-20T11:09:26.655609+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:32.999975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191448+0000","last_change":"2024-01-20T11:09:26.684507+0000","last_active":"2024-01-20T11:09:28.191448+0000","last_peered":"2024-01-20T11:09:28.191448+0000","last_clean":"2024-01-20T11:09:28.191448+0000","last_became_active":"2024-01-20T11:09:26.684201+0000","last_became_peered":"2024-01-20T11:09:26.684201+0000","last_unstale":"2024-01-20T11:09:28.191448+0000","last_undegraded":"2024-01-20T11:09:28.191448+0000","last_fullsized":"2024-01-20T11:09:28.191448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:40:39.955372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.678786+0000","last_change":"2024-01-20T11:09:25.673119+0000","last_active":"2024-01-20T11:09:26.678786+0000","last_peered":"2024-01-20T11:09:26.678786+0000","last_clean":"2024-01-20T11:09:26.678786+0000","last_became_active":"2024-01-20T11:09:25.672661+0000","last_became_peered":"2024-01-20T11:09:25.672661+0000","last_unstale":"2024-01-20T11:09:26.678786+0000","last_undegraded":"2024-01-20T11:09:26.678786+0000","last_fullsized":"2024-01-20T11:09:26.678786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.538731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720789+0000","last_change":"2024-01-20T11:09:26.684444+0000","last_active":"2024-01-20T11:09:27.720789+0000","last_peered":"2024-01-20T11:09:27.720789+0000","last_clean":"2024-01-20T11:09:27.720789+0000","last_became_active":"2024-01-20T11:09:26.684134+0000","last_became_peered":"2024-01-20T11:09:26.684134+0000","last_unstale":"2024-01-20T11:09:27.720789+0000","last_undegraded":"2024-01-20T11:09:27.720789+0000","last_fullsized":"2024-01-20T11:09:27.720789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:14.552443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.666196+0000","last_change":"2024-01-20T11:09:25.670430+0000","last_active":"2024-01-20T11:09:26.666196+0000","last_peered":"2024-01-20T11:09:26.666196+0000","last_clean":"2024-01-20T11:09:26.666196+0000","last_became_active":"2024-01-20T11:09:25.670202+0000","last_became_peered":"2024-01-20T11:09:25.670202+0000","last_unstale":"2024-01-20T11:09:26.666196+0000","last_undegraded":"2024-01-20T11:09:26.666196+0000","last_fullsized":"2024-01-20T11:09:26.666196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:40:38.941660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192165+0000","last_change":"2024-01-20T11:09:26.684054+0000","last_active":"2024-01-20T11:09:28.192165+0000","last_peered":"2024-01-20T11:09:28.192165+0000","last_clean":"2024-01-20T11:09:28.192165+0000","last_became_active":"2024-01-20T11:09:26.683673+0000","last_became_peered":"2024-01-20T11:09:26.683673+0000","last_unstale":"2024-01-20T11:09:28.192165+0000","last_undegraded":"2024-01-20T11:09:28.192165+0000","last_fullsized":"2024-01-20T11:09:28.192165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.685235+0000","last_change":"2024-01-20T11:09:25.674337+0000","last_active":"2024-01-20T11:09:26.685235+0000","last_peered":"2024-01-20T11:09:26.685235+0000","last_clean":"2024-01-20T11:09:26.685235+0000","last_became_active":"2024-01-20T11:09:25.674049+0000","last_became_peered":"2024-01-20T11:09:25.674049+0000","last_unstale":"2024-01-20T11:09:26.685235+0000","last_undegraded":"2024-01-20T11:09:26.685235+0000","last_fullsized":"2024-01-20T11:09:26.685235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:52:34.016988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679217+0000","last_change":"2024-01-20T11:09:26.696903+0000","last_active":"2024-01-20T11:09:27.679217+0000","last_peered":"2024-01-20T11:09:27.679217+0000","last_clean":"2024-01-20T11:09:27.679217+0000","last_became_active":"2024-01-20T11:09:26.696637+0000","last_became_peered":"2024-01-20T11:09:26.696637+0000","last_unstale":"2024-01-20T11:09:27.679217+0000","last_undegraded":"2024-01-20T11:09:27.679217+0000","last_fullsized":"2024-01-20T11:09:27.679217+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:24:12.697565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.680340+0000","last_change":"2024-01-20T11:09:25.666513+0000","last_active":"2024-01-20T11:09:26.680340+0000","last_peered":"2024-01-20T11:09:26.680340+0000","last_clean":"2024-01-20T11:09:26.680340+0000","last_became_active":"2024-01-20T11:09:25.666244+0000","last_became_peered":"2024-01-20T11:09:25.666244+0000","last_unstale":"2024-01-20T11:09:26.680340+0000","last_undegraded":"2024-01-20T11:09:26.680340+0000","last_fullsized":"2024-01-20T11:09:26.680340+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:56:07.984070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431152+0000","last_change":"2024-01-20T11:09:26.680250+0000","last_active":"2024-01-20T11:09:28.431152+0000","last_peered":"2024-01-20T11:09:28.431152+0000","last_clean":"2024-01-20T11:09:28.431152+0000","last_became_active":"2024-01-20T11:09:26.679033+0000","last_became_peered":"2024-01-20T11:09:26.679033+0000","last_unstale":"2024-01-20T11:09:28.431152+0000","last_undegraded":"2024-01-20T11:09:28.431152+0000","last_fullsized":"2024-01-20T11:09:28.431152+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:36:27.314299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.686667+0000","last_change":"2024-01-20T11:09:25.674417+0000","last_active":"2024-01-20T11:09:26.686667+0000","last_peered":"2024-01-20T11:09:26.686667+0000","last_clean":"2024-01-20T11:09:26.686667+0000","last_became_active":"2024-01-20T11:09:25.673890+0000","last_became_peered":"2024-01-20T11:09:25.673890+0000","last_unstale":"2024-01-20T11:09:26.686667+0000","last_undegraded":"2024-01-20T11:09:26.686667+0000","last_fullsized":"2024-01-20T11:09:26.686667+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:18:54.420184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431161+0000","last_change":"2024-01-20T11:09:26.689141+0000","last_active":"2024-01-20T11:09:28.431161+0000","last_peered":"2024-01-20T11:09:28.431161+0000","last_clean":"2024-01-20T11:09:28.431161+0000","last_became_active":"2024-01-20T11:09:26.687219+0000","last_became_peered":"2024-01-20T11:09:26.687219+0000","last_unstale":"2024-01-20T11:09:28.431161+0000","last_undegraded":"2024-01-20T11:09:28.431161+0000","last_fullsized":"2024-01-20T11:09:28.431161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:06.885960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.683013+0000","last_change":"2024-01-20T11:09:25.662705+0000","last_active":"2024-01-20T11:09:26.683013+0000","last_peered":"2024-01-20T11:09:26.683013+0000","last_clean":"2024-01-20T11:09:26.683013+0000","last_became_active":"2024-01-20T11:09:25.662444+0000","last_became_peered":"2024-01-20T11:09:25.662444+0000","last_unstale":"2024-01-20T11:09:26.683013+0000","last_undegraded":"2024-01-20T11:09:26.683013+0000","last_fullsized":"2024-01-20T11:09:26.683013+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:21:06.514985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677505+0000","last_change":"2024-01-20T11:09:26.698689+0000","last_active":"2024-01-20T11:09:27.677505+0000","last_peered":"2024-01-20T11:09:27.677505+0000","last_clean":"2024-01-20T11:09:27.677505+0000","last_became_active":"2024-01-20T11:09:26.698392+0000","last_became_peered":"2024-01-20T11:09:26.698392+0000","last_unstale":"2024-01-20T11:09:27.677505+0000","last_undegraded":"2024-01-20T11:09:27.677505+0000","last_fullsized":"2024-01-20T11:09:27.677505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:49.930023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.680077+0000","last_change":"2024-01-20T11:09:25.669178+0000","last_active":"2024-01-20T11:09:26.680077+0000","last_peered":"2024-01-20T11:09:26.680077+0000","last_clean":"2024-01-20T11:09:26.680077+0000","last_became_active":"2024-01-20T11:09:25.668816+0000","last_became_peered":"2024-01-20T11:09:25.668816+0000","last_unstale":"2024-01-20T11:09:26.680077+0000","last_undegraded":"2024-01-20T11:09:26.680077+0000","last_fullsized":"2024-01-20T11:09:26.680077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:21:06.514985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429031+0000","last_change":"2024-01-20T11:09:26.680872+0000","last_active":"2024-01-20T11:09:28.429031+0000","last_peered":"2024-01-20T11:09:28.429031+0000","last_clean":"2024-01-20T11:09:28.429031+0000","last_became_active":"2024-01-20T11:09:26.680017+0000","last_became_peered":"2024-01-20T11:09:26.680017+0000","last_unstale":"2024-01-20T11:09:28.429031+0000","last_undegraded":"2024-01-20T11:09:28.429031+0000","last_fullsized":"2024-01-20T11:09:28.429031+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:50:44.925247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655653+0000","last_change":"2024-01-20T11:09:25.662421+0000","last_active":"2024-01-20T11:09:26.655653+0000","last_peered":"2024-01-20T11:09:26.655653+0000","last_clean":"2024-01-20T11:09:26.655653+0000","last_became_active":"2024-01-20T11:09:25.661713+0000","last_became_peered":"2024-01-20T11:09:25.661713+0000","last_unstale":"2024-01-20T11:09:26.655653+0000","last_undegraded":"2024-01-20T11:09:26.655653+0000","last_fullsized":"2024-01-20T11:09:26.655653+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:55:05.992860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192700+0000","last_change":"2024-01-20T11:09:26.696785+0000","last_active":"2024-01-20T11:09:28.192700+0000","last_peered":"2024-01-20T11:09:28.192700+0000","last_clean":"2024-01-20T11:09:28.192700+0000","last_became_active":"2024-01-20T11:09:26.696524+0000","last_became_peered":"2024-01-20T11:09:26.696524+0000","last_unstale":"2024-01-20T11:09:28.192700+0000","last_undegraded":"2024-01-20T11:09:28.192700+0000","last_fullsized":"2024-01-20T11:09:28.192700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:05.315505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.706883+0000","last_change":"2024-01-20T11:09:25.666038+0000","last_active":"2024-01-20T11:09:26.706883+0000","last_peered":"2024-01-20T11:09:26.706883+0000","last_clean":"2024-01-20T11:09:26.706883+0000","last_became_active":"2024-01-20T11:09:25.663508+0000","last_became_peered":"2024-01-20T11:09:25.663508+0000","last_unstale":"2024-01-20T11:09:26.706883+0000","last_undegraded":"2024-01-20T11:09:26.706883+0000","last_fullsized":"2024-01-20T11:09:26.706883+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:52.561712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677775+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:09:27.677775+0000","last_peered":"2024-01-20T11:09:27.677775+0000","last_clean":"2024-01-20T11:09:27.677775+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:09:27.677775+0000","last_undegraded":"2024-01-20T11:09:27.677775+0000","last_fullsized":"2024-01-20T11:09:27.677775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":813375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.036}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.105},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.335}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.758},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.383}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.7070000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.873},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.28}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2210000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.859}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":223589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.296,"5min":3.343,"15min":3.343},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6830000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.216,"15min":1.2410000000000001},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.675,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4710000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2450000000000001,"15min":1.248},"min":{"1min":0.85699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.514,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.002},{"interface":"front","average":{"1min":1.226,"5min":1.294,"15min":1.3049999999999999},"min":{"1min":0.82299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.694,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.84899999999999998}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.284,"15min":1.2929999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.609,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.4690000000000001,"15min":1.488},"min":{"1min":1.0700000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.708,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.1419999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.4419999999999999},"min":{"1min":0.88600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.6399999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.347,"5min":1.355,"15min":1.3560000000000001},"min":{"1min":0.88100000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.768,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5309999999999999,"15min":1.542},"min":{"1min":1.1180000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9099999999999999,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.5369999999999999,"15min":1.5509999999999999},"min":{"1min":0.94399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9370000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.276}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":1.034,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.853,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.034},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.673,"15min":1.6910000000000001},"min":{"1min":1.0680000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9950000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.0680000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":222987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.1040000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.94699999999999995}]},{"osd":2,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.224},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.4359999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.278}]},{"osd":4,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.546},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.603}]},{"osd":6,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.169,"5min":1.169,"15min":1.169},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.649},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.4930000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:08:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.8149999999999999},{"interface":"front","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.391,"5min":1.391,"15min":1.391},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.736}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":561152,"data_stored":224529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.89700000000000002}]},{"osd":1,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.704}]},{"osd":2,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.048}]},{"osd":3,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.516},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.365}]},{"osd":5,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.6619999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.278},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.792}]},{"osd":7,"last update":"Sat Jan 20 11:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.472}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":223555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.88}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.012},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.532},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.4319999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.292},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.3979999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.343},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.4890000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.577},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.6240000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":224551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92600000000000005,"15min":0.85199999999999998},"min":{"1min":0.622,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":9.8870000000000005,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.1080000000000001,"15min":1.05},"min":{"1min":0.66900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.026,"5min":10.026,"15min":10.026},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.137,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":0.876},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.2090000000000001,"15min":1.129},"min":{"1min":0.66600000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":1.008}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.21,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":11.414999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.4359999999999999,"15min":1.367},"min":{"1min":0.95399999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":10.919,"5min":10.919,"15min":10.919},"last":0.90200000000000002}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.4990000000000001,"15min":1.4350000000000001},"min":{"1min":1.073,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":11.1,"5min":11.1,"15min":11.1},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.996,"5min":1.54,"15min":1.464},"min":{"1min":0.89600000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":11.141999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.4199999999999999,"15min":1.3799999999999999},"min":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":10.077999999999999,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.401,"15min":1.3899999999999999},"min":{"1min":1.0920000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.3}]},{"osd":6,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.6499999999999999,"15min":1.5760000000000001},"min":{"1min":1.22,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":11.185,"5min":11.185,"15min":11.185},"last":1.157},{"interface":"front","average":{"1min":1.845,"5min":1.536,"15min":1.484},"min":{"1min":1.008,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":1.377}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.52,"15min":1.4670000000000001},"min":{"1min":0.96999999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":10.234999999999999,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.234},{"interface":"front","average":{"1min":1.956,"5min":1.512,"15min":1.4379999999999999},"min":{"1min":1.2549999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":9.843,"5min":9.843,"15min":9.843},"last":1.1339999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":222987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.0549999999999999,"15min":1.01},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":12.061,"5min":12.061,"15min":12.061},"last":1.208},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1739999999999999,"15min":1.165},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":1.5009999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.04,"15min":1.054},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.3929999999999998,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.032},{"interface":"front","average":{"1min":1.889,"5min":1.3520000000000001,"15min":1.262},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.204999999999998,"5min":20.204999999999998,"15min":20.204999999999998},"last":1.333}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.278,"15min":1.232},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":11.978999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":1.6539999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.325,"15min":1.3540000000000001},"min":{"1min":0.77900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6839999999999999,"5min":5.21,"15min":5.21},"last":1.147},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.528,"15min":1.46},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":15.596,"5min":15.596,"15min":15.596},"last":1.591}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.5740000000000001,"15min":1.5649999999999999},"min":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.403},{"interface":"front","average":{"1min":1.296,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.966,"5min":5.242,"15min":5.242},"last":1.6220000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.6040000000000001,"15min":1.5900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":10.784000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.756},{"interface":"front","average":{"1min":1.282,"5min":1.423,"15min":1.4470000000000001},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.931,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.26}]},{"osd":7,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.601,"15min":1.5569999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.7150000000000001,"15min":1.6990000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":10.869999999999999,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.903}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":813319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.113,"5min":0.91000000000000003,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.1109999999999998,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":1.0209999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":1.357},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.90400000000000003,"15min":0.85999999999999999},"min":{"1min":0.48999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.976,"5min":5.976,"15min":5.976},"last":0.98199999999999998}]},{"osd":3,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.03,"15min":1.006},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":1.089},{"interface":"front","average":{"1min":1.29,"5min":1.042,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.2110000000000003,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":1.115}]},{"osd":4,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.2450000000000001,"15min":1.2110000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.2640000000000002,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":1.333},{"interface":"front","average":{"1min":1.347,"5min":1.25,"15min":1.234},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.647},{"interface":"front","average":{"1min":1.51,"5min":1.25,"15min":1.206},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":1.2390000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.2949999999999999,"15min":1.2749999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3899999999999999,"15min":1.3620000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5629999999999997,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.7529999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.337,"15min":1.296},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":6.1660000000000004,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.5169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:09:36.133 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:09:36.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.351+0000 7f213a400640 1 Processor -- start 2024-01-20T11:09:36.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.351+0000 7f213a400640 1 -- start start 2024-01-20T11:09:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.353+0000 7f213a400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2134143c70 0x7f2134070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.353+0000 7f213a400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340b3ad0 0x7f21340cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.353+0000 7f213a400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21340cd300 con 0x7f21340cf960 2024-01-20T11:09:36.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.353+0000 7f213a400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340cfdd0 con 0x7f2134143c70 2024-01-20T11:09:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.353+0000 7f213a400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21340cc9d0 con 0x7f21340b3ad0 2024-01-20T11:09:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.353+0000 7f2139000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2134143c70 0x7f2134070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.354+0000 7f2139000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2134143c70 0x7f2134070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60586/0 (socket says 172.21.15.162:60586) 2024-01-20T11:09:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.354+0000 7f2139000640 1 -- 172.21.15.162:0/4146191189 learned_addr learned my addr 172.21.15.162:0/4146191189 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:36.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.354+0000 7f2133e00640 1 --2- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340b3ad0 0x7f21340cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.354+0000 7f2139000640 1 -- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340b3ad0 msgr2=0x7f21340cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:36.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.354+0000 7f2139000640 1 --2- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340b3ad0 0x7f21340cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.354+0000 7f2139000640 1 -- 172.21.15.162:0/4146191189 >> v1:172.21.15.179:6789/0 conn(0x7f21340cf960 legacy=0x7f21340b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.354+0000 7f2139000640 1 -- 172.21.15.162:0/4146191189 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340cccb0 con 0x7f2134143c70 2024-01-20T11:09:36.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.356+0000 7f2139000640 1 --2- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f2134070d20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2124009e50 tx=0x7f212402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5965ed06ffc27b52 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:36.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.356+0000 7f2133400640 1 -- 172.21.15.162:0/4146191189 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212402cb00 con 0x7f2134143c70 2024-01-20T11:09:36.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.356+0000 7f2133400640 1 -- 172.21.15.162:0/4146191189 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212402cc60 con 0x7f2134143c70 2024-01-20T11:09:36.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.356+0000 7f2133400640 1 -- 172.21.15.162:0/4146191189 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240343f0 con 0x7f2134143c70 2024-01-20T11:09:36.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 -- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 msgr2=0x7f2134070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 --2- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f2134070d20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2124009e50 tx=0x7f212402bf60 comp rx=0 tx=0).stop 2024-01-20T11:09:36.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 -- 172.21.15.162:0/4146191189 shutdown_connections 2024-01-20T11:09:36.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 --2- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340b3ad0 0x7f21340cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 --2- 172.21.15.162:0/4146191189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f2134070d20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 -- 172.21.15.162:0/4146191189 >> 172.21.15.162:0/4146191189 conn(0x7f213406aa20 msgr2=0x7f213406ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:36.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 -- 172.21.15.162:0/4146191189 shutdown_connections 2024-01-20T11:09:36.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.357+0000 7f213a400640 1 -- 172.21.15.162:0/4146191189 wait complete. 2024-01-20T11:09:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.359+0000 7f213a400640 1 Processor -- start 2024-01-20T11:09:36.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.359+0000 7f213a400640 1 -- start start 2024-01-20T11:09:36.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.360+0000 7f213a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21340b3ad0 0x7f21340c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f213a400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340cf960 0x7f213415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f213a400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f21341f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f213a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134137500 con 0x7f21340b3ad0 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f213a400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21340c8f20 con 0x7f2134143c70 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f213a400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21341377a0 con 0x7f21340cf960 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21340b3ad0 0x7f21340c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21340b3ad0 0x7f21340c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42818/0 (socket says 172.21.15.162:42818) 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 -- 172.21.15.162:0/2580653287 learned_addr learned my addr 172.21.15.162:0/2580653287 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2133e00640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340cf960 0x7f213415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139a00640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f21341f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 -- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340cf960 msgr2=0x7f213415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340cf960 0x7f213415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 -- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 msgr2=0x7f21341f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f21341f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139000640 1 -- 172.21.15.162:0/2580653287 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009b30 con 0x7f21340b3ad0 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2133e00640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340cf960 0x7f213415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.361+0000 7f2139a00640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f21341f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.362+0000 7f2139000640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21340b3ad0 0x7f21340c89e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2124036040 tx=0x7f2124004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.362+0000 7f2130c00640 1 -- 172.21.15.162:0/2580653287 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124009510 con 0x7f21340b3ad0 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.362+0000 7f2130c00640 1 -- 172.21.15.162:0/2580653287 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212403e450 con 0x7f21340b3ad0 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.362+0000 7f2130c00640 1 -- 172.21.15.162:0/2580653287 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212403e820 con 0x7f21340b3ad0 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.362+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2134137a80 con 0x7f21340b3ad0 2024-01-20T11:09:36.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.362+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2134138040 con 0x7f21340b3ad0 2024-01-20T11:09:36.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.363+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2134074a30 con 0x7f21340b3ad0 2024-01-20T11:09:36.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.364+0000 7f2130c00640 1 -- 172.21.15.162:0/2580653287 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f212403e980 con 0x7f21340b3ad0 2024-01-20T11:09:36.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.365+0000 7f2130c00640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f210c06aed0 0x7f210c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.365+0000 7f2130c00640 1 -- 172.21.15.162:0/2580653287 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21240ac420 con 0x7f21340b3ad0 2024-01-20T11:09:36.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.365+0000 7f2133e00640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f210c06aed0 0x7f210c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.366+0000 7f2133e00640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f210c06aed0 0x7f210c06d390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21341f6d40 tx=0x7f211c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:36.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.371+0000 7f2130c00640 1 -- 172.21.15.162:0/2580653287 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2124077270 con 0x7f21340b3ad0 2024-01-20T11:09:36.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.562+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2134143540 con 0x7f210c06aed0 2024-01-20T11:09:36.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.584+0000 7f2130c00640 1 -- 172.21.15.162:0/2580653287 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286710 (secure 0 0 0) 0x7f2134143540 con 0x7f210c06aed0 2024-01-20T11:09:36.593 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:36.595 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:09:36.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.591+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f210c06aed0 msgr2=0x7f210c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.591+0000 7f213a400640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f210c06aed0 0x7f210c06d390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21341f6d40 tx=0x7f211c008040 comp rx=0 tx=0).stop 2024-01-20T11:09:36.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.591+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21340b3ad0 msgr2=0x7f21340c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.591+0000 7f213a400640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21340b3ad0 0x7f21340c89e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2124036040 tx=0x7f2124004a40 comp rx=0 tx=0).stop 2024-01-20T11:09:36.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 shutdown_connections 2024-01-20T11:09:36.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f210c06aed0 0x7f210c06d390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2134143c70 0x7f21341f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21340cf960 0x7f213415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 --2- 172.21.15.162:0/2580653287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21340b3ad0 0x7f21340c89e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 >> 172.21.15.162:0/2580653287 conn(0x7f213406aa20 msgr2=0x7f21340b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:36.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 shutdown_connections 2024-01-20T11:09:36.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.592+0000 7f213a400640 1 -- 172.21.15.162:0/2580653287 wait complete. 2024-01-20T11:09:36.614 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-01-20T11:09:35.618761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246652,"kb_used_data":5512,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728068,"statfs":{"total":773094113280,"available":772841541632,"internally_reserved":0,"allocated":5644288,"data_stored":2968892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.967453"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679698+0000","last_change":"2024-01-20T11:09:26.704261+0000","last_active":"2024-01-20T11:09:27.679698+0000","last_peered":"2024-01-20T11:09:27.679698+0000","last_clean":"2024-01-20T11:09:27.679698+0000","last_became_active":"2024-01-20T11:09:26.696063+0000","last_became_peered":"2024-01-20T11:09:26.696063+0000","last_unstale":"2024-01-20T11:09:27.679698+0000","last_undegraded":"2024-01-20T11:09:27.679698+0000","last_fullsized":"2024-01-20T11:09:27.679698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:05.315505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678398+0000","last_change":"2024-01-20T11:09:26.672672+0000","last_active":"2024-01-20T11:09:27.678398+0000","last_peered":"2024-01-20T11:09:27.678398+0000","last_clean":"2024-01-20T11:09:27.678398+0000","last_became_active":"2024-01-20T11:09:26.671885+0000","last_became_peered":"2024-01-20T11:09:26.671885+0000","last_unstale":"2024-01-20T11:09:27.678398+0000","last_undegraded":"2024-01-20T11:09:27.678398+0000","last_fullsized":"2024-01-20T11:09:27.678398+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:57.604746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429184+0000","last_change":"2024-01-20T11:09:26.689755+0000","last_active":"2024-01-20T11:09:28.429184+0000","last_peered":"2024-01-20T11:09:28.429184+0000","last_clean":"2024-01-20T11:09:28.429184+0000","last_became_active":"2024-01-20T11:09:26.689458+0000","last_became_peered":"2024-01-20T11:09:26.689458+0000","last_unstale":"2024-01-20T11:09:28.429184+0000","last_undegraded":"2024-01-20T11:09:28.429184+0000","last_fullsized":"2024-01-20T11:09:28.429184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:21:59.383614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192164+0000","last_change":"2024-01-20T11:09:26.685585+0000","last_active":"2024-01-20T11:09:28.192164+0000","last_peered":"2024-01-20T11:09:28.192164+0000","last_clean":"2024-01-20T11:09:28.192164+0000","last_became_active":"2024-01-20T11:09:26.683586+0000","last_became_peered":"2024-01-20T11:09:26.683586+0000","last_unstale":"2024-01-20T11:09:28.192164+0000","last_undegraded":"2024-01-20T11:09:28.192164+0000","last_fullsized":"2024-01-20T11:09:28.192164+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678174+0000","last_change":"2024-01-20T11:09:26.675354+0000","last_active":"2024-01-20T11:09:27.678174+0000","last_peered":"2024-01-20T11:09:27.678174+0000","last_clean":"2024-01-20T11:09:27.678174+0000","last_became_active":"2024-01-20T11:09:26.674942+0000","last_became_peered":"2024-01-20T11:09:26.674942+0000","last_unstale":"2024-01-20T11:09:27.678174+0000","last_undegraded":"2024-01-20T11:09:27.678174+0000","last_fullsized":"2024-01-20T11:09:27.678174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:26.979517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430774+0000","last_change":"2024-01-20T11:09:26.695334+0000","last_active":"2024-01-20T11:09:28.430774+0000","last_peered":"2024-01-20T11:09:28.430774+0000","last_clean":"2024-01-20T11:09:28.430774+0000","last_became_active":"2024-01-20T11:09:26.695044+0000","last_became_peered":"2024-01-20T11:09:26.695044+0000","last_unstale":"2024-01-20T11:09:28.430774+0000","last_undegraded":"2024-01-20T11:09:28.430774+0000","last_fullsized":"2024-01-20T11:09:28.430774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:18:44.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678120+0000","last_change":"2024-01-20T11:09:26.705212+0000","last_active":"2024-01-20T11:09:27.678120+0000","last_peered":"2024-01-20T11:09:27.678120+0000","last_clean":"2024-01-20T11:09:27.678120+0000","last_became_active":"2024-01-20T11:09:26.702807+0000","last_became_peered":"2024-01-20T11:09:26.702807+0000","last_unstale":"2024-01-20T11:09:27.678120+0000","last_undegraded":"2024-01-20T11:09:27.678120+0000","last_fullsized":"2024-01-20T11:09:27.678120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191291+0000","last_change":"2024-01-20T11:09:26.688539+0000","last_active":"2024-01-20T11:09:28.191291+0000","last_peered":"2024-01-20T11:09:28.191291+0000","last_clean":"2024-01-20T11:09:28.191291+0000","last_became_active":"2024-01-20T11:09:26.688265+0000","last_became_peered":"2024-01-20T11:09:26.688265+0000","last_unstale":"2024-01-20T11:09:28.191291+0000","last_undegraded":"2024-01-20T11:09:28.191291+0000","last_fullsized":"2024-01-20T11:09:28.191291+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:28.827941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192807+0000","last_change":"2024-01-20T11:09:26.680892+0000","last_active":"2024-01-20T11:09:28.192807+0000","last_peered":"2024-01-20T11:09:28.192807+0000","last_clean":"2024-01-20T11:09:28.192807+0000","last_became_active":"2024-01-20T11:09:26.680592+0000","last_became_peered":"2024-01-20T11:09:26.680592+0000","last_unstale":"2024-01-20T11:09:28.192807+0000","last_undegraded":"2024-01-20T11:09:28.192807+0000","last_fullsized":"2024-01-20T11:09:28.192807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:27:21.085164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192500+0000","last_change":"2024-01-20T11:09:26.687226+0000","last_active":"2024-01-20T11:09:28.192500+0000","last_peered":"2024-01-20T11:09:28.192500+0000","last_clean":"2024-01-20T11:09:28.192500+0000","last_became_active":"2024-01-20T11:09:26.686979+0000","last_became_peered":"2024-01-20T11:09:26.686979+0000","last_unstale":"2024-01-20T11:09:28.192500+0000","last_undegraded":"2024-01-20T11:09:28.192500+0000","last_fullsized":"2024-01-20T11:09:28.192500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:24:12.697565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192120+0000","last_change":"2024-01-20T11:09:26.693786+0000","last_active":"2024-01-20T11:09:28.192120+0000","last_peered":"2024-01-20T11:09:28.192120+0000","last_clean":"2024-01-20T11:09:28.192120+0000","last_became_active":"2024-01-20T11:09:26.693524+0000","last_became_peered":"2024-01-20T11:09:26.693524+0000","last_unstale":"2024-01-20T11:09:28.192120+0000","last_undegraded":"2024-01-20T11:09:28.192120+0000","last_fullsized":"2024-01-20T11:09:28.192120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:26.979517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678672+0000","last_change":"2024-01-20T11:09:26.683665+0000","last_active":"2024-01-20T11:09:27.678672+0000","last_peered":"2024-01-20T11:09:27.678672+0000","last_clean":"2024-01-20T11:09:27.678672+0000","last_became_active":"2024-01-20T11:09:26.683369+0000","last_became_peered":"2024-01-20T11:09:26.683369+0000","last_unstale":"2024-01-20T11:09:27.678672+0000","last_undegraded":"2024-01-20T11:09:27.678672+0000","last_fullsized":"2024-01-20T11:09:27.678672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:46.776196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677024+0000","last_change":"2024-01-20T11:09:26.695303+0000","last_active":"2024-01-20T11:09:27.677024+0000","last_peered":"2024-01-20T11:09:27.677024+0000","last_clean":"2024-01-20T11:09:27.677024+0000","last_became_active":"2024-01-20T11:09:26.695018+0000","last_became_peered":"2024-01-20T11:09:26.695018+0000","last_unstale":"2024-01-20T11:09:27.677024+0000","last_undegraded":"2024-01-20T11:09:27.677024+0000","last_fullsized":"2024-01-20T11:09:27.677024+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:16:14.451123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191741+0000","last_change":"2024-01-20T11:09:26.684122+0000","last_active":"2024-01-20T11:09:28.191741+0000","last_peered":"2024-01-20T11:09:28.191741+0000","last_clean":"2024-01-20T11:09:28.191741+0000","last_became_active":"2024-01-20T11:09:26.683772+0000","last_became_peered":"2024-01-20T11:09:26.683772+0000","last_unstale":"2024-01-20T11:09:28.191741+0000","last_undegraded":"2024-01-20T11:09:28.191741+0000","last_fullsized":"2024-01-20T11:09:28.191741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:34:36.188038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430653+0000","last_change":"2024-01-20T11:09:26.679970+0000","last_active":"2024-01-20T11:09:28.430653+0000","last_peered":"2024-01-20T11:09:28.430653+0000","last_clean":"2024-01-20T11:09:28.430653+0000","last_became_active":"2024-01-20T11:09:26.679604+0000","last_became_peered":"2024-01-20T11:09:26.679604+0000","last_unstale":"2024-01-20T11:09:28.430653+0000","last_undegraded":"2024-01-20T11:09:28.430653+0000","last_fullsized":"2024-01-20T11:09:28.430653+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:09:57.629408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.719963+0000","last_change":"2024-01-20T11:09:26.681801+0000","last_active":"2024-01-20T11:09:27.719963+0000","last_peered":"2024-01-20T11:09:27.719963+0000","last_clean":"2024-01-20T11:09:27.719963+0000","last_became_active":"2024-01-20T11:09:26.681407+0000","last_became_peered":"2024-01-20T11:09:26.681407+0000","last_unstale":"2024-01-20T11:09:27.719963+0000","last_undegraded":"2024-01-20T11:09:27.719963+0000","last_fullsized":"2024-01-20T11:09:27.719963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:00:48.815425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429351+0000","last_change":"2024-01-20T11:09:26.691803+0000","last_active":"2024-01-20T11:09:28.429351+0000","last_peered":"2024-01-20T11:09:28.429351+0000","last_clean":"2024-01-20T11:09:28.429351+0000","last_became_active":"2024-01-20T11:09:26.690812+0000","last_became_peered":"2024-01-20T11:09:26.690812+0000","last_unstale":"2024-01-20T11:09:28.429351+0000","last_undegraded":"2024-01-20T11:09:28.429351+0000","last_fullsized":"2024-01-20T11:09:28.429351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:25.665790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429392+0000","last_change":"2024-01-20T11:09:26.682398+0000","last_active":"2024-01-20T11:09:28.429392+0000","last_peered":"2024-01-20T11:09:28.429392+0000","last_clean":"2024-01-20T11:09:28.429392+0000","last_became_active":"2024-01-20T11:09:26.680035+0000","last_became_peered":"2024-01-20T11:09:26.680035+0000","last_unstale":"2024-01-20T11:09:28.429392+0000","last_undegraded":"2024-01-20T11:09:28.429392+0000","last_fullsized":"2024-01-20T11:09:28.429392+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:35.069387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.721088+0000","last_change":"2024-01-20T11:09:26.683156+0000","last_active":"2024-01-20T11:09:27.721088+0000","last_peered":"2024-01-20T11:09:27.721088+0000","last_clean":"2024-01-20T11:09:27.721088+0000","last_became_active":"2024-01-20T11:09:26.682878+0000","last_became_peered":"2024-01-20T11:09:26.682878+0000","last_unstale":"2024-01-20T11:09:27.721088+0000","last_undegraded":"2024-01-20T11:09:27.721088+0000","last_fullsized":"2024-01-20T11:09:27.721088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:49.465712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677274+0000","last_change":"2024-01-20T11:09:26.692694+0000","last_active":"2024-01-20T11:09:27.677274+0000","last_peered":"2024-01-20T11:09:27.677274+0000","last_clean":"2024-01-20T11:09:27.677274+0000","last_became_active":"2024-01-20T11:09:26.692380+0000","last_became_peered":"2024-01-20T11:09:26.692380+0000","last_unstale":"2024-01-20T11:09:27.677274+0000","last_undegraded":"2024-01-20T11:09:27.677274+0000","last_fullsized":"2024-01-20T11:09:27.677274+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:13:25.098120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431101+0000","last_change":"2024-01-20T11:09:26.685828+0000","last_active":"2024-01-20T11:09:28.431101+0000","last_peered":"2024-01-20T11:09:28.431101+0000","last_clean":"2024-01-20T11:09:28.431101+0000","last_became_active":"2024-01-20T11:09:26.685539+0000","last_became_peered":"2024-01-20T11:09:26.685539+0000","last_unstale":"2024-01-20T11:09:28.431101+0000","last_undegraded":"2024-01-20T11:09:28.431101+0000","last_fullsized":"2024-01-20T11:09:28.431101+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:20:01.583278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192172+0000","last_change":"2024-01-20T11:09:26.698211+0000","last_active":"2024-01-20T11:09:28.192172+0000","last_peered":"2024-01-20T11:09:28.192172+0000","last_clean":"2024-01-20T11:09:28.192172+0000","last_became_active":"2024-01-20T11:09:26.698031+0000","last_became_peered":"2024-01-20T11:09:26.698031+0000","last_unstale":"2024-01-20T11:09:28.192172+0000","last_undegraded":"2024-01-20T11:09:28.192172+0000","last_fullsized":"2024-01-20T11:09:28.192172+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720053+0000","last_change":"2024-01-20T11:09:26.691953+0000","last_active":"2024-01-20T11:09:27.720053+0000","last_peered":"2024-01-20T11:09:27.720053+0000","last_clean":"2024-01-20T11:09:27.720053+0000","last_became_active":"2024-01-20T11:09:26.691320+0000","last_became_peered":"2024-01-20T11:09:26.691320+0000","last_unstale":"2024-01-20T11:09:27.720053+0000","last_undegraded":"2024-01-20T11:09:27.720053+0000","last_fullsized":"2024-01-20T11:09:27.720053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:56:22.681327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.719993+0000","last_change":"2024-01-20T11:09:26.693837+0000","last_active":"2024-01-20T11:09:27.719993+0000","last_peered":"2024-01-20T11:09:27.719993+0000","last_clean":"2024-01-20T11:09:27.719993+0000","last_became_active":"2024-01-20T11:09:26.690047+0000","last_became_peered":"2024-01-20T11:09:26.690047+0000","last_unstale":"2024-01-20T11:09:27.719993+0000","last_undegraded":"2024-01-20T11:09:27.719993+0000","last_fullsized":"2024-01-20T11:09:27.719993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:51:09.839957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720709+0000","last_change":"2024-01-20T11:09:26.695991+0000","last_active":"2024-01-20T11:09:27.720709+0000","last_peered":"2024-01-20T11:09:27.720709+0000","last_clean":"2024-01-20T11:09:27.720709+0000","last_became_active":"2024-01-20T11:09:26.695701+0000","last_became_peered":"2024-01-20T11:09:26.695701+0000","last_unstale":"2024-01-20T11:09:27.720709+0000","last_undegraded":"2024-01-20T11:09:27.720709+0000","last_fullsized":"2024-01-20T11:09:27.720709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:48.713928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677754+0000","last_change":"2024-01-20T11:09:26.686603+0000","last_active":"2024-01-20T11:09:27.677754+0000","last_peered":"2024-01-20T11:09:27.677754+0000","last_clean":"2024-01-20T11:09:27.677754+0000","last_became_active":"2024-01-20T11:09:26.686326+0000","last_became_peered":"2024-01-20T11:09:26.686326+0000","last_unstale":"2024-01-20T11:09:27.677754+0000","last_undegraded":"2024-01-20T11:09:27.677754+0000","last_fullsized":"2024-01-20T11:09:27.677754+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:31:47.399814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429500+0000","last_change":"2024-01-20T11:09:26.690872+0000","last_active":"2024-01-20T11:09:28.429500+0000","last_peered":"2024-01-20T11:09:28.429500+0000","last_clean":"2024-01-20T11:09:28.429500+0000","last_became_active":"2024-01-20T11:09:26.690548+0000","last_became_peered":"2024-01-20T11:09:26.690548+0000","last_unstale":"2024-01-20T11:09:28.429500+0000","last_undegraded":"2024-01-20T11:09:28.429500+0000","last_fullsized":"2024-01-20T11:09:28.429500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:09:35.885362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678798+0000","last_change":"2024-01-20T11:09:26.683619+0000","last_active":"2024-01-20T11:09:27.678798+0000","last_peered":"2024-01-20T11:09:27.678798+0000","last_clean":"2024-01-20T11:09:27.678798+0000","last_became_active":"2024-01-20T11:09:26.682936+0000","last_became_peered":"2024-01-20T11:09:26.682936+0000","last_unstale":"2024-01-20T11:09:27.678798+0000","last_undegraded":"2024-01-20T11:09:27.678798+0000","last_fullsized":"2024-01-20T11:09:27.678798+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720425+0000","last_change":"2024-01-20T11:09:26.681935+0000","last_active":"2024-01-20T11:09:27.720425+0000","last_peered":"2024-01-20T11:09:27.720425+0000","last_clean":"2024-01-20T11:09:27.720425+0000","last_became_active":"2024-01-20T11:09:26.681629+0000","last_became_peered":"2024-01-20T11:09:26.681629+0000","last_unstale":"2024-01-20T11:09:27.720425+0000","last_undegraded":"2024-01-20T11:09:27.720425+0000","last_fullsized":"2024-01-20T11:09:27.720425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:37:37.827422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429138+0000","last_change":"2024-01-20T11:09:26.691057+0000","last_active":"2024-01-20T11:09:28.429138+0000","last_peered":"2024-01-20T11:09:28.429138+0000","last_clean":"2024-01-20T11:09:28.429138+0000","last_became_active":"2024-01-20T11:09:26.690775+0000","last_became_peered":"2024-01-20T11:09:26.690775+0000","last_unstale":"2024-01-20T11:09:28.429138+0000","last_undegraded":"2024-01-20T11:09:28.429138+0000","last_fullsized":"2024-01-20T11:09:28.429138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:22:40.795037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430947+0000","last_change":"2024-01-20T11:09:26.669802+0000","last_active":"2024-01-20T11:09:28.430947+0000","last_peered":"2024-01-20T11:09:28.430947+0000","last_clean":"2024-01-20T11:09:28.430947+0000","last_became_active":"2024-01-20T11:09:26.669511+0000","last_became_peered":"2024-01-20T11:09:26.669511+0000","last_unstale":"2024-01-20T11:09:28.430947+0000","last_undegraded":"2024-01-20T11:09:28.430947+0000","last_fullsized":"2024-01-20T11:09:28.430947+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:56:54.684647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.676810+0000","last_change":"2024-01-20T11:09:26.698320+0000","last_active":"2024-01-20T11:09:27.676810+0000","last_peered":"2024-01-20T11:09:27.676810+0000","last_clean":"2024-01-20T11:09:27.676810+0000","last_became_active":"2024-01-20T11:09:26.697279+0000","last_became_peered":"2024-01-20T11:09:26.697279+0000","last_unstale":"2024-01-20T11:09:27.676810+0000","last_undegraded":"2024-01-20T11:09:27.676810+0000","last_fullsized":"2024-01-20T11:09:27.676810+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:40:37.036709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429981+0000","last_change":"2024-01-20T11:09:26.685625+0000","last_active":"2024-01-20T11:09:28.429981+0000","last_peered":"2024-01-20T11:09:28.429981+0000","last_clean":"2024-01-20T11:09:28.429981+0000","last_became_active":"2024-01-20T11:09:26.685352+0000","last_became_peered":"2024-01-20T11:09:26.685352+0000","last_unstale":"2024-01-20T11:09:28.429981+0000","last_undegraded":"2024-01-20T11:09:28.429981+0000","last_fullsized":"2024-01-20T11:09:28.429981+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:50.567638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.706029+0000","last_change":"2024-01-20T11:09:25.667528+0000","last_active":"2024-01-20T11:09:26.706029+0000","last_peered":"2024-01-20T11:09:26.706029+0000","last_clean":"2024-01-20T11:09:26.706029+0000","last_became_active":"2024-01-20T11:09:25.667261+0000","last_became_peered":"2024-01-20T11:09:25.667261+0000","last_unstale":"2024-01-20T11:09:26.706029+0000","last_undegraded":"2024-01-20T11:09:26.706029+0000","last_fullsized":"2024-01-20T11:09:26.706029+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:20:25.965805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720688+0000","last_change":"2024-01-20T11:09:26.695261+0000","last_active":"2024-01-20T11:09:27.720688+0000","last_peered":"2024-01-20T11:09:27.720688+0000","last_clean":"2024-01-20T11:09:27.720688+0000","last_became_active":"2024-01-20T11:09:26.694955+0000","last_became_peered":"2024-01-20T11:09:26.694955+0000","last_unstale":"2024-01-20T11:09:27.720688+0000","last_undegraded":"2024-01-20T11:09:27.720688+0000","last_fullsized":"2024-01-20T11:09:27.720688+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:33:51.492845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.703179+0000","last_change":"2024-01-20T11:09:25.666647+0000","last_active":"2024-01-20T11:09:26.703179+0000","last_peered":"2024-01-20T11:09:26.703179+0000","last_clean":"2024-01-20T11:09:26.703179+0000","last_became_active":"2024-01-20T11:09:25.666288+0000","last_became_peered":"2024-01-20T11:09:25.666288+0000","last_unstale":"2024-01-20T11:09:26.703179+0000","last_undegraded":"2024-01-20T11:09:26.703179+0000","last_fullsized":"2024-01-20T11:09:26.703179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:33:39.669648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678930+0000","last_change":"2024-01-20T11:09:26.676550+0000","last_active":"2024-01-20T11:09:27.678930+0000","last_peered":"2024-01-20T11:09:27.678930+0000","last_clean":"2024-01-20T11:09:27.678930+0000","last_became_active":"2024-01-20T11:09:26.675866+0000","last_became_peered":"2024-01-20T11:09:26.675866+0000","last_unstale":"2024-01-20T11:09:27.678930+0000","last_undegraded":"2024-01-20T11:09:27.678930+0000","last_fullsized":"2024-01-20T11:09:27.678930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.705952+0000","last_change":"2024-01-20T11:09:25.668001+0000","last_active":"2024-01-20T11:09:26.705952+0000","last_peered":"2024-01-20T11:09:26.705952+0000","last_clean":"2024-01-20T11:09:26.705952+0000","last_became_active":"2024-01-20T11:09:25.666885+0000","last_became_peered":"2024-01-20T11:09:25.666885+0000","last_unstale":"2024-01-20T11:09:26.705952+0000","last_undegraded":"2024-01-20T11:09:26.705952+0000","last_fullsized":"2024-01-20T11:09:26.705952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:33:39.669648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429983+0000","last_change":"2024-01-20T11:09:26.697162+0000","last_active":"2024-01-20T11:09:28.429983+0000","last_peered":"2024-01-20T11:09:28.429983+0000","last_clean":"2024-01-20T11:09:28.429983+0000","last_became_active":"2024-01-20T11:09:26.696896+0000","last_became_peered":"2024-01-20T11:09:26.696896+0000","last_unstale":"2024-01-20T11:09:28.429983+0000","last_undegraded":"2024-01-20T11:09:28.429983+0000","last_fullsized":"2024-01-20T11:09:28.429983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:13:02.857985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.704804+0000","last_change":"2024-01-20T11:09:25.675465+0000","last_active":"2024-01-20T11:09:26.704804+0000","last_peered":"2024-01-20T11:09:26.704804+0000","last_clean":"2024-01-20T11:09:26.704804+0000","last_became_active":"2024-01-20T11:09:25.675109+0000","last_became_peered":"2024-01-20T11:09:25.675109+0000","last_unstale":"2024-01-20T11:09:26.704804+0000","last_undegraded":"2024-01-20T11:09:26.704804+0000","last_fullsized":"2024-01-20T11:09:26.704804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:27.814229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429038+0000","last_change":"2024-01-20T11:09:26.700874+0000","last_active":"2024-01-20T11:09:28.429038+0000","last_peered":"2024-01-20T11:09:28.429038+0000","last_clean":"2024-01-20T11:09:28.429038+0000","last_became_active":"2024-01-20T11:09:26.700576+0000","last_became_peered":"2024-01-20T11:09:26.700576+0000","last_unstale":"2024-01-20T11:09:28.429038+0000","last_undegraded":"2024-01-20T11:09:28.429038+0000","last_fullsized":"2024-01-20T11:09:28.429038+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T23:04:10.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707269+0000","last_change":"2024-01-20T11:09:25.668050+0000","last_active":"2024-01-20T11:09:26.707269+0000","last_peered":"2024-01-20T11:09:26.707269+0000","last_clean":"2024-01-20T11:09:26.707269+0000","last_became_active":"2024-01-20T11:09:25.667619+0000","last_became_peered":"2024-01-20T11:09:25.667619+0000","last_unstale":"2024-01-20T11:09:26.707269+0000","last_undegraded":"2024-01-20T11:09:26.707269+0000","last_fullsized":"2024-01-20T11:09:26.707269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:18:54.420184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191827+0000","last_change":"2024-01-20T11:09:26.686513+0000","last_active":"2024-01-20T11:09:28.191827+0000","last_peered":"2024-01-20T11:09:28.191827+0000","last_clean":"2024-01-20T11:09:28.191827+0000","last_became_active":"2024-01-20T11:09:26.686105+0000","last_became_peered":"2024-01-20T11:09:26.686105+0000","last_unstale":"2024-01-20T11:09:28.191827+0000","last_undegraded":"2024-01-20T11:09:28.191827+0000","last_fullsized":"2024-01-20T11:09:28.191827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:49.930023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.705873+0000","last_change":"2024-01-20T11:09:25.670665+0000","last_active":"2024-01-20T11:09:26.705873+0000","last_peered":"2024-01-20T11:09:26.705873+0000","last_clean":"2024-01-20T11:09:26.705873+0000","last_became_active":"2024-01-20T11:09:25.668663+0000","last_became_peered":"2024-01-20T11:09:25.668663+0000","last_unstale":"2024-01-20T11:09:26.705873+0000","last_undegraded":"2024-01-20T11:09:26.705873+0000","last_fullsized":"2024-01-20T11:09:26.705873+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:46:18.356782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191548+0000","last_change":"2024-01-20T11:09:26.689081+0000","last_active":"2024-01-20T11:09:28.191548+0000","last_peered":"2024-01-20T11:09:28.191548+0000","last_clean":"2024-01-20T11:09:28.191548+0000","last_became_active":"2024-01-20T11:09:26.683874+0000","last_became_peered":"2024-01-20T11:09:26.683874+0000","last_unstale":"2024-01-20T11:09:28.191548+0000","last_undegraded":"2024-01-20T11:09:28.191548+0000","last_fullsized":"2024-01-20T11:09:28.191548+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:13.179098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.658217+0000","last_change":"2024-01-20T11:09:25.665896+0000","last_active":"2024-01-20T11:09:26.658217+0000","last_peered":"2024-01-20T11:09:26.658217+0000","last_clean":"2024-01-20T11:09:26.658217+0000","last_became_active":"2024-01-20T11:09:25.665634+0000","last_became_peered":"2024-01-20T11:09:25.665634+0000","last_unstale":"2024-01-20T11:09:26.658217+0000","last_undegraded":"2024-01-20T11:09:26.658217+0000","last_fullsized":"2024-01-20T11:09:26.658217+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:48.452000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720142+0000","last_change":"2024-01-20T11:09:26.692166+0000","last_active":"2024-01-20T11:09:27.720142+0000","last_peered":"2024-01-20T11:09:27.720142+0000","last_clean":"2024-01-20T11:09:27.720142+0000","last_became_active":"2024-01-20T11:09:26.691691+0000","last_became_peered":"2024-01-20T11:09:26.691691+0000","last_unstale":"2024-01-20T11:09:27.720142+0000","last_undegraded":"2024-01-20T11:09:27.720142+0000","last_fullsized":"2024-01-20T11:09:27.720142+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:10:42.934886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655288+0000","last_change":"2024-01-20T11:09:25.653806+0000","last_active":"2024-01-20T11:09:26.655288+0000","last_peered":"2024-01-20T11:09:26.655288+0000","last_clean":"2024-01-20T11:09:26.655288+0000","last_became_active":"2024-01-20T11:09:25.653522+0000","last_became_peered":"2024-01-20T11:09:25.653522+0000","last_unstale":"2024-01-20T11:09:26.655288+0000","last_undegraded":"2024-01-20T11:09:26.655288+0000","last_fullsized":"2024-01-20T11:09:26.655288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:55:51.642082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429710+0000","last_change":"2024-01-20T11:09:26.681612+0000","last_active":"2024-01-20T11:09:28.429710+0000","last_peered":"2024-01-20T11:09:28.429710+0000","last_clean":"2024-01-20T11:09:28.429710+0000","last_became_active":"2024-01-20T11:09:26.679392+0000","last_became_peered":"2024-01-20T11:09:26.679392+0000","last_unstale":"2024-01-20T11:09:28.429710+0000","last_undegraded":"2024-01-20T11:09:28.429710+0000","last_fullsized":"2024-01-20T11:09:28.429710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:37.076431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.683513+0000","last_change":"2024-01-20T11:09:25.662752+0000","last_active":"2024-01-20T11:09:26.683513+0000","last_peered":"2024-01-20T11:09:26.683513+0000","last_clean":"2024-01-20T11:09:26.683513+0000","last_became_active":"2024-01-20T11:09:25.660279+0000","last_became_peered":"2024-01-20T11:09:25.660279+0000","last_unstale":"2024-01-20T11:09:26.683513+0000","last_undegraded":"2024-01-20T11:09:26.683513+0000","last_fullsized":"2024-01-20T11:09:26.683513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:56:07.984070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679739+0000","last_change":"2024-01-20T11:09:26.698206+0000","last_active":"2024-01-20T11:09:27.679739+0000","last_peered":"2024-01-20T11:09:27.679739+0000","last_clean":"2024-01-20T11:09:27.679739+0000","last_became_active":"2024-01-20T11:09:26.697932+0000","last_became_peered":"2024-01-20T11:09:26.697932+0000","last_unstale":"2024-01-20T11:09:27.679739+0000","last_undegraded":"2024-01-20T11:09:27.679739+0000","last_fullsized":"2024-01-20T11:09:27.679739+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:25.570747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.658862+0000","last_change":"2024-01-20T11:09:25.667320+0000","last_active":"2024-01-20T11:09:26.658862+0000","last_peered":"2024-01-20T11:09:26.658862+0000","last_clean":"2024-01-20T11:09:26.658862+0000","last_became_active":"2024-01-20T11:09:25.667040+0000","last_became_peered":"2024-01-20T11:09:25.667040+0000","last_unstale":"2024-01-20T11:09:26.658862+0000","last_undegraded":"2024-01-20T11:09:26.658862+0000","last_fullsized":"2024-01-20T11:09:26.658862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:56.671058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431867+0000","last_change":"2024-01-20T11:09:26.684466+0000","last_active":"2024-01-20T11:09:28.431867+0000","last_peered":"2024-01-20T11:09:28.431867+0000","last_clean":"2024-01-20T11:09:28.431867+0000","last_became_active":"2024-01-20T11:09:26.684167+0000","last_became_peered":"2024-01-20T11:09:26.684167+0000","last_unstale":"2024-01-20T11:09:28.431867+0000","last_undegraded":"2024-01-20T11:09:28.431867+0000","last_fullsized":"2024-01-20T11:09:28.431867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:12:58.697408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707590+0000","last_change":"2024-01-20T11:09:25.674319+0000","last_active":"2024-01-20T11:09:26.707590+0000","last_peered":"2024-01-20T11:09:26.707590+0000","last_clean":"2024-01-20T11:09:26.707590+0000","last_became_active":"2024-01-20T11:09:25.674029+0000","last_became_peered":"2024-01-20T11:09:25.674029+0000","last_unstale":"2024-01-20T11:09:26.707590+0000","last_undegraded":"2024-01-20T11:09:26.707590+0000","last_fullsized":"2024-01-20T11:09:26.707590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:52.561712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679055+0000","last_change":"2024-01-20T11:09:26.705707+0000","last_active":"2024-01-20T11:09:27.679055+0000","last_peered":"2024-01-20T11:09:27.679055+0000","last_clean":"2024-01-20T11:09:27.679055+0000","last_became_active":"2024-01-20T11:09:26.705132+0000","last_became_peered":"2024-01-20T11:09:26.705132+0000","last_unstale":"2024-01-20T11:09:27.679055+0000","last_undegraded":"2024-01-20T11:09:27.679055+0000","last_fullsized":"2024-01-20T11:09:27.679055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:32:28.195633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.714184+0000","last_change":"2024-01-20T11:09:25.657996+0000","last_active":"2024-01-20T11:09:26.714184+0000","last_peered":"2024-01-20T11:09:26.714184+0000","last_clean":"2024-01-20T11:09:26.714184+0000","last_became_active":"2024-01-20T11:09:25.657691+0000","last_became_peered":"2024-01-20T11:09:25.657691+0000","last_unstale":"2024-01-20T11:09:26.714184+0000","last_undegraded":"2024-01-20T11:09:26.714184+0000","last_fullsized":"2024-01-20T11:09:26.714184+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:16.297500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720209+0000","last_change":"2024-01-20T11:09:26.678786+0000","last_active":"2024-01-20T11:09:27.720209+0000","last_peered":"2024-01-20T11:09:27.720209+0000","last_clean":"2024-01-20T11:09:27.720209+0000","last_became_active":"2024-01-20T11:09:26.678485+0000","last_became_peered":"2024-01-20T11:09:26.678485+0000","last_unstale":"2024-01-20T11:09:27.720209+0000","last_undegraded":"2024-01-20T11:09:27.720209+0000","last_fullsized":"2024-01-20T11:09:27.720209+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:20:22.030550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707366+0000","last_change":"2024-01-20T11:09:25.659501+0000","last_active":"2024-01-20T11:09:26.707366+0000","last_peered":"2024-01-20T11:09:26.707366+0000","last_clean":"2024-01-20T11:09:26.707366+0000","last_became_active":"2024-01-20T11:09:25.659195+0000","last_became_peered":"2024-01-20T11:09:25.659195+0000","last_unstale":"2024-01-20T11:09:26.707366+0000","last_undegraded":"2024-01-20T11:09:26.707366+0000","last_fullsized":"2024-01-20T11:09:26.707366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:11:12.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192151+0000","last_change":"2024-01-20T11:09:26.697813+0000","last_active":"2024-01-20T11:09:28.192151+0000","last_peered":"2024-01-20T11:09:28.192151+0000","last_clean":"2024-01-20T11:09:28.192151+0000","last_became_active":"2024-01-20T11:09:26.695970+0000","last_became_peered":"2024-01-20T11:09:26.695970+0000","last_unstale":"2024-01-20T11:09:28.192151+0000","last_undegraded":"2024-01-20T11:09:28.192151+0000","last_fullsized":"2024-01-20T11:09:28.192151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:57.604746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.682452+0000","last_change":"2024-01-20T11:09:25.672264+0000","last_active":"2024-01-20T11:09:26.682452+0000","last_peered":"2024-01-20T11:09:26.682452+0000","last_clean":"2024-01-20T11:09:26.682452+0000","last_became_active":"2024-01-20T11:09:25.671493+0000","last_became_peered":"2024-01-20T11:09:25.671493+0000","last_unstale":"2024-01-20T11:09:26.682452+0000","last_undegraded":"2024-01-20T11:09:26.682452+0000","last_fullsized":"2024-01-20T11:09:26.682452+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:59:48.452000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430204+0000","last_change":"2024-01-20T11:09:26.686494+0000","last_active":"2024-01-20T11:09:28.430204+0000","last_peered":"2024-01-20T11:09:28.430204+0000","last_clean":"2024-01-20T11:09:28.430204+0000","last_became_active":"2024-01-20T11:09:26.686013+0000","last_became_peered":"2024-01-20T11:09:26.686013+0000","last_unstale":"2024-01-20T11:09:28.430204+0000","last_undegraded":"2024-01-20T11:09:28.430204+0000","last_fullsized":"2024-01-20T11:09:28.430204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:43:46.695969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.664493+0000","last_change":"2024-01-20T11:09:25.659237+0000","last_active":"2024-01-20T11:09:26.664493+0000","last_peered":"2024-01-20T11:09:26.664493+0000","last_clean":"2024-01-20T11:09:26.664493+0000","last_became_active":"2024-01-20T11:09:25.658993+0000","last_became_peered":"2024-01-20T11:09:25.658993+0000","last_unstale":"2024-01-20T11:09:26.664493+0000","last_undegraded":"2024-01-20T11:09:26.664493+0000","last_fullsized":"2024-01-20T11:09:26.664493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:52:34.016988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.678420+0000","last_change":"2024-01-20T11:09:26.700000+0000","last_active":"2024-01-20T11:09:27.678420+0000","last_peered":"2024-01-20T11:09:27.678420+0000","last_clean":"2024-01-20T11:09:27.678420+0000","last_became_active":"2024-01-20T11:09:26.699728+0000","last_became_peered":"2024-01-20T11:09:26.699728+0000","last_unstale":"2024-01-20T11:09:27.678420+0000","last_undegraded":"2024-01-20T11:09:27.678420+0000","last_fullsized":"2024-01-20T11:09:27.678420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.711587+0000","last_change":"2024-01-20T11:09:25.662705+0000","last_active":"2024-01-20T11:09:26.711587+0000","last_peered":"2024-01-20T11:09:26.711587+0000","last_clean":"2024-01-20T11:09:26.711587+0000","last_became_active":"2024-01-20T11:09:25.662103+0000","last_became_peered":"2024-01-20T11:09:25.662103+0000","last_unstale":"2024-01-20T11:09:26.711587+0000","last_undegraded":"2024-01-20T11:09:26.711587+0000","last_fullsized":"2024-01-20T11:09:26.711587+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:21.987470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677731+0000","last_change":"2024-01-20T11:09:26.684940+0000","last_active":"2024-01-20T11:09:27.677731+0000","last_peered":"2024-01-20T11:09:27.677731+0000","last_clean":"2024-01-20T11:09:27.677731+0000","last_became_active":"2024-01-20T11:09:26.684642+0000","last_became_peered":"2024-01-20T11:09:26.684642+0000","last_unstale":"2024-01-20T11:09:27.677731+0000","last_undegraded":"2024-01-20T11:09:27.677731+0000","last_fullsized":"2024-01-20T11:09:27.677731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:38.197779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707085+0000","last_change":"2024-01-20T11:09:25.660178+0000","last_active":"2024-01-20T11:09:26.707085+0000","last_peered":"2024-01-20T11:09:26.707085+0000","last_clean":"2024-01-20T11:09:26.707085+0000","last_became_active":"2024-01-20T11:09:25.659658+0000","last_became_peered":"2024-01-20T11:09:25.659658+0000","last_unstale":"2024-01-20T11:09:26.707085+0000","last_undegraded":"2024-01-20T11:09:26.707085+0000","last_fullsized":"2024-01-20T11:09:26.707085+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:49:45.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192778+0000","last_change":"2024-01-20T11:09:26.684848+0000","last_active":"2024-01-20T11:09:28.192778+0000","last_peered":"2024-01-20T11:09:28.192778+0000","last_clean":"2024-01-20T11:09:28.192778+0000","last_became_active":"2024-01-20T11:09:26.682804+0000","last_became_peered":"2024-01-20T11:09:26.682804+0000","last_unstale":"2024-01-20T11:09:28.192778+0000","last_undegraded":"2024-01-20T11:09:28.192778+0000","last_fullsized":"2024-01-20T11:09:28.192778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:25.570747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.701168+0000","last_change":"2024-01-20T11:09:25.661453+0000","last_active":"2024-01-20T11:09:26.701168+0000","last_peered":"2024-01-20T11:09:26.701168+0000","last_clean":"2024-01-20T11:09:26.701168+0000","last_became_active":"2024-01-20T11:09:25.660834+0000","last_became_peered":"2024-01-20T11:09:25.660834+0000","last_unstale":"2024-01-20T11:09:26.701168+0000","last_undegraded":"2024-01-20T11:09:26.701168+0000","last_fullsized":"2024-01-20T11:09:26.701168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:10.081431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720680+0000","last_change":"2024-01-20T11:09:26.679749+0000","last_active":"2024-01-20T11:09:27.720680+0000","last_peered":"2024-01-20T11:09:27.720680+0000","last_clean":"2024-01-20T11:09:27.720680+0000","last_became_active":"2024-01-20T11:09:26.679362+0000","last_became_peered":"2024-01-20T11:09:26.679362+0000","last_unstale":"2024-01-20T11:09:27.720680+0000","last_undegraded":"2024-01-20T11:09:27.720680+0000","last_fullsized":"2024-01-20T11:09:27.720680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:02:22.740219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.704508+0000","last_change":"2024-01-20T11:09:25.664841+0000","last_active":"2024-01-20T11:09:26.704508+0000","last_peered":"2024-01-20T11:09:26.704508+0000","last_clean":"2024-01-20T11:09:26.704508+0000","last_became_active":"2024-01-20T11:09:25.664637+0000","last_became_peered":"2024-01-20T11:09:25.664637+0000","last_unstale":"2024-01-20T11:09:26.704508+0000","last_undegraded":"2024-01-20T11:09:26.704508+0000","last_fullsized":"2024-01-20T11:09:26.704508+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.538731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720709+0000","last_change":"2024-01-20T11:09:26.684239+0000","last_active":"2024-01-20T11:09:27.720709+0000","last_peered":"2024-01-20T11:09:27.720709+0000","last_clean":"2024-01-20T11:09:27.720709+0000","last_became_active":"2024-01-20T11:09:26.683937+0000","last_became_peered":"2024-01-20T11:09:26.683937+0000","last_unstale":"2024-01-20T11:09:27.720709+0000","last_undegraded":"2024-01-20T11:09:27.720709+0000","last_fullsized":"2024-01-20T11:09:27.720709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:08:57.759826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.666904+0000","last_change":"2024-01-20T11:09:25.668814+0000","last_active":"2024-01-20T11:09:26.666904+0000","last_peered":"2024-01-20T11:09:26.666904+0000","last_clean":"2024-01-20T11:09:26.666904+0000","last_became_active":"2024-01-20T11:09:25.668549+0000","last_became_peered":"2024-01-20T11:09:25.668549+0000","last_unstale":"2024-01-20T11:09:26.666904+0000","last_undegraded":"2024-01-20T11:09:26.666904+0000","last_fullsized":"2024-01-20T11:09:26.666904+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:34:35.174326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.430905+0000","last_change":"2024-01-20T11:09:26.684150+0000","last_active":"2024-01-20T11:09:28.430905+0000","last_peered":"2024-01-20T11:09:28.430905+0000","last_clean":"2024-01-20T11:09:28.430905+0000","last_became_active":"2024-01-20T11:09:26.683497+0000","last_became_peered":"2024-01-20T11:09:26.683497+0000","last_unstale":"2024-01-20T11:09:28.430905+0000","last_undegraded":"2024-01-20T11:09:28.430905+0000","last_fullsized":"2024-01-20T11:09:28.430905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:30.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.707341+0000","last_change":"2024-01-20T11:09:25.664399+0000","last_active":"2024-01-20T11:09:26.707341+0000","last_peered":"2024-01-20T11:09:26.707341+0000","last_clean":"2024-01-20T11:09:26.707341+0000","last_became_active":"2024-01-20T11:09:25.664143+0000","last_became_peered":"2024-01-20T11:09:25.664143+0000","last_unstale":"2024-01-20T11:09:26.707341+0000","last_undegraded":"2024-01-20T11:09:26.707341+0000","last_fullsized":"2024-01-20T11:09:26.707341+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:32:27.814229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429516+0000","last_change":"2024-01-20T11:09:26.687665+0000","last_active":"2024-01-20T11:09:28.429516+0000","last_peered":"2024-01-20T11:09:28.429516+0000","last_clean":"2024-01-20T11:09:28.429516+0000","last_became_active":"2024-01-20T11:09:26.687432+0000","last_became_peered":"2024-01-20T11:09:26.687432+0000","last_unstale":"2024-01-20T11:09:28.429516+0000","last_undegraded":"2024-01-20T11:09:28.429516+0000","last_fullsized":"2024-01-20T11:09:28.429516+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:51:53.803211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.657988+0000","last_change":"2024-01-20T11:09:25.673499+0000","last_active":"2024-01-20T11:09:26.657988+0000","last_peered":"2024-01-20T11:09:26.657988+0000","last_clean":"2024-01-20T11:09:26.657988+0000","last_became_active":"2024-01-20T11:09:25.673220+0000","last_became_peered":"2024-01-20T11:09:25.673220+0000","last_unstale":"2024-01-20T11:09:26.657988+0000","last_undegraded":"2024-01-20T11:09:26.657988+0000","last_fullsized":"2024-01-20T11:09:26.657988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:04:47.700216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.676887+0000","last_change":"2024-01-20T11:09:26.691210+0000","last_active":"2024-01-20T11:09:27.676887+0000","last_peered":"2024-01-20T11:09:27.676887+0000","last_clean":"2024-01-20T11:09:27.676887+0000","last_became_active":"2024-01-20T11:09:26.690903+0000","last_became_peered":"2024-01-20T11:09:26.690903+0000","last_unstale":"2024-01-20T11:09:27.676887+0000","last_undegraded":"2024-01-20T11:09:27.676887+0000","last_fullsized":"2024-01-20T11:09:27.676887+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:58:56.722085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655609+0000","last_change":"2024-01-20T11:09:25.661232+0000","last_active":"2024-01-20T11:09:26.655609+0000","last_peered":"2024-01-20T11:09:26.655609+0000","last_clean":"2024-01-20T11:09:26.655609+0000","last_became_active":"2024-01-20T11:09:25.660942+0000","last_became_peered":"2024-01-20T11:09:25.660942+0000","last_unstale":"2024-01-20T11:09:26.655609+0000","last_undegraded":"2024-01-20T11:09:26.655609+0000","last_fullsized":"2024-01-20T11:09:26.655609+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:32.999975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.191448+0000","last_change":"2024-01-20T11:09:26.684507+0000","last_active":"2024-01-20T11:09:28.191448+0000","last_peered":"2024-01-20T11:09:28.191448+0000","last_clean":"2024-01-20T11:09:28.191448+0000","last_became_active":"2024-01-20T11:09:26.684201+0000","last_became_peered":"2024-01-20T11:09:26.684201+0000","last_unstale":"2024-01-20T11:09:28.191448+0000","last_undegraded":"2024-01-20T11:09:28.191448+0000","last_fullsized":"2024-01-20T11:09:28.191448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:40:39.955372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.678786+0000","last_change":"2024-01-20T11:09:25.673119+0000","last_active":"2024-01-20T11:09:26.678786+0000","last_peered":"2024-01-20T11:09:26.678786+0000","last_clean":"2024-01-20T11:09:26.678786+0000","last_became_active":"2024-01-20T11:09:25.672661+0000","last_became_peered":"2024-01-20T11:09:25.672661+0000","last_unstale":"2024-01-20T11:09:26.678786+0000","last_undegraded":"2024-01-20T11:09:26.678786+0000","last_fullsized":"2024-01-20T11:09:26.678786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.538731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.720789+0000","last_change":"2024-01-20T11:09:26.684444+0000","last_active":"2024-01-20T11:09:27.720789+0000","last_peered":"2024-01-20T11:09:27.720789+0000","last_clean":"2024-01-20T11:09:27.720789+0000","last_became_active":"2024-01-20T11:09:26.684134+0000","last_became_peered":"2024-01-20T11:09:26.684134+0000","last_unstale":"2024-01-20T11:09:27.720789+0000","last_undegraded":"2024-01-20T11:09:27.720789+0000","last_fullsized":"2024-01-20T11:09:27.720789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:14.552443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431967+0000","last_change":"2024-01-20T11:09:25.670430+0000","last_active":"2024-01-20T11:09:28.431967+0000","last_peered":"2024-01-20T11:09:28.431967+0000","last_clean":"2024-01-20T11:09:28.431967+0000","last_became_active":"2024-01-20T11:09:25.670202+0000","last_became_peered":"2024-01-20T11:09:25.670202+0000","last_unstale":"2024-01-20T11:09:28.431967+0000","last_undegraded":"2024-01-20T11:09:28.431967+0000","last_fullsized":"2024-01-20T11:09:28.431967+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:40:38.941660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192165+0000","last_change":"2024-01-20T11:09:26.684054+0000","last_active":"2024-01-20T11:09:28.192165+0000","last_peered":"2024-01-20T11:09:28.192165+0000","last_clean":"2024-01-20T11:09:28.192165+0000","last_became_active":"2024-01-20T11:09:26.683673+0000","last_became_peered":"2024-01-20T11:09:26.683673+0000","last_unstale":"2024-01-20T11:09:28.192165+0000","last_undegraded":"2024-01-20T11:09:28.192165+0000","last_fullsized":"2024-01-20T11:09:28.192165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:11:38.285779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.685235+0000","last_change":"2024-01-20T11:09:25.674337+0000","last_active":"2024-01-20T11:09:26.685235+0000","last_peered":"2024-01-20T11:09:26.685235+0000","last_clean":"2024-01-20T11:09:26.685235+0000","last_became_active":"2024-01-20T11:09:25.674049+0000","last_became_peered":"2024-01-20T11:09:25.674049+0000","last_unstale":"2024-01-20T11:09:26.685235+0000","last_undegraded":"2024-01-20T11:09:26.685235+0000","last_fullsized":"2024-01-20T11:09:26.685235+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:52:34.016988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.679217+0000","last_change":"2024-01-20T11:09:26.696903+0000","last_active":"2024-01-20T11:09:27.679217+0000","last_peered":"2024-01-20T11:09:27.679217+0000","last_clean":"2024-01-20T11:09:27.679217+0000","last_became_active":"2024-01-20T11:09:26.696637+0000","last_became_peered":"2024-01-20T11:09:26.696637+0000","last_unstale":"2024-01-20T11:09:27.679217+0000","last_undegraded":"2024-01-20T11:09:27.679217+0000","last_fullsized":"2024-01-20T11:09:27.679217+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:24:12.697565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.680340+0000","last_change":"2024-01-20T11:09:25.666513+0000","last_active":"2024-01-20T11:09:26.680340+0000","last_peered":"2024-01-20T11:09:26.680340+0000","last_clean":"2024-01-20T11:09:26.680340+0000","last_became_active":"2024-01-20T11:09:25.666244+0000","last_became_peered":"2024-01-20T11:09:25.666244+0000","last_unstale":"2024-01-20T11:09:26.680340+0000","last_undegraded":"2024-01-20T11:09:26.680340+0000","last_fullsized":"2024-01-20T11:09:26.680340+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:56:07.984070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431152+0000","last_change":"2024-01-20T11:09:26.680250+0000","last_active":"2024-01-20T11:09:28.431152+0000","last_peered":"2024-01-20T11:09:28.431152+0000","last_clean":"2024-01-20T11:09:28.431152+0000","last_became_active":"2024-01-20T11:09:26.679033+0000","last_became_peered":"2024-01-20T11:09:26.679033+0000","last_unstale":"2024-01-20T11:09:28.431152+0000","last_undegraded":"2024-01-20T11:09:28.431152+0000","last_fullsized":"2024-01-20T11:09:28.431152+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T21:36:27.314299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.686667+0000","last_change":"2024-01-20T11:09:25.674417+0000","last_active":"2024-01-20T11:09:26.686667+0000","last_peered":"2024-01-20T11:09:26.686667+0000","last_clean":"2024-01-20T11:09:26.686667+0000","last_became_active":"2024-01-20T11:09:25.673890+0000","last_became_peered":"2024-01-20T11:09:25.673890+0000","last_unstale":"2024-01-20T11:09:26.686667+0000","last_undegraded":"2024-01-20T11:09:26.686667+0000","last_fullsized":"2024-01-20T11:09:26.686667+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:18:54.420184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.431161+0000","last_change":"2024-01-20T11:09:26.689141+0000","last_active":"2024-01-20T11:09:28.431161+0000","last_peered":"2024-01-20T11:09:28.431161+0000","last_clean":"2024-01-20T11:09:28.431161+0000","last_became_active":"2024-01-20T11:09:26.687219+0000","last_became_peered":"2024-01-20T11:09:26.687219+0000","last_unstale":"2024-01-20T11:09:28.431161+0000","last_undegraded":"2024-01-20T11:09:28.431161+0000","last_fullsized":"2024-01-20T11:09:28.431161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:06.885960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.683013+0000","last_change":"2024-01-20T11:09:25.662705+0000","last_active":"2024-01-20T11:09:26.683013+0000","last_peered":"2024-01-20T11:09:26.683013+0000","last_clean":"2024-01-20T11:09:26.683013+0000","last_became_active":"2024-01-20T11:09:25.662444+0000","last_became_peered":"2024-01-20T11:09:25.662444+0000","last_unstale":"2024-01-20T11:09:26.683013+0000","last_undegraded":"2024-01-20T11:09:26.683013+0000","last_fullsized":"2024-01-20T11:09:26.683013+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:21:06.514985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677505+0000","last_change":"2024-01-20T11:09:26.698689+0000","last_active":"2024-01-20T11:09:27.677505+0000","last_peered":"2024-01-20T11:09:27.677505+0000","last_clean":"2024-01-20T11:09:27.677505+0000","last_became_active":"2024-01-20T11:09:26.698392+0000","last_became_peered":"2024-01-20T11:09:26.698392+0000","last_unstale":"2024-01-20T11:09:27.677505+0000","last_undegraded":"2024-01-20T11:09:27.677505+0000","last_fullsized":"2024-01-20T11:09:27.677505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:28:49.930023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.680077+0000","last_change":"2024-01-20T11:09:25.669178+0000","last_active":"2024-01-20T11:09:26.680077+0000","last_peered":"2024-01-20T11:09:26.680077+0000","last_clean":"2024-01-20T11:09:26.680077+0000","last_became_active":"2024-01-20T11:09:25.668816+0000","last_became_peered":"2024-01-20T11:09:25.668816+0000","last_unstale":"2024-01-20T11:09:26.680077+0000","last_undegraded":"2024-01-20T11:09:26.680077+0000","last_fullsized":"2024-01-20T11:09:26.680077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:21:06.514985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.429031+0000","last_change":"2024-01-20T11:09:26.680872+0000","last_active":"2024-01-20T11:09:28.429031+0000","last_peered":"2024-01-20T11:09:28.429031+0000","last_clean":"2024-01-20T11:09:28.429031+0000","last_became_active":"2024-01-20T11:09:26.680017+0000","last_became_peered":"2024-01-20T11:09:26.680017+0000","last_unstale":"2024-01-20T11:09:28.429031+0000","last_undegraded":"2024-01-20T11:09:28.429031+0000","last_fullsized":"2024-01-20T11:09:28.429031+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:50:44.925247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.655653+0000","last_change":"2024-01-20T11:09:25.662421+0000","last_active":"2024-01-20T11:09:26.655653+0000","last_peered":"2024-01-20T11:09:26.655653+0000","last_clean":"2024-01-20T11:09:26.655653+0000","last_became_active":"2024-01-20T11:09:25.661713+0000","last_became_peered":"2024-01-20T11:09:25.661713+0000","last_unstale":"2024-01-20T11:09:26.655653+0000","last_undegraded":"2024-01-20T11:09:26.655653+0000","last_fullsized":"2024-01-20T11:09:26.655653+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:55:05.992860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:28.192700+0000","last_change":"2024-01-20T11:09:26.696785+0000","last_active":"2024-01-20T11:09:28.192700+0000","last_peered":"2024-01-20T11:09:28.192700+0000","last_clean":"2024-01-20T11:09:28.192700+0000","last_became_active":"2024-01-20T11:09:26.696524+0000","last_became_peered":"2024-01-20T11:09:26.696524+0000","last_unstale":"2024-01-20T11:09:28.192700+0000","last_undegraded":"2024-01-20T11:09:28.192700+0000","last_fullsized":"2024-01-20T11:09:28.192700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:25.626088+0000","last_clean_scrub_stamp":"2024-01-20T11:09:25.626088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:05.315505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-20T11:09:26.706883+0000","last_change":"2024-01-20T11:09:25.666038+0000","last_active":"2024-01-20T11:09:26.706883+0000","last_peered":"2024-01-20T11:09:26.706883+0000","last_clean":"2024-01-20T11:09:26.706883+0000","last_became_active":"2024-01-20T11:09:25.663508+0000","last_became_peered":"2024-01-20T11:09:25.663508+0000","last_unstale":"2024-01-20T11:09:26.706883+0000","last_undegraded":"2024-01-20T11:09:26.706883+0000","last_fullsized":"2024-01-20T11:09:26.706883+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:09:24.612377+0000","last_clean_scrub_stamp":"2024-01-20T11:09:24.612377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:52.561712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-01-20T11:09:27.677775+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:09:27.677775+0000","last_peered":"2024-01-20T11:09:27.677775+0000","last_clean":"2024-01-20T11:09:27.677775+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:09:27.677775+0000","last_undegraded":"2024-01-20T11:09:27.677775+0000","last_fullsized":"2024-01-20T11:09:27.677775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":813375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":1.143},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.385}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.4690000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.2130000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.181},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.0589999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.258},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.1020000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.329},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.587}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.667},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.92900000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":223589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.296,"5min":3.343,"15min":3.343},"last":1.508},{"interface":"front","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6830000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.216,"15min":1.2410000000000001},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.675,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.149},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4710000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2450000000000001,"15min":1.248},"min":{"1min":0.85699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.514,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.349},{"interface":"front","average":{"1min":1.226,"5min":1.294,"15min":1.3049999999999999},"min":{"1min":0.82299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.694,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.284,"15min":1.2929999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.609,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.4690000000000001,"15min":1.488},"min":{"1min":1.0700000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.708,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.603}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.4419999999999999},"min":{"1min":0.88600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.6399999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.355,"15min":1.3560000000000001},"min":{"1min":0.88100000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.768,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.5620000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5309999999999999,"15min":1.542},"min":{"1min":1.1180000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9099999999999999,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.5369999999999999,"15min":1.5509999999999999},"min":{"1min":0.94399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9370000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.665}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":1.034,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.853,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.417},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.673,"15min":1.6910000000000001},"min":{"1min":1.0680000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9950000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.454}]}]},{"osd":5,"up_from":14,"seq":60129542175,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":222987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1220000000000001,"15min":1.1180000000000001},"min":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.597}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.117,"15min":1.121},"min":{"1min":0.78200000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7130000000000001,"5min":1.845,"15min":1.845},"last":1.167},{"interface":"front","average":{"1min":1.177,"5min":1.129,"15min":1.121},"min":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.607,"5min":1.968,"15min":1.968},"last":1.4990000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.4850000000000001,"5min":1.544,"15min":1.544},"last":1.268},{"interface":"front","average":{"1min":1.371,"5min":1.202,"15min":1.1739999999999999},"min":{"1min":0.91600000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.069}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2689999999999999,"15min":1.2669999999999999},"min":{"1min":0.86699999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.81599999999999995,"5min":0.748,"15min":0.748},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.637}]},{"osd":4,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.363},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4710000000000001,"15min":1.4750000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8129999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.52,"15min":1.5169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.552},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.405,"15min":1.3899999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.968,"5min":2.069,"15min":2.069},"last":1.238}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5640000000000001,"15min":1.577},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8149999999999999,"5min":1.956,"15min":1.956},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6359999999999999,"15min":1.6339999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.089,"5min":2.105,"15min":2.105},"last":1.462}]}]},{"osd":4,"up_from":14,"seq":60129542173,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":561152,"data_stored":224529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.115,"15min":1.103},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.403}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.125,"15min":1.1259999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5249999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.21,"15min":1.216},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.704,"5min":1.954,"15min":1.954},"last":0.85199999999999998}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1679999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.1679999999999999,"15min":1.1599999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":1.853,"15min":1.853},"last":1.1359999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.516,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.234},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3300000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.617,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.206}]},{"osd":5,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3580000000000001,"15min":1.3540000000000001},"min":{"1min":0.89200000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.839,"5min":2.681,"15min":2.681},"last":1.589}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.9119999999999999,"5min":2.968,"15min":2.968},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.472,"15min":1.458},"min":{"1min":0.88900000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.0510000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.6220000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7490000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.5209999999999999,"15min":1.522},"min":{"1min":0.876,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.853,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.5489999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":223555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.68300000000000005}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.501},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.71799999999999997}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":1.085},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.0289999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.95199999999999996}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.262},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.89100000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":224551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92600000000000005,"15min":0.85199999999999998},"min":{"1min":0.622,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":9.8870000000000005,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":1.101},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.1080000000000001,"15min":1.05},"min":{"1min":0.66900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.026,"5min":10.026,"15min":10.026},"last":0.75}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.137,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.2090000000000001,"15min":1.129},"min":{"1min":0.66600000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.21,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":11.414999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.4359999999999999,"15min":1.367},"min":{"1min":0.95399999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":10.919,"5min":10.919,"15min":10.919},"last":1.0309999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.4990000000000001,"15min":1.4350000000000001},"min":{"1min":1.073,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":11.1,"5min":11.1,"15min":11.1},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.996,"5min":1.54,"15min":1.464},"min":{"1min":0.89600000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":11.141999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":1.331}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.4199999999999999,"15min":1.3799999999999999},"min":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":10.077999999999999,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.071},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.401,"15min":1.3899999999999999},"min":{"1min":1.0920000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.51}]},{"osd":6,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.6499999999999999,"15min":1.5760000000000001},"min":{"1min":1.22,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":11.185,"5min":11.185,"15min":11.185},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.845,"5min":1.536,"15min":1.484},"min":{"1min":1.008,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":1.3720000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.52,"15min":1.4670000000000001},"min":{"1min":0.96999999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":10.234999999999999,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.512,"15min":1.4379999999999999},"min":{"1min":1.2549999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":9.843,"5min":9.843,"15min":9.843},"last":1.4139999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":222987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.0549999999999999,"15min":1.01},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":12.061,"5min":12.061,"15min":12.061},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1739999999999999,"15min":1.165},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.04,"15min":1.054},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.3929999999999998,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.889,"5min":1.3520000000000001,"15min":1.262},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.204999999999998,"5min":20.204999999999998,"15min":20.204999999999998},"last":0.80900000000000005}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.278,"15min":1.232},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":11.978999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":1.141}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.325,"15min":1.3540000000000001},"min":{"1min":0.77900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6839999999999999,"5min":5.21,"15min":5.21},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.528,"15min":1.46},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":15.596,"5min":15.596,"15min":15.596},"last":1.0329999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.5740000000000001,"15min":1.5649999999999999},"min":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.345},{"interface":"front","average":{"1min":1.296,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.966,"5min":5.242,"15min":5.242},"last":1.0589999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.6040000000000001,"15min":1.5900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":10.784000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.423,"15min":1.4470000000000001},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.931,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.1919999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.601,"15min":1.5569999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.7150000000000001,"15min":1.6990000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":10.869999999999999,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.302}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":813319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.113,"5min":0.91000000000000003,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.1109999999999998,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.90400000000000003,"15min":0.85999999999999999},"min":{"1min":0.48999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.976,"5min":5.976,"15min":5.976},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.03,"15min":1.006},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":0.623},{"interface":"front","average":{"1min":1.29,"5min":1.042,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.2110000000000003,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.2450000000000001,"15min":1.2110000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.2640000000000002,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.347,"5min":1.25,"15min":1.234},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.077},{"interface":"front","average":{"1min":1.51,"5min":1.25,"15min":1.206},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":0.878}]},{"osd":6,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.2949999999999999,"15min":1.2749999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3899999999999999,"15min":1.3620000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5629999999999997,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.337,"15min":1.296},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":6.1660000000000004,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:09:36.619 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T11:09:36.619 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-20T11:09:36.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.877+0000 7f2cd4e00640 1 Processor -- start 2024-01-20T11:09:36.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.878+0000 7f2cd4e00640 1 -- start start 2024-01-20T11:09:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2cd4e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2cd00cefe0 0x7f2cd00cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2cd4e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd0165690 0x7f2cd0165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2cd4e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd00b3560 con 0x7f2cd0161b80 2024-01-20T11:09:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2cd4e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd0161f60 con 0x7f2cd00cefe0 2024-01-20T11:09:36.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2cd4e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0072830 con 0x7f2cd0165690 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2ccd400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2cd00cefe0 0x7f2cd00cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2ccd400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2cd00cefe0 0x7f2cd00cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57234/0 (socket says 172.21.15.162:57234) 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2ccd400640 1 -- 172.21.15.162:0/3370380234 learned_addr learned my addr 172.21.15.162:0/3370380234 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2cce800640 1 --2- 172.21.15.162:0/3370380234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd0165690 0x7f2cd0165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2ccd400640 1 -- 172.21.15.162:0/3370380234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd0165690 msgr2=0x7f2cd0165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.880+0000 7f2ccd400640 1 --2- 172.21.15.162:0/3370380234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd0165690 0x7f2cd0165aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.881+0000 7f2ccd400640 1 -- 172.21.15.162:0/3370380234 >> v1:172.21.15.179:6789/0 conn(0x7f2cd0161b80 legacy=0x7f2cd0071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:36.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.881+0000 7f2ccd400640 1 -- 172.21.15.162:0/3370380234 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00b3de0 con 0x7f2cd00cefe0 2024-01-20T11:09:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.882+0000 7f2ccd400640 1 --2- 172.21.15.162:0/3370380234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd00cefe0 0x7f2cd00cf470 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009870 tx=0x7f2cb802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922aeefa38b5a563 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:36.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.882+0000 7f2ccca00640 1 -- 172.21.15.162:0/3370380234 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80317c0 con 0x7f2cd00cefe0 2024-01-20T11:09:36.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.882+0000 7f2ccca00640 1 -- 172.21.15.162:0/3370380234 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb8031920 con 0x7f2cd00cefe0 2024-01-20T11:09:36.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.882+0000 7f2ccca00640 1 -- 172.21.15.162:0/3370380234 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8031cb0 con 0x7f2cd00cefe0 2024-01-20T11:09:36.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 -- 172.21.15.162:0/3370380234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd00cefe0 msgr2=0x7f2cd00cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/3370380234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd00cefe0 0x7f2cd00cf470 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009870 tx=0x7f2cb802b860 comp rx=0 tx=0).stop 2024-01-20T11:09:36.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 -- 172.21.15.162:0/3370380234 shutdown_connections 2024-01-20T11:09:36.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/3370380234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd0165690 0x7f2cd0165aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/3370380234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd00cefe0 0x7f2cd00cf470 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 -- 172.21.15.162:0/3370380234 >> 172.21.15.162:0/3370380234 conn(0x7f2cd006a600 msgr2=0x7f2cd006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:36.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 -- 172.21.15.162:0/3370380234 shutdown_connections 2024-01-20T11:09:36.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.883+0000 7f2cd4e00640 1 -- 172.21.15.162:0/3370380234 wait complete. 2024-01-20T11:09:36.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.885+0000 7f2cd4e00640 1 Processor -- start 2024-01-20T11:09:36.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.885+0000 7f2cd4e00640 1 -- start start 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2cd4e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00cefe0 0x7f2cd01f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2cd4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd0161b80 0x7f2cd015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2cd4e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd0165690 0x7f2cd015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2cd4e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00a8930 con 0x7f2cd0161b80 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2cd4e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd015f010 con 0x7f2cd0165690 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2cd4e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd015ea50 con 0x7f2cd00cefe0 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2ccd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd0161b80 0x7f2cd015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2ccd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd0161b80 0x7f2cd015dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57246/0 (socket says 172.21.15.162:57246) 2024-01-20T11:09:36.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.886+0000 7f2ccd400640 1 -- 172.21.15.162:0/215085581 learned_addr learned my addr 172.21.15.162:0/215085581 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:36.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2cce800640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd0165690 0x7f2cd015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2ccde00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00cefe0 0x7f2cd01f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2ccd400640 1 -- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00cefe0 msgr2=0x7f2cd01f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2ccd400640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00cefe0 0x7f2cd01f6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2ccd400640 1 -- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd0165690 msgr2=0x7f2cd015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2ccd400640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd0165690 0x7f2cd015f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2ccd400640 1 -- 172.21.15.162:0/215085581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80094d0 con 0x7f2cd0161b80 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2ccd400640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd0161b80 0x7f2cd015dfb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8000c00 tx=0x7f2cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.887+0000 7f2cc6000640 1 -- 172.21.15.162:0/215085581 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8032860 con 0x7f2cd0161b80 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.888+0000 7f2cc6000640 1 -- 172.21.15.162:0/215085581 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb80329c0 con 0x7f2cd0161b80 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.888+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd015ed30 con 0x7f2cd0161b80 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.888+0000 7f2cc6000640 1 -- 172.21.15.162:0/215085581 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8032d70 con 0x7f2cd0161b80 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.888+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd01515b0 con 0x7f2cd0161b80 2024-01-20T11:09:36.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.889+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd004e970 con 0x7f2cd0161b80 2024-01-20T11:09:36.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.890+0000 7f2cc6000640 1 -- 172.21.15.162:0/215085581 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2cb804d3f0 con 0x7f2cd0161b80 2024-01-20T11:09:36.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.890+0000 7f2cc6000640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ca806aed0 0x7f2ca806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:36.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.891+0000 7f2cc6000640 1 -- 172.21.15.162:0/215085581 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cb80ab510 con 0x7f2cd0161b80 2024-01-20T11:09:36.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.891+0000 7f2ccde00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ca806aed0 0x7f2ca806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:36.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.892+0000 7f2ccde00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ca806aed0 0x7f2ca806d390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0003d90 tx=0x7f2cc0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:36.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:36.895+0000 7f2cc6000640 1 -- 172.21.15.162:0/215085581 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2cb8076340 con 0x7f2cd0161b80 2024-01-20T11:09:37.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.161+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2cd00ce100 con 0x7f2cd0161b80 2024-01-20T11:09:37.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.166+0000 7f2cc6000640 1 -- 172.21.15.162:0/215085581 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2cb8079960 con 0x7f2cd0161b80 2024-01-20T11:09:37.167 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-01-20T11:09:37.167 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA3qatljGIeOBAAZAh1ameerRU000krb9bN6g== 2024-01-20T11:09:37.167 INFO:teuthology.orchestra.run.smithi162.stdout: caps mds = "allow" 2024-01-20T11:09:37.167 INFO:teuthology.orchestra.run.smithi162.stdout: caps mon = "allow r" 2024-01-20T11:09:37.167 INFO:teuthology.orchestra.run.smithi162.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-20T11:09:37.167 INFO:teuthology.orchestra.run.smithi162.stderr:updated caps for client.0 2024-01-20T11:09:37.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ca806aed0 msgr2=0x7f2ca806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:37.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ca806aed0 0x7f2ca806d390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0003d90 tx=0x7f2cc0009040 comp rx=0 tx=0).stop 2024-01-20T11:09:37.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd0161b80 msgr2=0x7f2cd015dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:37.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd0161b80 0x7f2cd015dfb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8000c00 tx=0x7f2cb80046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 shutdown_connections 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f2ca806aed0 0x7f2ca806d390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd0165690 0x7f2cd015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd0161b80 0x7f2cd015dfb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 --2- 172.21.15.162:0/215085581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00cefe0 0x7f2cd01f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 >> 172.21.15.162:0/215085581 conn(0x7f2cd006a600 msgr2=0x7f2cd01644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 shutdown_connections 2024-01-20T11:09:37.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.171+0000 7f2cd4e00640 1 -- 172.21.15.162:0/215085581 wait complete. 2024-01-20T11:09:37.191 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:37.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.406+0000 7f4886c00640 1 Processor -- start 2024-01-20T11:09:37.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.406+0000 7f4886c00640 1 -- start start 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4886c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f488015a530 0x7f48800cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4886c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f488006deb0 0x7f48800716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4886c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488015a910 con 0x7f4880071260 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4886c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48800ca390 con 0x7f488006deb0 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4886c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4880072960 con 0x7f488015a530 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4884c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f488006deb0 0x7f48800716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4884c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f488006deb0 0x7f48800716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57248/0 (socket says 172.21.15.162:57248) 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4884c00640 1 -- 172.21.15.162:0/3948375963 learned_addr learned my addr 172.21.15.162:0/3948375963 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f487fe00640 1 --2- 172.21.15.162:0/3948375963 >> v2:172.21.15.179:3300/0 conn(0x7f488015a530 0x7f48800cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:37.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4884c00640 1 -- 172.21.15.162:0/3948375963 >> v2:172.21.15.179:3300/0 conn(0x7f488015a530 msgr2=0x7f48800cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:37.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4884c00640 1 --2- 172.21.15.162:0/3948375963 >> v2:172.21.15.179:3300/0 conn(0x7f488015a530 0x7f48800cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4884c00640 1 -- 172.21.15.162:0/3948375963 >> v1:172.21.15.179:6789/0 conn(0x7f4880071260 legacy=0x7f488006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:37.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.408+0000 7f4884c00640 1 -- 172.21.15.162:0/3948375963 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800ce730 con 0x7f488006deb0 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.410+0000 7f4884c00640 1 --2- 172.21.15.162:0/3948375963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f48800716d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4878009e50 tx=0x7f487802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c0fceb1f35b6f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.410+0000 7f487ea00640 1 -- 172.21.15.162:0/3948375963 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487802c9f0 con 0x7f488006deb0 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.410+0000 7f487ea00640 1 -- 172.21.15.162:0/3948375963 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487802cb50 con 0x7f488006deb0 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.410+0000 7f487ea00640 1 -- 172.21.15.162:0/3948375963 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780343f0 con 0x7f488006deb0 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.410+0000 7f4886c00640 1 -- 172.21.15.162:0/3948375963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 msgr2=0x7f48800716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.410+0000 7f4886c00640 1 --2- 172.21.15.162:0/3948375963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f48800716d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4878009e50 tx=0x7f487802be50 comp rx=0 tx=0).stop 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.411+0000 7f4886c00640 1 -- 172.21.15.162:0/3948375963 shutdown_connections 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.411+0000 7f4886c00640 1 --2- 172.21.15.162:0/3948375963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f48800716d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.411+0000 7f4886c00640 1 --2- 172.21.15.162:0/3948375963 >> v2:172.21.15.179:3300/0 conn(0x7f488015a530 0x7f48800cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.411+0000 7f4886c00640 1 -- 172.21.15.162:0/3948375963 >> 172.21.15.162:0/3948375963 conn(0x7f48800b0cd0 msgr2=0x7f48800b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.411+0000 7f4886c00640 1 -- 172.21.15.162:0/3948375963 shutdown_connections 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.411+0000 7f4886c00640 1 -- 172.21.15.162:0/3948375963 wait complete. 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.413+0000 7f4886c00640 1 Processor -- start 2024-01-20T11:09:37.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.413+0000 7f4886c00640 1 -- start start 2024-01-20T11:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.414+0000 7f4886c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f488015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.414+0000 7f4886c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4880071260 0x7f48801587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.414+0000 7f4886c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f488015a530 0x7f4880157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.414+0000 7f4886c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48801583b0 con 0x7f488006deb0 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.414+0000 7f4886c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488015d930 con 0x7f4880071260 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.414+0000 7f4886c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48800b4910 con 0x7f488015a530 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f488015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f488015d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57262/0 (socket says 172.21.15.162:57262) 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 -- 172.21.15.162:0/1390105474 learned_addr learned my addr 172.21.15.162:0/1390105474 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f4884c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f488015a530 0x7f4880157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487f400640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4880071260 0x7f48801587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 -- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f488015a530 msgr2=0x7f4880157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f488015a530 0x7f4880157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 -- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4880071260 msgr2=0x7f48801587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4880071260 0x7f48801587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 -- 172.21.15.162:0/1390105474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009b30 con 0x7f488006deb0 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f4884c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f488015a530 0x7f4880157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487f400640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4880071260 0x7f48801587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.415+0000 7f487fe00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f488015d3f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f487000d5f0 tx=0x7f487000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.416+0000 7f4877e00640 1 -- 172.21.15.162:0/1390105474 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700125f0 con 0x7f488006deb0 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.416+0000 7f4877e00640 1 -- 172.21.15.162:0/1390105474 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4870012750 con 0x7f488006deb0 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.416+0000 7f4877e00640 1 -- 172.21.15.162:0/1390105474 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870012b00 con 0x7f488006deb0 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.416+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48800b4bf0 con 0x7f488006deb0 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.416+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48800b2170 con 0x7f488006deb0 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.417+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488004e970 con 0x7f488006deb0 2024-01-20T11:09:37.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.418+0000 7f4877e00640 1 -- 172.21.15.162:0/1390105474 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4870012c60 con 0x7f488006deb0 2024-01-20T11:09:37.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.419+0000 7f4877e00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f485806aed0 0x7f485806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:37.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.419+0000 7f4877e00640 1 -- 172.21.15.162:0/1390105474 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4870089bb0 con 0x7f488006deb0 2024-01-20T11:09:37.419 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.419+0000 7f487f400640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f485806aed0 0x7f485806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:37.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.420+0000 7f487f400640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f485806aed0 0x7f485806d390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f488009d300 tx=0x7f4868009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:37.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.423+0000 7f4877e00640 1 -- 172.21.15.162:0/1390105474 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f48700549e0 con 0x7f488006deb0 2024-01-20T11:09:37.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.658+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f488015e340 con 0x7f488006deb0 2024-01-20T11:09:37.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.659+0000 7f4877e00640 1 -- 172.21.15.162:0/1390105474 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f4870058000 con 0x7f488006deb0 2024-01-20T11:09:37.660 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:37.660 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3643822826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3643822826},{"type":"v1","addr":"172.21.15.162:6837","nonce":3643822826}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3084491175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3084491175},{"type":"v1","addr":"172.21.15.179:6834","nonce":3084491175}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3459133230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3459133230},{"type":"v1","addr":"172.21.15.162:6836","nonce":3459133230}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:09:26.112913+0000","modified":"2024-01-20T11:09:29.172569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/4241600456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4241600456},{"type":"v1","addr":"172.21.15.179:6835","nonce":4241600456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T11:09:37.660 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 23 2024-01-20T11:09:37.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.661+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f485806aed0 msgr2=0x7f485806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:37.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f485806aed0 0x7f485806d390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f488009d300 tx=0x7f4868009040 comp rx=0 tx=0).stop 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 msgr2=0x7f488015d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f488015d3f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f487000d5f0 tx=0x7f487000dab0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 shutdown_connections 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f488015a530 0x7f4880157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f485806aed0 0x7f485806d390 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4880071260 0x7f48801587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 --2- 172.21.15.162:0/1390105474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f488006deb0 0x7f488015d3f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 >> 172.21.15.162:0/1390105474 conn(0x7f48800b0cd0 msgr2=0x7f48800abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 shutdown_connections 2024-01-20T11:09:37.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:37.662+0000 7f4886c00640 1 -- 172.21.15.162:0/1390105474 wait complete. 2024-01-20T11:09:38.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-20T11:09:26.112913+0000', 'modified': '2024-01-20T11:09:29.172569+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5550': {'gid': 5550, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/4241600456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 4241600456}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 4241600456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-20T11:09:38.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-20T11:09:38.084 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-20T11:09:38.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.305+0000 7f3a0fe00640 1 Processor -- start 2024-01-20T11:09:38.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.305+0000 7f3a0fe00640 1 -- start start 2024-01-20T11:09:38.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.307+0000 7f3a0fe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a080cdc30 0x7f3a0806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.307+0000 7f3a0fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080cee70 con 0x7f3a0806cc20 2024-01-20T11:09:38.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.307+0000 7f3a0fe00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080cd7a0 con 0x7f3a08141bb0 2024-01-20T11:09:38.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.307+0000 7f3a0fe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0806d0d0 con 0x7f3a080cdc30 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.307+0000 7f3a0de00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3a0806cc20 0x7f3a080717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41168/0 (socket says 172.21.15.162:41168) 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.307+0000 7f3a0de00640 1 -- 172.21.15.162:0/2021989126 learned_addr learned my addr 172.21.15.162:0/2021989126 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/2021989126 >> v2:172.21.15.179:3300/0 conn(0x7f3a080cdc30 0x7f3a0806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345455451 0 0) 0x7f3a00001490 con 0x7f3a0806cc20 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e8003520 con 0x7f3a0806cc20 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 488693349 0 0) 0x7f39e8003520 con 0x7f3a0806cc20 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 >> v2:172.21.15.179:3300/0 conn(0x7f3a080cdc30 msgr2=0x7f3a0806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 --2- 172.21.15.162:0/2021989126 >> v2:172.21.15.179:3300/0 conn(0x7f3a080cdc30 0x7f3a0806c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 >> v1:172.21.15.179:6789/0 conn(0x7f3a08141bb0 legacy=0x7f3a080ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080ceb90 con 0x7f3a0806cc20 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f3a00001b80 con 0x7f3a0806cc20 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 >> v1:172.21.15.162:6789/0 conn(0x7f3a0806cc20 legacy=0x7f3a080717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e80047c0 0x7f39e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e80051d0 0x7f39e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0806d0d0 con 0x7f39e80039c0 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e800c120 con 0x7f39e80051d0 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.308+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e800c2e0 con 0x7f39e80047c0 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.309+0000 7f3a0d400640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.309+0000 7f3a0d400640 1 -- 172.21.15.162:0/2021989126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e80047c0 msgr2=0x7f39e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.309+0000 7f3a0d400640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e80047c0 0x7f39e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.309+0000 7f3a0d400640 1 -- 172.21.15.162:0/2021989126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e80051d0 msgr2=0x7f39e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.309+0000 7f3a0d400640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e80051d0 0x7f39e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.309+0000 7f3a0d400640 1 -- 172.21.15.162:0/2021989126 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8003520 con 0x7f39e80039c0 2024-01-20T11:09:38.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.309+0000 7f3a0de00640 1 -- 172.21.15.162:0/2021989126 reap_dead start 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.310+0000 7f3a0d400640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f39f8001720 tx=0x7f39e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9630b6ae57927f8b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.310+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80052d0 con 0x7f39e80039c0 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.310+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f802e050 con 0x7f39e80039c0 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.310+0000 7f3a07e00640 1 -- 172.21.15.162:0/2021989126 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8003830 con 0x7f39e80039c0 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.311+0000 7f3a0fe00640 1 -- 172.21.15.162:0/2021989126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 msgr2=0x7f39e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.311+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f39f8001720 tx=0x7f39e80057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.311+0000 7f3a0fe00640 1 -- 172.21.15.162:0/2021989126 shutdown_connections 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.311+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/2021989126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.311+0000 7f3a0fe00640 1 -- 172.21.15.162:0/2021989126 >> 172.21.15.162:0/2021989126 conn(0x7f3a0806a600 msgr2=0x7f3a0806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.311+0000 7f3a0fe00640 1 -- 172.21.15.162:0/2021989126 shutdown_connections 2024-01-20T11:09:38.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.311+0000 7f3a0fe00640 1 -- 172.21.15.162:0/2021989126 wait complete. 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.313+0000 7f3a0fe00640 1 Processor -- start 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.313+0000 7f3a0fe00640 1 -- start start 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f3a0815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0fe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a08139ea0 0x7f3a0815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a0815b1b0 0x7f3a0813bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0815b610 con 0x7f39e80039c0 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0fe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08138e00 con 0x7f3a0815b1b0 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0fe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a081390e0 con 0x7f3a08139ea0 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f3a0815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f3a0815dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57276/0 (socket says 172.21.15.162:57276) 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.314+0000 7f3a0d400640 1 -- 172.21.15.162:0/3777998567 learned_addr learned my addr 172.21.15.162:0/3777998567 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:38.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0de00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a0815b1b0 0x7f3a0813bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a08139ea0 0x7f3a0815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0d400640 1 -- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a08139ea0 msgr2=0x7f3a0815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0d400640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a08139ea0 0x7f3a0815ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0d400640 1 -- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a0815b1b0 msgr2=0x7f3a0813bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0d400640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a0815b1b0 0x7f3a0813bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0d400640 1 -- 172.21.15.162:0/3777998567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a081393c0 con 0x7f39e80039c0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0d400640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f3a0815dac0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f39f8000c00 tx=0x7f39f8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a05600640 1 -- 172.21.15.162:0/3777998567 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80076c0 con 0x7f39e80039c0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a05600640 1 -- 172.21.15.162:0/3777998567 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8007a30 con 0x7f39e80039c0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a05600640 1 -- 172.21.15.162:0/3777998567 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8006be0 con 0x7f39e80039c0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a081396a0 con 0x7f39e80039c0 2024-01-20T11:09:38.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.315+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0815e000 con 0x7f39e80039c0 2024-01-20T11:09:38.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.317+0000 7f3a05600640 1 -- 172.21.15.162:0/3777998567 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f39f8006d40 con 0x7f39e80039c0 2024-01-20T11:09:38.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.318+0000 7f3a05600640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f39e006af00 0x7f39e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.318+0000 7f3a05600640 1 -- 172.21.15.162:0/3777998567 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39f80ab3a0 con 0x7f39e80039c0 2024-01-20T11:09:38.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.319+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f39e006af00 0x7f39e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.319+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f39e006af00 0x7f39e006d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a080b1d40 tx=0x7f39f0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.319+0000 7f3a12a7d740 1 Processor -- start 2024-01-20T11:09:38.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.320+0000 7f3a12a7d740 1 -- start start 2024-01-20T11:09:38.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.320+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e030 0x56443ab4bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.320+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab05660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.320+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab2d970 0x56443ab05ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.320+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443aa72d80 con 0x56443ab2d970 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.320+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443aa70470 con 0x56443ab4e030 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.320+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443aa6bd60 con 0x56443ab4e410 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab2d970 0x56443ab05ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab2d970 0x56443ab05ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57290/0 (socket says 172.21.15.162:57290) 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 -- 172.21.15.162:0/2860589547 learned_addr learned my addr 172.21.15.162:0/2860589547 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab05660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 -- 172.21.15.162:0/2860589547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 msgr2=0x56443ab05660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab05660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 -- 172.21.15.162:0/2860589547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e030 msgr2=0x56443ab4bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e030 0x56443ab4bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.321+0000 7f3a0de00640 1 -- 172.21.15.162:0/2860589547 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443aa21280 con 0x56443ab2d970 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.322+0000 7f3a0de00640 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab2d970 0x56443ab05ba0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3a00002040 tx=0x7f3a00007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a7287d0a0bc14 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.322+0000 7f39fdc00640 1 -- 172.21.15.162:0/2860589547 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000d760 con 0x56443ab2d970 2024-01-20T11:09:38.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.322+0000 7f39fdc00640 1 -- 172.21.15.162:0/2860589547 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0000d8c0 con 0x56443ab2d970 2024-01-20T11:09:38.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.322+0000 7f39fdc00640 1 -- 172.21.15.162:0/2860589547 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000dc70 con 0x56443ab2d970 2024-01-20T11:09:38.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.322+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2860589547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab2d970 msgr2=0x56443ab05ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.322+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab2d970 0x56443ab05ba0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3a00002040 tx=0x7f3a00007f60 comp rx=0 tx=0).stop 2024-01-20T11:09:38.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2860589547 shutdown_connections 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab2d970 0x56443ab05ba0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab05660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2860589547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e030 0x56443ab4bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2860589547 >> 172.21.15.162:0/2860589547 conn(0x56443ab02a50 msgr2=0x56443ab4b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2860589547 shutdown_connections 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2860589547 wait complete. 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.323+0000 7f3a12a7d740 1 -- start start 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.324+0000 7f3a12a7d740 1 Processor -- start 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.324+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443ab26070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab2b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 0x56443ab232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443aa07740 con 0x56443ab4e030 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443aa250c0 con 0x56443ab22e60 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443a7cdf20 con 0x56443ab4e410 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a12a7d740 10 client.0 _ll_register_callbacks cb 0x56443aa62200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443ab26070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443ab26070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57296/0 (socket says 172.21.15.162:57296) 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 -- 172.21.15.162:0/2805167400 learned_addr learned my addr 172.21.15.162:0/2805167400 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 -- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 msgr2=0x56443ab2b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab2b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 -- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 msgr2=0x56443ab232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 0x56443ab232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 -- 172.21.15.162:0/2805167400 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a080ceb90 con 0x56443ab4e030 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f3a0d400640 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443ab26070 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f39f80050a0 tx=0x7f39f807a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d46914092bcaca9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.325+0000 7f39f6000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f39f6000640 1 -- 172.21.15.162:0/2805167400 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f807c070 con 0x56443ab4e030 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f39f6000640 1 -- 172.21.15.162:0/2805167400 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39f8082190 con 0x56443ab4e030 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56443aa64bf0 con 0x56443ab4e030 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f39f6000640 1 -- 172.21.15.162:0/2805167400 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39f8001370 con 0x56443ab4e030 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 10 client.5715 fetch_fsmap learned FSMap version 23 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56443aa6a3e0 con 0x56443ab4e030 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f39f6000640 1 -- 172.21.15.162:0/2805167400 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56443aa64bf0 con 0x56443ab4e030 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f39f6000640 1 -- 172.21.15.162:0/2805167400 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39f804d020 con 0x56443ab4e030 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 10 client.5715 fetch_fsmap finished waiting for FSMap version 23 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 10 client.5715 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 20 client.5715 populate_metadata read hostname 'smithi162' 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab21970 0x56443ab6cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 4 client.5715 mds_command: new command op to 5550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-20T11:09:38.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.326+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 --> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56443aa64910 con 0x56443ab21970 2024-01-20T11:09:38.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.327+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab21970 0x56443ab6cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.328+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab21970 0x56443ab6cf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d50263e6cbd380c2 server_cookie=fe714d158738b06 in_seq=0 out_seq=0 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.328+0000 7f39f6000640 10 client.5715 ms_handle_connect on v2:172.21.15.179:6833/4241600456 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.330+0000 7f39f6000640 1 -- 172.21.15.162:0/2805167400 <== mds.0 v2:172.21.15.179:6833/4241600456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56443aa64910 con 0x56443ab21970 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.330+0000 7f39f6000640 10 client.5715 handle_command_reply: tid=0 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.330+0000 7f3a12a7d740 1 client.5715 shutdown 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.330+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 msgr2=0x56443ab26070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.330+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443ab26070 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f39f80050a0 tx=0x7f39f807a500 comp rx=0 tx=0).stop 2024-01-20T11:09:38.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 shutdown_connections 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab21970 0x56443ab6cf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 0x56443ab232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab2b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/2805167400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443ab26070 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f39f6000640 0 client.5715 ms_handle_reset on v2:172.21.15.179:6833/4241600456 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 >> 172.21.15.162:0/2805167400 conn(0x56443ab2d970 msgr2=0x56443aaff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 shutdown_connections 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 1 -- 172.21.15.162:0/2805167400 wait complete. 2024-01-20T11:09:38.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.331+0000 7f3a12a7d740 20 client.5715 trim_cache size 0 max 16384 2024-01-20T11:09:38.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 Processor -- start 2024-01-20T11:09:38.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 -- start start 2024-01-20T11:09:38.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab22e60 0x56443ab28220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e030 0x56443ab254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e410 0x56443ab259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443ab70f80 con 0x56443ab22e60 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443ab26e90 con 0x56443ab4e410 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.348+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443ab698e0 con 0x56443ab4e030 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab22e60 0x56443ab28220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab22e60 0x56443ab28220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57310/0 (socket says 172.21.15.162:57310) 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 -- 172.21.15.162:0/3766522725 learned_addr learned my addr 172.21.15.162:0/3766522725 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 -- 172.21.15.162:0/3766522725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e030 msgr2=0x56443ab254b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 --2- 172.21.15.162:0/3766522725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e030 0x56443ab254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 -- 172.21.15.162:0/3766522725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e410 msgr2=0x56443ab259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 --2- 172.21.15.162:0/3766522725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e410 0x56443ab259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 -- 172.21.15.162:0/3766522725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443aa06fd0 con 0x56443ab22e60 2024-01-20T11:09:38.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.349+0000 7f3a0d400640 1 --2- 172.21.15.162:0/3766522725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab22e60 0x56443ab28220 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f39f80ab090 tx=0x7f39f80ab000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee0ae662633ae1d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f39fd200640 1 -- 172.21.15.162:0/3766522725 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8082190 con 0x56443ab22e60 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f39fd200640 1 -- 172.21.15.162:0/3766522725 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8001370 con 0x56443ab22e60 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f39fd200640 1 -- 172.21.15.162:0/3766522725 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8081f40 con 0x56443ab22e60 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 -- 172.21.15.162:0/3766522725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab22e60 msgr2=0x56443ab28220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/3766522725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab22e60 0x56443ab28220 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f39f80ab090 tx=0x7f39f80ab000 comp rx=0 tx=0).stop 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 -- 172.21.15.162:0/3766522725 shutdown_connections 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/3766522725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab4e410 0x56443ab259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/3766522725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e030 0x56443ab254b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/3766522725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab22e60 0x56443ab28220 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 -- 172.21.15.162:0/3766522725 >> 172.21.15.162:0/3766522725 conn(0x56443ab2d970 msgr2=0x56443ab2c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 -- 172.21.15.162:0/3766522725 shutdown_connections 2024-01-20T11:09:38.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.350+0000 7f3a12a7d740 1 -- 172.21.15.162:0/3766522725 wait complete. 2024-01-20T11:09:38.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.351+0000 7f3a12a7d740 1 -- start start 2024-01-20T11:09:38.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.351+0000 7f3a12a7d740 1 Processor -- start 2024-01-20T11:09:38.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 0x56443abbead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443abbab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a12a7d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab056e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443ab4ad90 con 0x56443ab4e030 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443abbb7c0 con 0x56443ab22e60 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a12a7d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443ab713c0 con 0x56443ab4e410 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a12a7d740 10 client.0 _ll_register_callbacks cb 0x7f3a00001a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a0ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443abbab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a0ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443abbab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57312/0 (socket says 172.21.15.162:57312) 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.352+0000 7f3a0ca00640 1 -- 172.21.15.162:0/287112033 learned_addr learned my addr 172.21.15.162:0/287112033 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f3a0ca00640 1 -- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 msgr2=0x56443ab056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f3a0ca00640 1 -- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 msgr2=0x56443abbead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 0x56443abbead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f3a0ca00640 1 -- 172.21.15.162:0/287112033 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56443aa6a3e0 con 0x56443ab4e030 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f3a0ca00640 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443abbab40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x56443ab4f940 tx=0x7f39f0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6899323020f8c569 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f39f6000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f39f6000640 1 -- 172.21.15.162:0/287112033 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0015e90 con 0x56443ab4e030 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f39f6000640 1 -- 172.21.15.162:0/287112033 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39f0004020 con 0x56443ab4e030 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.353+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a0000d8c0 con 0x56443ab4e030 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f39f6000640 1 -- 172.21.15.162:0/287112033 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39f00041e0 con 0x56443ab4e030 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 10 client.5721 fetch_fsmap learned FSMap version 23 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56443aa2c5c0 con 0x56443ab4e030 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f39f6000640 1 -- 172.21.15.162:0/287112033 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0000d8c0 con 0x56443ab4e030 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f39f6000640 1 -- 172.21.15.162:0/287112033 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39f0004340 con 0x56443ab4e030 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 10 client.5721 fetch_fsmap finished waiting for FSMap version 23 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 10 client.5721 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 20 client.5721 populate_metadata read hostname 'smithi162' 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab05c20 0x56443ab28220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 4 client.5721 mds_command: new command op to 5550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.354+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 --> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56443a76b6c0 con 0x56443ab05c20 2024-01-20T11:09:38.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.355+0000 7f3a0d400640 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab05c20 0x56443ab28220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.356+0000 7f39f6000640 10 client.5721 ms_handle_connect on v2:172.21.15.179:6833/4241600456 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.356+0000 7f3a0d400640 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab05c20 0x56443ab28220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efff500b05c68c7e server_cookie=aaffdf735d516e7b in_seq=0 out_seq=0 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.356+0000 7f39f6000640 1 -- 172.21.15.162:0/287112033 <== mds.0 v2:172.21.15.179:6833/4241600456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56443a76b6c0 con 0x56443ab05c20 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.356+0000 7f39f6000640 10 client.5721 handle_command_reply: tid=0 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.356+0000 7f3a12a7d740 1 client.5721 shutdown 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 msgr2=0x56443abbab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443abbab40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x56443ab4f940 tx=0x7f39f0009190 comp rx=0 tx=0).stop 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 shutdown_connections 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:6833/4241600456,v1:172.21.15.179:6835/4241600456] conn(0x56443ab05c20 0x56443ab28220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56443ab4e410 0x56443ab056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56443ab4e030 0x56443abbab40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 --2- 172.21.15.162:0/287112033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56443ab22e60 0x56443abbead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f39f6000640 0 client.5721 ms_handle_reset on v2:172.21.15.179:6833/4241600456 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 >> 172.21.15.162:0/287112033 conn(0x56443ab2d970 msgr2=0x56443ab2c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 shutdown_connections 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 1 -- 172.21.15.162:0/287112033 wait complete. 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.357+0000 7f3a12a7d740 20 client.5721 trim_cache size 0 max 16384 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "c5cb0dc2-b452-4376-8c48-87e4df6f2999", 2024-01-20T11:09:38.360 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 0, 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 5550, 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 11.683298536000001, 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 23, 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 47, 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 47, 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 17.146127760999999 2024-01-20T11:09:38.361 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f39e006af00 msgr2=0x7f39e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f39e006af00 0x7f39e006d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a080b1d40 tx=0x7f39f0008040 comp rx=0 tx=0).stop 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 msgr2=0x7f3a0815dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f3a0815dac0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f39f8000c00 tx=0x7f39f8001120 comp rx=0 tx=0).stop 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 shutdown_connections 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f39e006af00 0x7f39e006d3c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a0815b1b0 0x7f3a0813bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a08139ea0 0x7f3a0815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 --2- 172.21.15.162:0/3777998567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e80039c0 0x7f3a0815dac0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 >> 172.21.15.162:0/3777998567 conn(0x7f3a0806a600 msgr2=0x7f3a0813ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 shutdown_connections 2024-01-20T11:09:38.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.358+0000 7f3a0fe00640 1 -- 172.21.15.162:0/3777998567 wait complete. 2024-01-20T11:09:38.375 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T11:09:38.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.578+0000 7f54d0400640 1 Processor -- start 2024-01-20T11:09:38.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.578+0000 7f54d0400640 1 -- start start 2024-01-20T11:09:38.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54d0400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54c813e380 0x7f54c815efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54d0400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 0x7f54c8140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54d0400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c806d150 con 0x7f54c815f520 2024-01-20T11:09:38.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54d0400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c806d3a0 con 0x7f54c813e380 2024-01-20T11:09:38.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54d0400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80ccc70 con 0x7f54c806cce0 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54cd000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f54c815f520 0x7f54c806c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41170/0 (socket says 172.21.15.162:41170) 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54cd000640 1 -- 172.21.15.162:0/832711805 learned_addr learned my addr 172.21.15.162:0/832711805 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54cda00640 1 --2- 172.21.15.162:0/832711805 >> v2:172.21.15.179:3300/0 conn(0x7f54c813e380 0x7f54c815efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.580+0000 7f54ce400640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 0x7f54c8140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236274468 0 0) 0x7f54c806d150 con 0x7f54c815f520 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a8003520 con 0x7f54c815f520 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1228730489 0 0) 0x7f54a8003520 con 0x7f54c815f520 2024-01-20T11:09:38.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 msgr2=0x7f54c8140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 0x7f54c8140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 >> v2:172.21.15.179:3300/0 conn(0x7f54c813e380 msgr2=0x7f54c815efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 --2- 172.21.15.162:0/832711805 >> v2:172.21.15.179:3300/0 conn(0x7f54c813e380 0x7f54c815efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c813fa50 con 0x7f54c815f520 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f54b0001670 con 0x7f54c815f520 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 >> v1:172.21.15.162:6789/0 conn(0x7f54c815f520 legacy=0x7f54c806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 0x7f54a8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a8004d00 0x7f54a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c806d3a0 con 0x7f54a8003ef0 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80ccc70 con 0x7f54a8004d00 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.581+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a800b980 con 0x7f54c806cce0 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54cd000640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54cda00640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 0x7f54a8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54ce400640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a8004d00 0x7f54a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54cd000640 1 -- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 msgr2=0x7f54a8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54cd000640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c806cce0 0x7f54a8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54cd000640 1 -- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a8004d00 msgr2=0x7f54a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54cd000640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a8004d00 0x7f54a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.582+0000 7f54cd000640 1 -- 172.21.15.162:0/832711805 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8003520 con 0x7f54a8003ef0 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.583+0000 7f54cd000640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54a80047c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f54b000c240 tx=0x7f54a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bc68d4fa1f0e76 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b002cae0 con 0x7f54a8003ef0 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b002cc40 con 0x7f54a8003ef0 2024-01-20T11:09:38.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54c7e00640 1 -- 172.21.15.162:0/832711805 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0005af0 con 0x7f54a8003ef0 2024-01-20T11:09:38.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54d0400640 1 -- 172.21.15.162:0/832711805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 msgr2=0x7f54a80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54d0400640 1 --2- 172.21.15.162:0/832711805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54a80047c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f54b000c240 tx=0x7f54a80057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54ce400640 1 -- 172.21.15.162:0/832711805 reap_dead start 2024-01-20T11:09:38.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54d0400640 1 -- 172.21.15.162:0/832711805 shutdown_connections 2024-01-20T11:09:38.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.584+0000 7f54d0400640 1 -- 172.21.15.162:0/832711805 >> 172.21.15.162:0/832711805 conn(0x7f54c806a600 msgr2=0x7f54c806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.585+0000 7f54d0400640 1 -- 172.21.15.162:0/832711805 shutdown_connections 2024-01-20T11:09:38.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.585+0000 7f54d0400640 1 -- 172.21.15.162:0/832711805 wait complete. 2024-01-20T11:09:38.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.587+0000 7f54d0400640 1 Processor -- start 2024-01-20T11:09:38.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.587+0000 7f54d0400640 1 -- start start 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54d0400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54c81559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54d0400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c8131750 0x7f54c8131bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54d0400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c8132110 0x7f54c81305d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54d0400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8130140 con 0x7f54a8003ef0 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54d0400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80b0200 con 0x7f54c8131750 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54d0400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8132590 con 0x7f54c8132110 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54c81559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54c81559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57330/0 (socket says 172.21.15.162:57330) 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 -- 172.21.15.162:0/861085404 learned_addr learned my addr 172.21.15.162:0/861085404 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 -- 172.21.15.162:0/861085404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c8132110 msgr2=0x7f54c81305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c8132110 0x7f54c81305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 -- 172.21.15.162:0/861085404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c8131750 msgr2=0x7f54c8131bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c8131750 0x7f54c8131bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.588+0000 7f54cda00640 1 -- 172.21.15.162:0/861085404 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c812f810 con 0x7f54a8003ef0 2024-01-20T11:09:38.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.589+0000 7f54cda00640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54c81559e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f54b8011630 tx=0x7f54b8011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.589+0000 7f54c5600640 1 -- 172.21.15.162:0/861085404 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8015870 con 0x7f54a8003ef0 2024-01-20T11:09:38.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.589+0000 7f54c5600640 1 -- 172.21.15.162:0/861085404 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80159d0 con 0x7f54a8003ef0 2024-01-20T11:09:38.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.589+0000 7f54c5600640 1 -- 172.21.15.162:0/861085404 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8015d40 con 0x7f54a8003ef0 2024-01-20T11:09:38.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.589+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c812faf0 con 0x7f54a8003ef0 2024-01-20T11:09:38.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.589+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c8155f20 con 0x7f54a8003ef0 2024-01-20T11:09:38.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.590+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c804e970 con 0x7f54a8003ef0 2024-01-20T11:09:38.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.591+0000 7f54c5600640 1 -- 172.21.15.162:0/861085404 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f54b800f490 con 0x7f54a8003ef0 2024-01-20T11:09:38.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.592+0000 7f54c5600640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f54a006aed0 0x7f54a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:38.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.592+0000 7f54c5600640 1 -- 172.21.15.162:0/861085404 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54b8089f20 con 0x7f54a8003ef0 2024-01-20T11:09:38.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.592+0000 7f54cd000640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f54a006aed0 0x7f54a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:38.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.593+0000 7f54cd000640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f54a006aed0 0x7f54a006d390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54b0034000 tx=0x7f54b002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:38.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.597+0000 7f54c5600640 1 -- 172.21.15.162:0/861085404 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f54b8054d50 con 0x7f54a8003ef0 2024-01-20T11:09:38.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.836+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f54c80b1da0 con 0x7f54a8003ef0 2024-01-20T11:09:38.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.836+0000 7f54c5600640 1 -- 172.21.15.162:0/861085404 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f54b8058370 con 0x7f54a8003ef0 2024-01-20T11:09:38.837 INFO:teuthology.orchestra.run.smithi162.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T11:09:38.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f54a006aed0 msgr2=0x7f54a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f54a006aed0 0x7f54a006d390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54b0034000 tx=0x7f54b002e000 comp rx=0 tx=0).stop 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 msgr2=0x7f54c81559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54c81559e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f54b8011630 tx=0x7f54b8011af0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 shutdown_connections 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c8132110 0x7f54c81305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f54a006aed0 0x7f54a006d390 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c8131750 0x7f54c8131bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 --2- 172.21.15.162:0/861085404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8003ef0 0x7f54c81559e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 >> 172.21.15.162:0/861085404 conn(0x7f54c806a600 msgr2=0x7f54c815e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 shutdown_connections 2024-01-20T11:09:38.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:38.839+0000 7f54d0400640 1 -- 172.21.15.162:0/861085404 wait complete. 2024-01-20T11:09:38.858 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T11:09:38.859 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:09:38.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:38.859 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-01-20T11:09:38.909 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T11:09:38.909 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T11:09:38.909 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T11:09:38.909 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:09:38.909 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42371sec preferred_lft 42371sec 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-01-20T11:09:38.910 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 4a:ef:0d:fa:ff:04 brd ff:ff:ff:ff:ff:ff 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::f816:dfff:fe99:c645/64 scope link 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 92:5b:34:cf:51:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::905b:34ff:fecf:51d2/64 scope link 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 4a:ef:0d:fa:ff:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::48ef:dff:fefa:ff04/64 scope link 2024-01-20T11:09:38.911 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-01-20T11:09:38.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:38.912 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T11:09:38.996 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-01-20T11:09:39.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:39.000 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-01-20T11:09:39.053 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-01-20T11:09:39.053 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T11:09:39.053 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T11:09:39.054 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T11:09:39.054 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T11:09:39.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:39.054 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-01-20T11:09:39.054 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-01-20T11:09:39.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T11:09:39.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T11:09:39.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T11:09:39.054 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-01-20T11:09:39.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:39.237 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:09:39.288 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T11:09:39.288 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-20T11:09:39.289 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:09:39.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:39.289 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-01-20T11:09:39.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:09:39.380 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T11:09:39.431 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T11:09:39.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T11:09:39.431 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T11:09:39.480 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-20T11:09:39.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:39.480 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:09:39.615 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:09:39.615 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:09:39.615 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:09:39.637 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:09:39.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:09:39.638 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:09:39.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:09:39.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:09:39.667 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-20T11:09:39.667 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-20T11:09:39.667 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-01-20T11:09:39.667 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-01-20T11:09:39.667 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-20T11:09:39.667 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-01-20T11:09:39.668 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.162:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-01-20T11:09:39.668 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c5cb0dc2-b452-4376-8c48-87e4df6f2999" will pass to kernel 2024-01-20T11:09:39.669 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T11:09:39.669 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-01-20T11:09:39.669 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T11:09:39.669 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T11:09:39.669 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T11:09:39.673 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T11:09:39.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:39.673 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T11:09:39.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:39.761 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T11:09:39.840 INFO:teuthology.orchestra.run.smithi162.stdout:client5730 2024-01-20T11:09:39.840 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:39.841 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:39.895 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_fragment_size_max 50 2024-01-20T11:09:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.108+0000 7fb72f200640 1 Processor -- start 2024-01-20T11:09:40.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.109+0000 7fb72f200640 1 -- start start 2024-01-20T11:09:40.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.110+0000 7fb72f200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 0x7fb7280cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:40.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.110+0000 7fb72f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb72806b710 0x7fb72806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:40.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.110+0000 7fb72f200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb728158370 con 0x7fb728157f90 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.110+0000 7fb72f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280cc460 con 0x7fb72806b710 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.110+0000 7fb72f200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280cb870 con 0x7fb7280b3450 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.110+0000 7fb727e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb728157f90 0x7fb7280b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41178/0 (socket says 172.21.15.162:41178) 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.110+0000 7fb727e00640 1 -- 172.21.15.162:0/3857545230 learned_addr learned my addr 172.21.15.162:0/3857545230 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.111+0000 7fb72d200640 1 --2- 172.21.15.162:0/3857545230 >> v2:172.21.15.162:3300/0 conn(0x7fb72806b710 0x7fb72806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.111+0000 7fb726a00640 1 -- 172.21.15.162:0/3857545230 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317859947 0 0) 0x7fb728158370 con 0x7fb728157f90 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.111+0000 7fb726a00640 1 -- 172.21.15.162:0/3857545230 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb708003520 con 0x7fb728157f90 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.111+0000 7fb72d200640 1 -- 172.21.15.162:0/3857545230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 msgr2=0x7fb7280cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.111+0000 7fb72d200640 1 --2- 172.21.15.162:0/3857545230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 0x7fb7280cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.111+0000 7fb72d200640 1 -- 172.21.15.162:0/3857545230 >> v1:172.21.15.162:6789/0 conn(0x7fb728157f90 legacy=0x7fb7280b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:40.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.111+0000 7fb72d200640 1 -- 172.21.15.162:0/3857545230 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280cbac0 con 0x7fb72806b710 2024-01-20T11:09:40.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.112+0000 7fb72d200640 1 --2- 172.21.15.162:0/3857545230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb72806b710 0x7fb72806bbc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097a0 tx=0x7fb72002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5e698d03511c4a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:40.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.112+0000 7fb726a00640 1 -- 172.21.15.162:0/3857545230 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720031780 con 0x7fb72806b710 2024-01-20T11:09:40.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.112+0000 7fb726a00640 1 -- 172.21.15.162:0/3857545230 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7200318e0 con 0x7fb72806b710 2024-01-20T11:09:40.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.112+0000 7fb726a00640 1 -- 172.21.15.162:0/3857545230 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720031c70 con 0x7fb72806b710 2024-01-20T11:09:40.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 -- 172.21.15.162:0/3857545230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb72806b710 msgr2=0x7fb72806bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:40.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 --2- 172.21.15.162:0/3857545230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb72806b710 0x7fb72806bbc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097a0 tx=0x7fb72002b820 comp rx=0 tx=0).stop 2024-01-20T11:09:40.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 -- 172.21.15.162:0/3857545230 shutdown_connections 2024-01-20T11:09:40.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 --2- 172.21.15.162:0/3857545230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 0x7fb7280cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 --2- 172.21.15.162:0/3857545230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb72806b710 0x7fb72806bbc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 -- 172.21.15.162:0/3857545230 >> 172.21.15.162:0/3857545230 conn(0x7fb72806e970 msgr2=0x7fb72806ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:40.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 -- 172.21.15.162:0/3857545230 shutdown_connections 2024-01-20T11:09:40.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.113+0000 7fb72f200640 1 -- 172.21.15.162:0/3857545230 wait complete. 2024-01-20T11:09:40.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.115+0000 7fb72f200640 1 Processor -- start 2024-01-20T11:09:40.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.115+0000 7fb72f200640 1 -- start start 2024-01-20T11:09:40.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72f200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb72806b710 0x7fb728153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:40.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72f200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 0x7fb7281f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:40.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb728157f90 0x7fb7280b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:40.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7281f2ec0 con 0x7fb728157f90 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72f200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb728152ea0 con 0x7fb72806b710 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72f200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb728153180 con 0x7fb7280b3450 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb728157f90 0x7fb7280b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb728157f90 0x7fb7280b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57340/0 (socket says 172.21.15.162:57340) 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.116+0000 7fb72d200640 1 -- 172.21.15.162:0/2805426261 learned_addr learned my addr 172.21.15.162:0/2805426261 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb727e00640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb72806b710 0x7fb728153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb727400640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 0x7fb7281f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb72d200640 1 -- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 msgr2=0x7fb7281f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb72d200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 0x7fb7281f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb72d200640 1 -- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb72806b710 msgr2=0x7fb728153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb72d200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb72806b710 0x7fb728153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb72d200640 1 -- 172.21.15.162:0/2805426261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009400 con 0x7fb728157f90 2024-01-20T11:09:40.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.117+0000 7fb72d200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb728157f90 0x7fb7280b6a40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097a0 tx=0x7fb7200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:40.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.118+0000 7fb71fe00640 1 -- 172.21.15.162:0/2805426261 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720032820 con 0x7fb728157f90 2024-01-20T11:09:40.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.118+0000 7fb71fe00640 1 -- 172.21.15.162:0/2805426261 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7200329a0 con 0x7fb728157f90 2024-01-20T11:09:40.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.118+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb728153460 con 0x7fb728157f90 2024-01-20T11:09:40.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.118+0000 7fb71fe00640 1 -- 172.21.15.162:0/2805426261 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720032d50 con 0x7fb728157f90 2024-01-20T11:09:40.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.118+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb728153a20 con 0x7fb728157f90 2024-01-20T11:09:40.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.119+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72806b130 con 0x7fb728157f90 2024-01-20T11:09:40.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.120+0000 7fb71fe00640 1 -- 172.21.15.162:0/2805426261 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb72004d3f0 con 0x7fb728157f90 2024-01-20T11:09:40.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.121+0000 7fb71fe00640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb70006aed0 0x7fb70006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:40.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.121+0000 7fb71fe00640 1 -- 172.21.15.162:0/2805426261 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7200ab1a0 con 0x7fb728157f90 2024-01-20T11:09:40.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.121+0000 7fb727e00640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb70006aed0 0x7fb70006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:40.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.122+0000 7fb727e00640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb70006aed0 0x7fb70006d390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb710005880 tx=0x7fb710009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:40.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.125+0000 7fb71fe00640 1 -- 172.21.15.162:0/2805426261 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb720076060 con 0x7fb728157f90 2024-01-20T11:09:40.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.319+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7fb728153c10 con 0x7fb728157f90 2024-01-20T11:09:40.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.324+0000 7fb71fe00640 1 -- 172.21.15.162:0/2805426261 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v13)=0 v13) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb720079680 con 0x7fb728157f90 2024-01-20T11:09:40.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb70006aed0 msgr2=0x7fb70006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:40.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb70006aed0 0x7fb70006d390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb710005880 tx=0x7fb710009040 comp rx=0 tx=0).stop 2024-01-20T11:09:40.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb728157f90 msgr2=0x7fb7280b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:40.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb728157f90 0x7fb7280b6a40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097a0 tx=0x7fb7200046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 shutdown_connections 2024-01-20T11:09:40.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb728157f90 0x7fb7280b6a40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7280b3450 0x7fb7281f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb70006aed0 0x7fb70006d390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 --2- 172.21.15.162:0/2805426261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb72806b710 0x7fb728153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:40.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 >> 172.21.15.162:0/2805426261 conn(0x7fb72806e970 msgr2=0x7fb7280b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:40.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.327+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 shutdown_connections 2024-01-20T11:09:40.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:40.328+0000 7fb72f200640 1 -- 172.21.15.162:0/2805426261 wait complete. 2024-01-20T11:09:50.348 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:50.348 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:50.403 DEBUG:teuthology.orchestra.run.smithi162:> stdin-killer -- python3 -c ' 2024-01-20T11:09:50.403 DEBUG:teuthology.orchestra.run.smithi162:> import os 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> import uuid 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> n = 51 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> create_hard_links = False 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> if 0 > 0: 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> create_hard_links = True 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> dpath = os.path.dirname(path) 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> fnameprefix = os.path.basename(path) 2024-01-20T11:09:50.404 DEBUG:teuthology.orchestra.run.smithi162:> os.makedirs(dpath, exist_ok=True) 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> try: 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> for i in range(n): 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> with open(fpath, '"'"'w'"'"') as f: 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> f.write(f"{i}") 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> if False: 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> f.flush() 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> os.fsync(f.fileno()) 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> if False: 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> os.unlink(fpath) 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> if False: 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> os.fsync(dirfd) 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> if create_hard_links: 2024-01-20T11:09:50.405 DEBUG:teuthology.orchestra.run.smithi162:> for j in range(0): 2024-01-20T11:09:50.406 DEBUG:teuthology.orchestra.run.smithi162:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-01-20T11:09:50.406 DEBUG:teuthology.orchestra.run.smithi162:> if True: 2024-01-20T11:09:50.406 DEBUG:teuthology.orchestra.run.smithi162:> os.fsync(dirfd) 2024-01-20T11:09:50.406 DEBUG:teuthology.orchestra.run.smithi162:> finally: 2024-01-20T11:09:50.406 DEBUG:teuthology.orchestra.run.smithi162:> os.close(dirfd) 2024-01-20T11:09:50.406 DEBUG:teuthology.orchestra.run.smithi162:> ' 2024-01-20T11:09:50.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-20T11:09:50.649 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T11:09:50.650 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:09:50.794 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T11:09:50.917 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T11:09:50.917 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:50.917 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:50.973 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:50.973 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:51.027 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:51.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.237+0000 7fc783e00640 1 Processor -- start 2024-01-20T11:09:51.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.238+0000 7fc783e00640 1 -- start start 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.239+0000 7fc783e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc77c070630 0x7fc77c0adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.239+0000 7fc783e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc77c15c6e0 0x7fc77c0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.239+0000 7fc783e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c070b60 con 0x7fc77c155a30 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.239+0000 7fc783e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c15ba10 con 0x7fc77c15c6e0 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.239+0000 7fc783e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c15bc00 con 0x7fc77c070630 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.239+0000 7fc781400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc77c155a30 0x7fc77c0ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57690/0 (socket says 172.21.15.162:57690) 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.239+0000 7fc781400640 1 -- 172.21.15.162:0/3778833376 learned_addr learned my addr 172.21.15.162:0/3778833376 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc781e00640 1 --2- 172.21.15.162:0/3778833376 >> v2:172.21.15.162:3300/0 conn(0x7fc77c15c6e0 0x7fc77c0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc780a00640 1 --2- 172.21.15.162:0/3778833376 >> v2:172.21.15.179:3300/0 conn(0x7fc77c070630 0x7fc77c0adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc77be00640 1 -- 172.21.15.162:0/3778833376 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610439349 0 0) 0x7fc77c070b60 con 0x7fc77c155a30 2024-01-20T11:09:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc77be00640 1 -- 172.21.15.162:0/3778833376 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc75c003520 con 0x7fc77c155a30 2024-01-20T11:09:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc781e00640 1 -- 172.21.15.162:0/3778833376 >> v2:172.21.15.179:3300/0 conn(0x7fc77c070630 msgr2=0x7fc77c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc781e00640 1 --2- 172.21.15.162:0/3778833376 >> v2:172.21.15.179:3300/0 conn(0x7fc77c070630 0x7fc77c0adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc781e00640 1 -- 172.21.15.162:0/3778833376 >> v1:172.21.15.162:6789/0 conn(0x7fc77c155a30 legacy=0x7fc77c0ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.240+0000 7fc781e00640 1 -- 172.21.15.162:0/3778833376 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c15bee0 con 0x7fc77c15c6e0 2024-01-20T11:09:51.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.242+0000 7fc781e00640 1 --2- 172.21.15.162:0/3778833376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c15c6e0 0x7fc77c0ae4e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc77c06d870 tx=0x7fc77402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932e17ad2172c185 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:51.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.242+0000 7fc77be00640 1 -- 172.21.15.162:0/3778833376 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774031830 con 0x7fc77c15c6e0 2024-01-20T11:09:51.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.242+0000 7fc77be00640 1 -- 172.21.15.162:0/3778833376 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774031990 con 0x7fc77c15c6e0 2024-01-20T11:09:51.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.242+0000 7fc77be00640 1 -- 172.21.15.162:0/3778833376 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774031d20 con 0x7fc77c15c6e0 2024-01-20T11:09:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 -- 172.21.15.162:0/3778833376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c15c6e0 msgr2=0x7fc77c0ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 --2- 172.21.15.162:0/3778833376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c15c6e0 0x7fc77c0ae4e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc77c06d870 tx=0x7fc77402b8d0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 -- 172.21.15.162:0/3778833376 shutdown_connections 2024-01-20T11:09:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 --2- 172.21.15.162:0/3778833376 >> v2:172.21.15.179:3300/0 conn(0x7fc77c070630 0x7fc77c0adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 --2- 172.21.15.162:0/3778833376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c15c6e0 0x7fc77c0ae4e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 -- 172.21.15.162:0/3778833376 >> 172.21.15.162:0/3778833376 conn(0x7fc77c0b0cd0 msgr2=0x7fc77c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:51.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 -- 172.21.15.162:0/3778833376 shutdown_connections 2024-01-20T11:09:51.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.243+0000 7fc783e00640 1 -- 172.21.15.162:0/3778833376 wait complete. 2024-01-20T11:09:51.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.245+0000 7fc783e00640 1 Processor -- start 2024-01-20T11:09:51.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.245+0000 7fc783e00640 1 -- start start 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.246+0000 7fc783e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c070630 0x7fc77c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.246+0000 7fc783e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c155a30 0x7fc77c0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.246+0000 7fc783e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c15c6e0 0x7fc77c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.246+0000 7fc783e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c145540 con 0x7fc77c155a30 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.246+0000 7fc783e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c144b40 con 0x7fc77c070630 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.246+0000 7fc783e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c144ec0 con 0x7fc77c15c6e0 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c155a30 0x7fc77c0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c155a30 0x7fc77c0b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57018/0 (socket says 172.21.15.162:57018) 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 -- 172.21.15.162:0/1151167247 learned_addr learned my addr 172.21.15.162:0/1151167247 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc781400640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c070630 0x7fc77c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc781e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c15c6e0 0x7fc77c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 -- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c15c6e0 msgr2=0x7fc77c0b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c15c6e0 0x7fc77c0b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 -- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c070630 msgr2=0x7fc77c144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c070630 0x7fc77c144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 -- 172.21.15.162:0/1151167247 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774009400 con 0x7fc77c155a30 2024-01-20T11:09:51.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc781400640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c070630 0x7fc77c144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:51.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc781e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c15c6e0 0x7fc77c0b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:51.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.247+0000 7fc780a00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c155a30 0x7fc77c0b2e10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc76400d800 tx=0x7fc76400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.248+0000 7fc779600640 1 -- 172.21.15.162:0/1151167247 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400b6c0 con 0x7fc77c155a30 2024-01-20T11:09:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.248+0000 7fc779600640 1 -- 172.21.15.162:0/1151167247 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400b820 con 0x7fc77c155a30 2024-01-20T11:09:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.248+0000 7fc779600640 1 -- 172.21.15.162:0/1151167247 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400bbb0 con 0x7fc77c155a30 2024-01-20T11:09:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.248+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c155f90 con 0x7fc77c155a30 2024-01-20T11:09:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.248+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c145160 con 0x7fc77c155a30 2024-01-20T11:09:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.249+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c1457b0 con 0x7fc77c155a30 2024-01-20T11:09:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.250+0000 7fc779600640 1 -- 172.21.15.162:0/1151167247 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc76400bd10 con 0x7fc77c155a30 2024-01-20T11:09:51.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.251+0000 7fc779600640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc75406aed0 0x7fc75406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.251+0000 7fc779600640 1 -- 172.21.15.162:0/1151167247 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc764089c00 con 0x7fc77c155a30 2024-01-20T11:09:51.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.251+0000 7fc781400640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc75406aed0 0x7fc75406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.252+0000 7fc781400640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc75406aed0 0x7fc75406d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc76c005c00 tx=0x7fc76c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:51.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.256+0000 7fc779600640 1 -- 172.21.15.162:0/1151167247 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc764054a30 con 0x7fc77c155a30 2024-01-20T11:09:51.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.452+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc77c04e970 con 0x7fc77c155a30 2024-01-20T11:09:51.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.454+0000 7fc779600640 1 -- 172.21.15.162:0/1151167247 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16538 (secure 0 0 0) 0x7fc764058050 con 0x7fc77c155a30 2024-01-20T11:09:51.455 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:51.455 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":47,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:27.671415+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:09:23.943994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-20T11:09:25.120343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc75406aed0 msgr2=0x7fc75406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc75406aed0 0x7fc75406d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc76c005c00 tx=0x7fc76c009040 comp rx=0 tx=0).stop 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c155a30 msgr2=0x7fc77c0b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c155a30 0x7fc77c0b2e10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc76400d800 tx=0x7fc76400dcc0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 shutdown_connections 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c15c6e0 0x7fc77c0b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc77c155a30 0x7fc77c0b2e10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc75406aed0 0x7fc75406d390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 --2- 172.21.15.162:0/1151167247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c070630 0x7fc77c144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 >> 172.21.15.162:0/1151167247 conn(0x7fc77c0b0cd0 msgr2=0x7fc77c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 shutdown_connections 2024-01-20T11:09:51.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.457+0000 7fc783e00640 1 -- 172.21.15.162:0/1151167247 wait complete. 2024-01-20T11:09:51.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:09:23.943994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:09:25.120343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:09:51.477 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:09:51.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.692+0000 7f5837e00640 1 Processor -- start 2024-01-20T11:09:51.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.692+0000 7f5837e00640 1 -- start start 2024-01-20T11:09:51.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5837e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f583015a380 0x7f583015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5837e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58300b2040 0x7f58300707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5837e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58300b2ec0 con 0x7f58300cf060 2024-01-20T11:09:51.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5837e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583015ee30 con 0x7f583015a380 2024-01-20T11:09:51.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5837e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58300ce700 con 0x7f58300b2040 2024-01-20T11:09:51.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5835400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f583015a380 0x7f583015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5835e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f58300cf060 0x7f583006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57696/0 (socket says 172.21.15.162:57696) 2024-01-20T11:09:51.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.694+0000 7f5835e00640 1 -- 172.21.15.162:0/1915793847 learned_addr learned my addr 172.21.15.162:0/1915793847 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:51.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.695+0000 7f5834a00640 1 --2- 172.21.15.162:0/1915793847 >> v2:172.21.15.179:3300/0 conn(0x7f58300b2040 0x7f58300707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.695+0000 7f5835400640 1 -- 172.21.15.162:0/1915793847 >> v2:172.21.15.179:3300/0 conn(0x7f58300b2040 msgr2=0x7f58300707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.695+0000 7f5835400640 1 --2- 172.21.15.162:0/1915793847 >> v2:172.21.15.179:3300/0 conn(0x7f58300b2040 0x7f58300707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.695+0000 7f5835400640 1 -- 172.21.15.162:0/1915793847 >> v1:172.21.15.162:6789/0 conn(0x7f58300cf060 legacy=0x7f583006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.695+0000 7f5835400640 1 -- 172.21.15.162:0/1915793847 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300b2590 con 0x7f583015a380 2024-01-20T11:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.695+0000 7f582fe00640 1 -- 172.21.15.162:0/1915793847 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666550088 0 0) 0x7f5828001110 con 0x7f58300cf060 2024-01-20T11:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.696+0000 7f5835400640 1 --2- 172.21.15.162:0/1915793847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f583015e8f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f58300671c0 tx=0x7f582002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9797aedff05793ca server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.696+0000 7f582fe00640 1 -- 172.21.15.162:0/1915793847 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582002cbf0 con 0x7f583015a380 2024-01-20T11:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.696+0000 7f582fe00640 1 -- 172.21.15.162:0/1915793847 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582002cd50 con 0x7f583015a380 2024-01-20T11:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.696+0000 7f582fe00640 1 -- 172.21.15.162:0/1915793847 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820034660 con 0x7f583015a380 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 -- 172.21.15.162:0/1915793847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 msgr2=0x7f583015e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 --2- 172.21.15.162:0/1915793847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f583015e8f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f58300671c0 tx=0x7f582002be40 comp rx=0 tx=0).stop 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 -- 172.21.15.162:0/1915793847 shutdown_connections 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 --2- 172.21.15.162:0/1915793847 >> v2:172.21.15.179:3300/0 conn(0x7f58300b2040 0x7f58300707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 --2- 172.21.15.162:0/1915793847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f583015e8f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 -- 172.21.15.162:0/1915793847 >> 172.21.15.162:0/1915793847 conn(0x7f583006a600 msgr2=0x7f583006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 -- 172.21.15.162:0/1915793847 shutdown_connections 2024-01-20T11:09:51.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.697+0000 7f5837e00640 1 -- 172.21.15.162:0/1915793847 wait complete. 2024-01-20T11:09:51.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.700+0000 7f5837e00640 1 Processor -- start 2024-01-20T11:09:51.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.700+0000 7f5837e00640 1 -- start start 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5837e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58300b2040 0x7f58301476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5837e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58300cf060 0x7f5830144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5837e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f5830144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5837e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830145ef0 con 0x7f583015a380 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5837e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830145040 con 0x7f58300b2040 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5837e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5830145270 con 0x7f58300cf060 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f5830144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f5830144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57044/0 (socket says 172.21.15.162:57044) 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 -- 172.21.15.162:0/1544299056 learned_addr learned my addr 172.21.15.162:0/1544299056 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5834a00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58300cf060 0x7f5830144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835400640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58300b2040 0x7f58301476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 -- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58300cf060 msgr2=0x7f5830144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58300cf060 0x7f5830144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 -- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58300b2040 msgr2=0x7f58301476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58300b2040 0x7f58301476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5835e00640 1 -- 172.21.15.162:0/1544299056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009a70 con 0x7f583015a380 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.701+0000 7f5834a00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58300cf060 0x7f5830144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.702+0000 7f5835e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f5830144260 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f582800c780 tx=0x7f582800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.702+0000 7f582d600640 1 -- 172.21.15.162:0/1544299056 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280072d0 con 0x7f583015a380 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.702+0000 7f582d600640 1 -- 172.21.15.162:0/1544299056 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828007430 con 0x7f583015a380 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.702+0000 7f582d600640 1 -- 172.21.15.162:0/1544299056 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828001d10 con 0x7f583015a380 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.702+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5830145550 con 0x7f583015a380 2024-01-20T11:09:51.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.702+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5830145b10 con 0x7f583015a380 2024-01-20T11:09:51.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.703+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5830146030 con 0x7f583015a380 2024-01-20T11:09:51.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.704+0000 7f582d600640 1 -- 172.21.15.162:0/1544299056 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f58280047e0 con 0x7f583015a380 2024-01-20T11:09:51.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.705+0000 7f582d600640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f580806aed0 0x7f580806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:51.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.705+0000 7f582d600640 1 -- 172.21.15.162:0/1544299056 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5828088990 con 0x7f583015a380 2024-01-20T11:09:51.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.705+0000 7f5835400640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f580806aed0 0x7f580806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:51.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.706+0000 7f5835400640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f580806aed0 0x7f580806d390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5820036000 tx=0x7f5820030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:51.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.709+0000 7f582d600640 1 -- 172.21.15.162:0/1544299056 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5830146030 con 0x7f583015a380 2024-01-20T11:09:51.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.906+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58300b2ec0 con 0x7f583015a380 2024-01-20T11:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.907+0000 7f582d600640 1 -- 172.21.15.162:0/1544299056 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58300b2ec0 con 0x7f583015a380 2024-01-20T11:09:51.908 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:09:51.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f580806aed0 msgr2=0x7f580806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f580806aed0 0x7f580806d390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5820036000 tx=0x7f5820030000 comp rx=0 tx=0).stop 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 msgr2=0x7f5830144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f5830144260 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f582800c780 tx=0x7f582800cc40 comp rx=0 tx=0).stop 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 shutdown_connections 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f583015a380 0x7f5830144260 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58300cf060 0x7f5830144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f580806aed0 0x7f580806d390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 --2- 172.21.15.162:0/1544299056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58300b2040 0x7f58301476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 >> 172.21.15.162:0/1544299056 conn(0x7f583006a600 msgr2=0x7f5830071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 shutdown_connections 2024-01-20T11:09:51.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:51.910+0000 7f5837e00640 1 -- 172.21.15.162:0/1544299056 wait complete. 2024-01-20T11:09:51.930 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:09:52.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.143+0000 7f9c60c00640 1 Processor -- start 2024-01-20T11:09:52.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.143+0000 7f9c60c00640 1 -- start start 2024-01-20T11:09:52.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c60c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9c5c070d20 0x7f9c5c0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c60c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c5c0cf960 0x7f9c5c0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c60c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0cd300 con 0x7f9c5c143c70 2024-01-20T11:09:52.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c60c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0711b0 con 0x7f9c5c070d20 2024-01-20T11:09:52.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c60c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cfd40 con 0x7f9c5c0cf960 2024-01-20T11:09:52.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9c5c070d20 0x7f9c5c0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5aa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9c5c070d20 0x7f9c5c0cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57056/0 (socket says 172.21.15.162:57056) 2024-01-20T11:09:52.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9c5c143c70 0x7f9c5c0b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57700/0 (socket says 172.21.15.162:57700) 2024-01-20T11:09:52.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5aa00640 1 -- 172.21.15.162:0/1814150679 learned_addr learned my addr 172.21.15.162:0/1814150679 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5be00640 1 --2- 172.21.15.162:0/1814150679 >> v2:172.21.15.179:3300/0 conn(0x7f9c5c0cf960 0x7f9c5c0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5aa00640 1 -- 172.21.15.162:0/1814150679 >> v2:172.21.15.179:3300/0 conn(0x7f9c5c0cf960 msgr2=0x7f9c5c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5aa00640 1 --2- 172.21.15.162:0/1814150679 >> v2:172.21.15.179:3300/0 conn(0x7f9c5c0cf960 0x7f9c5c0cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.145+0000 7f9c5aa00640 1 -- 172.21.15.162:0/1814150679 >> v1:172.21.15.162:6789/0 conn(0x7f9c5c143c70 legacy=0x7f9c5c0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.146+0000 7f9c5aa00640 1 -- 172.21.15.162:0/1814150679 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0cc9d0 con 0x7f9c5c070d20 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.146+0000 7f9c5a000640 1 -- 172.21.15.162:0/1814150679 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757159334 0 0) 0x7f9c5c0cd300 con 0x7f9c5c143c70 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.146+0000 7f9c5be00640 1 --2- 172.21.15.162:0/1814150679 >> v2:172.21.15.179:3300/0 conn(0x7f9c5c0cf960 0x7f9c5c0cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:52.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.147+0000 7f9c5aa00640 1 --2- 172.21.15.162:0/1814150679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c070d20 0x7f9c5c0cf420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c072790 tx=0x7f9c4402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4170d8f8a9a72b0e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:52.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.147+0000 7f9c5a000640 1 -- 172.21.15.162:0/1814150679 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44030860 con 0x7f9c5c070d20 2024-01-20T11:09:52.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.147+0000 7f9c5a000640 1 -- 172.21.15.162:0/1814150679 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c440309c0 con 0x7f9c5c070d20 2024-01-20T11:09:52.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.147+0000 7f9c5a000640 1 -- 172.21.15.162:0/1814150679 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44030d50 con 0x7f9c5c070d20 2024-01-20T11:09:52.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.147+0000 7f9c60c00640 1 -- 172.21.15.162:0/1814150679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c070d20 msgr2=0x7f9c5c0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.147+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1814150679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c070d20 0x7f9c5c0cf420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c072790 tx=0x7f9c4402b9a0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.148+0000 7f9c60c00640 1 -- 172.21.15.162:0/1814150679 shutdown_connections 2024-01-20T11:09:52.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.148+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1814150679 >> v2:172.21.15.179:3300/0 conn(0x7f9c5c0cf960 0x7f9c5c0cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.148+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1814150679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c070d20 0x7f9c5c0cf420 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.148+0000 7f9c60c00640 1 -- 172.21.15.162:0/1814150679 >> 172.21.15.162:0/1814150679 conn(0x7f9c5c06aa20 msgr2=0x7f9c5c06ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:52.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.148+0000 7f9c60c00640 1 -- 172.21.15.162:0/1814150679 shutdown_connections 2024-01-20T11:09:52.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.148+0000 7f9c60c00640 1 -- 172.21.15.162:0/1814150679 wait complete. 2024-01-20T11:09:52.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.150+0000 7f9c60c00640 1 Processor -- start 2024-01-20T11:09:52.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.150+0000 7f9c60c00640 1 -- start start 2024-01-20T11:09:52.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c60c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5c070d20 0x7f9c5c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c60c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c5c0cf960 0x7f9c5c1f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c60c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c143c70 0x7f9c5c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c60c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0c5960 con 0x7f9c5c143c70 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c60c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c1f3790 con 0x7f9c5c070d20 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c60c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c1f3a70 con 0x7f9c5c0cf960 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c143c70 0x7f9c5c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c143c70 0x7f9c5c06cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57058/0 (socket says 172.21.15.162:57058) 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5be00640 1 -- 172.21.15.162:0/1728558254 learned_addr learned my addr 172.21.15.162:0/1728558254 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5be00640 1 -- 172.21.15.162:0/1728558254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c5c0cf960 msgr2=0x7f9c5c1f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5be00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c5c0cf960 0x7f9c5c1f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5be00640 1 -- 172.21.15.162:0/1728558254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5c070d20 msgr2=0x7f9c5c0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5b400640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5c070d20 0x7f9c5c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.151+0000 7f9c5be00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5c070d20 0x7f9c5c0c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.152+0000 7f9c5be00640 1 -- 172.21.15.162:0/1728558254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c440094d0 con 0x7f9c5c143c70 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.152+0000 7f9c5be00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c143c70 0x7f9c5c06cf00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400cef0 tx=0x7f9c5400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:52.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.152+0000 7f9c53400640 1 -- 172.21.15.162:0/1728558254 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400d840 con 0x7f9c5c143c70 2024-01-20T11:09:52.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.152+0000 7f9c53400640 1 -- 172.21.15.162:0/1728558254 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400d9c0 con 0x7f9c5c143c70 2024-01-20T11:09:52.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.152+0000 7f9c53400640 1 -- 172.21.15.162:0/1728558254 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400dd70 con 0x7f9c5c143c70 2024-01-20T11:09:52.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.152+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c06c700 con 0x7f9c5c143c70 2024-01-20T11:09:52.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.152+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c1f3d50 con 0x7f9c5c143c70 2024-01-20T11:09:52.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.153+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c06cc20 con 0x7f9c5c143c70 2024-01-20T11:09:52.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.154+0000 7f9c53400640 1 -- 172.21.15.162:0/1728558254 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9c5401e3b0 con 0x7f9c5c143c70 2024-01-20T11:09:52.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.155+0000 7f9c53400640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9c3406aed0 0x7f9c3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.155+0000 7f9c53400640 1 -- 172.21.15.162:0/1728558254 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c5408a1c0 con 0x7f9c5c143c70 2024-01-20T11:09:52.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.155+0000 7f9c5b400640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9c3406aed0 0x7f9c3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.156+0000 7f9c5b400640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9c3406aed0 0x7f9c3406d390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c000f60 tx=0x7f9c4c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:52.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.160+0000 7f9c53400640 1 -- 172.21.15.162:0/1728558254 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9c5c06cc20 con 0x7f9c5c143c70 2024-01-20T11:09:52.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.351+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c5c06cc20 con 0x7f9c5c143c70 2024-01-20T11:09:52.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.352+0000 7f9c53400640 1 -- 172.21.15.162:0/1728558254 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c5c06cc20 con 0x7f9c5c143c70 2024-01-20T11:09:52.353 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:09:52.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9c3406aed0 msgr2=0x7f9c3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9c3406aed0 0x7f9c3406d390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c000f60 tx=0x7f9c4c009040 comp rx=0 tx=0).stop 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c143c70 msgr2=0x7f9c5c06cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c143c70 0x7f9c5c06cf00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400cef0 tx=0x7f9c5400a710 comp rx=0 tx=0).stop 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 shutdown_connections 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c5c143c70 0x7f9c5c06cf00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c5c0cf960 0x7f9c5c1f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f9c3406aed0 0x7f9c3406d390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 --2- 172.21.15.162:0/1728558254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5c070d20 0x7f9c5c0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 >> 172.21.15.162:0/1728558254 conn(0x7f9c5c06aa20 msgr2=0x7f9c5c142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 shutdown_connections 2024-01-20T11:09:52.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.355+0000 7f9c60c00640 1 -- 172.21.15.162:0/1728558254 wait complete. 2024-01-20T11:09:52.375 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:09:52.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.579+0000 7f8308a00640 1 Processor -- start 2024-01-20T11:09:52.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.579+0000 7f8308a00640 1 -- start start 2024-01-20T11:09:52.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8308a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f830406a600 0x7f830406a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8308a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f830406e0c0 0x7f830415f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8308a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830406af20 con 0x7f83040cca20 2024-01-20T11:09:52.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8308a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83040ce8d0 con 0x7f830406a600 2024-01-20T11:09:52.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8308a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83040ccf90 con 0x7f830406e0c0 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8302800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f830406a600 0x7f830406a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8302800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f830406a600 0x7f830406a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57072/0 (socket says 172.21.15.162:57072) 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8302800640 1 -- 172.21.15.162:0/155293742 learned_addr learned my addr 172.21.15.162:0/155293742 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8303200640 1 --2- 172.21.15.162:0/155293742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f830406e0c0 0x7f830415f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.582+0000 7f8302800640 1 -- 172.21.15.162:0/155293742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f830406e0c0 msgr2=0x7f830415f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.583+0000 7f8302800640 1 --2- 172.21.15.162:0/155293742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f830406e0c0 0x7f830415f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.583+0000 7f8302800640 1 -- 172.21.15.162:0/155293742 >> v1:172.21.15.179:6789/0 conn(0x7f83040cca20 legacy=0x7f830415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:52.584 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.583+0000 7f8302800640 1 -- 172.21.15.162:0/155293742 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040cd270 con 0x7f830406a600 2024-01-20T11:09:52.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.584+0000 7f8302800640 1 --2- 172.21.15.162:0/155293742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f830406a9e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f82f40098a0 tx=0x7f82f402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31b43fd39b2bbd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.584+0000 7f8301400640 1 -- 172.21.15.162:0/155293742 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4031640 con 0x7f830406a600 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.584+0000 7f8301400640 1 -- 172.21.15.162:0/155293742 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f40317a0 con 0x7f830406a600 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.584+0000 7f8301400640 1 -- 172.21.15.162:0/155293742 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4031b30 con 0x7f830406a600 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 -- 172.21.15.162:0/155293742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 msgr2=0x7f830406a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 --2- 172.21.15.162:0/155293742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f830406a9e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f82f40098a0 tx=0x7f82f402b8f0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 -- 172.21.15.162:0/155293742 shutdown_connections 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 --2- 172.21.15.162:0/155293742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f830406e0c0 0x7f830415f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 --2- 172.21.15.162:0/155293742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f830406a9e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 -- 172.21.15.162:0/155293742 >> 172.21.15.162:0/155293742 conn(0x7f830406d5a0 msgr2=0x7f830406d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 -- 172.21.15.162:0/155293742 shutdown_connections 2024-01-20T11:09:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.585+0000 7f8308a00640 1 -- 172.21.15.162:0/155293742 wait complete. 2024-01-20T11:09:52.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.587+0000 7f8308a00640 1 Processor -- start 2024-01-20T11:09:52.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.588+0000 7f8308a00640 1 -- start start 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8308a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f83041f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8308a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f830406e0c0 0x7f83040b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8308a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83040cca20 0x7f83040ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8308a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040b41f0 con 0x7f830406a600 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8308a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040b3950 con 0x7f830406e0c0 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8308a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83040b3c30 con 0x7f83040cca20 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8302800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f83041f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8302800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f83041f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57080/0 (socket says 172.21.15.162:57080) 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8302800640 1 -- 172.21.15.162:0/291871326 learned_addr learned my addr 172.21.15.162:0/291871326 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.589+0000 7f8301e00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f830406e0c0 0x7f83040b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f8303200640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83040cca20 0x7f83040ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f8302800640 1 -- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83040cca20 msgr2=0x7f83040ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f8302800640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83040cca20 0x7f83040ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f8302800640 1 -- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f830406e0c0 msgr2=0x7f83040b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f8302800640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f830406e0c0 0x7f83040b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f8302800640 1 -- 172.21.15.162:0/291871326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f40094d0 con 0x7f830406a600 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f8302800640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f83041f6310 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f82f40098a0 tx=0x7f82f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.590+0000 7f82faa00640 1 -- 172.21.15.162:0/291871326 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f403ac60 con 0x7f830406a600 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.591+0000 7f82faa00640 1 -- 172.21.15.162:0/291871326 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f403ade0 con 0x7f830406a600 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.591+0000 7f82faa00640 1 -- 172.21.15.162:0/291871326 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4044630 con 0x7f830406a600 2024-01-20T11:09:52.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.591+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83040b3f10 con 0x7f830406a600 2024-01-20T11:09:52.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.591+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83040b49d0 con 0x7f830406a600 2024-01-20T11:09:52.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.592+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8304140d40 con 0x7f830406a600 2024-01-20T11:09:52.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.593+0000 7f82faa00640 1 -- 172.21.15.162:0/291871326 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f82f402f050 con 0x7f830406a600 2024-01-20T11:09:52.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.594+0000 7f82faa00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f82dc06aed0 0x7f82dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:52.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.594+0000 7f82faa00640 1 -- 172.21.15.162:0/291871326 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82f40ab850 con 0x7f830406a600 2024-01-20T11:09:52.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.594+0000 7f8301e00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f82dc06aed0 0x7f82dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:52.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.595+0000 7f8301e00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f82dc06aed0 0x7f82dc06d390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f82ec006fd0 tx=0x7f82ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:52.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.598+0000 7f82faa00640 1 -- 172.21.15.162:0/291871326 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8304140d40 con 0x7f830406a600 2024-01-20T11:09:52.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.794+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8304140d40 con 0x7f830406a600 2024-01-20T11:09:52.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.795+0000 7f82faa00640 1 -- 172.21.15.162:0/291871326 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8304140d40 con 0x7f830406a600 2024-01-20T11:09:52.795 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f82dc06aed0 msgr2=0x7f82dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f82dc06aed0 0x7f82dc06d390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f82ec006fd0 tx=0x7f82ec008040 comp rx=0 tx=0).stop 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 msgr2=0x7f83041f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f83041f6310 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f82f40098a0 tx=0x7f82f40046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 shutdown_connections 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83040cca20 0x7f83040ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f82dc06aed0 0x7f82dc06d390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f830406e0c0 0x7f83040b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 --2- 172.21.15.162:0/291871326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f830406a600 0x7f83041f6310 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 >> 172.21.15.162:0/291871326 conn(0x7f830406d5a0 msgr2=0x7f83040b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 shutdown_connections 2024-01-20T11:09:52.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:52.798+0000 7f8308a00640 1 -- 172.21.15.162:0/291871326 wait complete. 2024-01-20T11:09:52.816 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T11:09:53.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.018+0000 7f5ba8a00640 1 Processor -- start 2024-01-20T11:09:53.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.018+0000 7f5ba8a00640 1 -- start start 2024-01-20T11:09:53.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.019+0000 7f5ba8a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ba00b2040 0x7f5ba015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.019+0000 7f5ba8a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00cf060 0x7f5ba00cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.019+0000 7f5ba8a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba00b2ec0 con 0x7f5ba015a380 2024-01-20T11:09:53.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.019+0000 7f5ba8a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba0070eb0 con 0x7f5ba00b2040 2024-01-20T11:09:53.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.019+0000 7f5ba8a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba015ee30 con 0x7f5ba00cf060 2024-01-20T11:09:53.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.020+0000 7f5ba6a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00cf060 0x7f5ba00cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.020+0000 7f5ba5600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ba00b2040 0x7f5ba015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.020+0000 7f5ba5600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ba00b2040 0x7f5ba015e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:38666/0 (socket says 172.21.15.162:38666) 2024-01-20T11:09:53.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.020+0000 7f5ba5600640 1 -- 172.21.15.162:0/3226474599 learned_addr learned my addr 172.21.15.162:0/3226474599 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:53.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.021+0000 7f5ba5600640 1 -- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00cf060 msgr2=0x7f5ba00cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:53.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.021+0000 7f5ba5600640 1 --2- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00cf060 0x7f5ba00cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.021+0000 7f5ba5600640 1 -- 172.21.15.162:0/3226474599 >> v1:172.21.15.179:6789/0 conn(0x7f5ba015a380 legacy=0x7f5ba00707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.021+0000 7f5ba5600640 1 -- 172.21.15.162:0/3226474599 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba00ce700 con 0x7f5ba00b2040 2024-01-20T11:09:53.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.021+0000 7f5ba4c00640 1 -- 172.21.15.162:0/3226474599 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776150724 0 0) 0x7f5b90001110 con 0x7f5ba015a380 2024-01-20T11:09:53.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.021+0000 7f5ba6a00640 1 --2- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00cf060 0x7f5ba00cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:09:53.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.022+0000 7f5ba5600640 1 --2- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba00b2040 0x7f5ba015e8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800bb10 tx=0x7f5b8802e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29bd0071c7dce36b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:53.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.022+0000 7f5ba4c00640 1 -- 172.21.15.162:0/3226474599 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8802ee70 con 0x7f5ba00b2040 2024-01-20T11:09:53.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.022+0000 7f5ba4c00640 1 -- 172.21.15.162:0/3226474599 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88036440 con 0x7f5ba00b2040 2024-01-20T11:09:53.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.022+0000 7f5ba4c00640 1 -- 172.21.15.162:0/3226474599 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880367d0 con 0x7f5ba00b2040 2024-01-20T11:09:53.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 -- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba00b2040 msgr2=0x7f5ba015e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba00b2040 0x7f5ba015e8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800bb10 tx=0x7f5b8802e0c0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 -- 172.21.15.162:0/3226474599 shutdown_connections 2024-01-20T11:09:53.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00cf060 0x7f5ba00cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/3226474599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba00b2040 0x7f5ba015e8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 -- 172.21.15.162:0/3226474599 >> 172.21.15.162:0/3226474599 conn(0x7f5ba006a600 msgr2=0x7f5ba006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:53.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 -- 172.21.15.162:0/3226474599 shutdown_connections 2024-01-20T11:09:53.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.023+0000 7f5ba8a00640 1 -- 172.21.15.162:0/3226474599 wait complete. 2024-01-20T11:09:53.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.025+0000 7f5ba8a00640 1 Processor -- start 2024-01-20T11:09:53.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.025+0000 7f5ba8a00640 1 -- start start 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba8a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00b2040 0x7f5ba00c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba00cf060 0x7f5ba0146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba8a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba015a380 0x7f5ba015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba01494a0 con 0x7f5ba00cf060 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba8a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba01471b0 con 0x7f5ba015a380 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba8a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0148890 con 0x7f5ba00b2040 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba00cf060 0x7f5ba0146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba00cf060 0x7f5ba0146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57082/0 (socket says 172.21.15.162:57082) 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.026+0000 7f5ba5600640 1 -- 172.21.15.162:0/1427367242 learned_addr learned my addr 172.21.15.162:0/1427367242 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba6000640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00b2040 0x7f5ba00c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba5600640 1 -- 172.21.15.162:0/1427367242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00b2040 msgr2=0x7f5ba00c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba5600640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00b2040 0x7f5ba00c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba5600640 1 -- 172.21.15.162:0/1427367242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba015a380 msgr2=0x7f5ba015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba5600640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba015a380 0x7f5ba015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba5600640 1 -- 172.21.15.162:0/1427367242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98009a70 con 0x7f5ba00cf060 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba5600640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba00cf060 0x7f5ba0146c70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5b88039040 tx=0x7f5b88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5b9e000640 1 -- 172.21.15.162:0/1427367242 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88004230 con 0x7f5ba00cf060 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5b9e000640 1 -- 172.21.15.162:0/1427367242 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88004390 con 0x7f5ba00cf060 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.027+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8800b770 con 0x7f5ba00cf060 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.028+0000 7f5b9e000640 1 -- 172.21.15.162:0/1427367242 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88003830 con 0x7f5ba00cf060 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.028+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba0148e50 con 0x7f5ba00cf060 2024-01-20T11:09:53.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.029+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba004e970 con 0x7f5ba00cf060 2024-01-20T11:09:53.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.030+0000 7f5b9e000640 1 -- 172.21.15.162:0/1427367242 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5b88003990 con 0x7f5ba00cf060 2024-01-20T11:09:53.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.031+0000 7f5b9e000640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b7806aed0 0x7f5b7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.031+0000 7f5b9e000640 1 -- 172.21.15.162:0/1427367242 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b880abd40 con 0x7f5ba00cf060 2024-01-20T11:09:53.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.031+0000 7f5ba6000640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b7806aed0 0x7f5b7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.032+0000 7f5ba6000640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b7806aed0 0x7f5b7806d390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b90007fd0 tx=0x7f5b90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:53.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.035+0000 7f5b9e000640 1 -- 172.21.15.162:0/1427367242 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5b88076af0 con 0x7f5ba00cf060 2024-01-20T11:09:53.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.241+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ba006d550 con 0x7f5ba00cf060 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.242+0000 7f5b9e000640 1 -- 172.21.15.162:0/1427367242 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5b8807a110 con 0x7f5ba00cf060 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.244+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b7806aed0 msgr2=0x7f5b7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.244+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b7806aed0 0x7f5b7806d390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b90007fd0 tx=0x7f5b90009040 comp rx=0 tx=0).stop 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.244+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba00cf060 msgr2=0x7f5ba0146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.244+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba00cf060 0x7f5ba0146c70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5b88039040 tx=0x7f5b88004730 comp rx=0 tx=0).stop 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 shutdown_connections 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5b7806aed0 0x7f5b7806d390 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba015a380 0x7f5ba015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba00cf060 0x7f5ba0146c70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 --2- 172.21.15.162:0/1427367242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba00b2040 0x7f5ba00c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 >> 172.21.15.162:0/1427367242 conn(0x7f5ba006a600 msgr2=0x7f5ba006c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:53.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 shutdown_connections 2024-01-20T11:09:53.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.245+0000 7f5ba8a00640 1 -- 172.21.15.162:0/1427367242 wait complete. 2024-01-20T11:09:53.264 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-20T11:09:53.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:53.264 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-20T11:09:53.436 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:09:53.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:09:53.437 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T11:09:53.476 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:09:53.476 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:53.514 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:09:53.514 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:09:53.514 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:53.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053860,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-20T11:09:53.557 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:09:53.557 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:09:53.605 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:09:53.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:53.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.815+0000 7f646b000640 1 Processor -- start 2024-01-20T11:09:53.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.815+0000 7f646b000640 1 -- start start 2024-01-20T11:09:53.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.816+0000 7f646b000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6464071260 0x7f64640716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.816+0000 7f646b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646406d7a0 0x7f646406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.816+0000 7f646b000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646415a910 con 0x7f646415a530 2024-01-20T11:09:53.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.816+0000 7f646b000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640ca390 con 0x7f6464071260 2024-01-20T11:09:53.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.816+0000 7f646b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646406e170 con 0x7f646406d7a0 2024-01-20T11:09:53.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.817+0000 7f6463400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6464071260 0x7f64640716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.817+0000 7f6469000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646406d7a0 0x7f646406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.817+0000 7f6463400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6464071260 0x7f64640716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:38682/0 (socket says 172.21.15.162:38682) 2024-01-20T11:09:53.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.817+0000 7f6463400640 1 -- 172.21.15.162:0/1107938187 learned_addr learned my addr 172.21.15.162:0/1107938187 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:53.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.818+0000 7f6469000640 1 -- 172.21.15.162:0/1107938187 >> v2:172.21.15.179:3300/0 conn(0x7f6464071260 msgr2=0x7f64640716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:53.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.818+0000 7f6469000640 1 --2- 172.21.15.162:0/1107938187 >> v2:172.21.15.179:3300/0 conn(0x7f6464071260 0x7f64640716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.818+0000 7f6469000640 1 -- 172.21.15.162:0/1107938187 >> v1:172.21.15.179:6789/0 conn(0x7f646415a530 legacy=0x7f64640cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.818+0000 7f6469000640 1 -- 172.21.15.162:0/1107938187 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464072960 con 0x7f646406d7a0 2024-01-20T11:09:53.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.818+0000 7f6463400640 1 --2- 172.21.15.162:0/1107938187 >> v2:172.21.15.179:3300/0 conn(0x7f6464071260 0x7f64640716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:09:53.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.819+0000 7f6469000640 1 --2- 172.21.15.162:0/1107938187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646406d7a0 0x7f646406dc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f645c009dc0 tx=0x7f645c02e010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf6cfbe21aa5d28 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:53.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.820+0000 7f6462a00640 1 -- 172.21.15.162:0/1107938187 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c02edc0 con 0x7f646406d7a0 2024-01-20T11:09:53.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.820+0000 7f6462a00640 1 -- 172.21.15.162:0/1107938187 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c036440 con 0x7f646406d7a0 2024-01-20T11:09:53.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.820+0000 7f6462a00640 1 -- 172.21.15.162:0/1107938187 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0367d0 con 0x7f646406d7a0 2024-01-20T11:09:53.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.820+0000 7f646b000640 1 -- 172.21.15.162:0/1107938187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646406d7a0 msgr2=0x7f646406dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.820+0000 7f646b000640 1 --2- 172.21.15.162:0/1107938187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646406d7a0 0x7f646406dc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f645c009dc0 tx=0x7f645c02e010 comp rx=0 tx=0).stop 2024-01-20T11:09:53.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.821+0000 7f646b000640 1 -- 172.21.15.162:0/1107938187 shutdown_connections 2024-01-20T11:09:53.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.821+0000 7f646b000640 1 --2- 172.21.15.162:0/1107938187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646406d7a0 0x7f646406dc30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.821+0000 7f646b000640 1 --2- 172.21.15.162:0/1107938187 >> v2:172.21.15.179:3300/0 conn(0x7f6464071260 0x7f64640716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.821+0000 7f646b000640 1 -- 172.21.15.162:0/1107938187 >> 172.21.15.162:0/1107938187 conn(0x7f64640b0cd0 msgr2=0x7f64640b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:53.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.821+0000 7f646b000640 1 -- 172.21.15.162:0/1107938187 shutdown_connections 2024-01-20T11:09:53.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.821+0000 7f646b000640 1 -- 172.21.15.162:0/1107938187 wait complete. 2024-01-20T11:09:53.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.822+0000 7f646b000640 1 Processor -- start 2024-01-20T11:09:53.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.823+0000 7f646b000640 1 -- start start 2024-01-20T11:09:53.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.823+0000 7f646b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646406d7a0 0x7f64641ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.823+0000 7f646b000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464071260 0x7f646415af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.823+0000 7f646b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646415a530 0x7f64640ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.823+0000 7f646b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646409bfb0 con 0x7f646406d7a0 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.823+0000 7f646b000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646409a230 con 0x7f6464071260 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.823+0000 7f646b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64641efd00 con 0x7f646415a530 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646406d7a0 0x7f64641ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646406d7a0 0x7f64641ef7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57086/0 (socket says 172.21.15.162:57086) 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 -- 172.21.15.162:0/2246059306 learned_addr learned my addr 172.21.15.162:0/2246059306 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463400640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464071260 0x7f646415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6469000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646415a530 0x7f64640ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 -- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646415a530 msgr2=0x7f64640ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646415a530 0x7f64640ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 -- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464071260 msgr2=0x7f646415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464071260 0x7f646415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:53.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463e00640 1 -- 172.21.15.162:0/2246059306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0094d0 con 0x7f646406d7a0 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6463400640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464071260 0x7f646415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.824+0000 7f6469000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646415a530 0x7f64640ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.825+0000 7f6463e00640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646406d7a0 0x7f64641ef7c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f645400c3f0 tx=0x7f645400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.825+0000 7f645be00640 1 -- 172.21.15.162:0/2246059306 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540052d0 con 0x7f646406d7a0 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.825+0000 7f645be00640 1 -- 172.21.15.162:0/2246059306 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454005450 con 0x7f646406d7a0 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.825+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c009a70 con 0x7f646406d7a0 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.825+0000 7f645be00640 1 -- 172.21.15.162:0/2246059306 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454007260 con 0x7f646406d7a0 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.825+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646409b8f0 con 0x7f646406d7a0 2024-01-20T11:09:53.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.826+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646409b700 con 0x7f646406d7a0 2024-01-20T11:09:53.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.827+0000 7f645be00640 1 -- 172.21.15.162:0/2246059306 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f64540073c0 con 0x7f646406d7a0 2024-01-20T11:09:53.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.828+0000 7f645be00640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f643c06aed0 0x7f643c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:53.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.828+0000 7f645be00640 1 -- 172.21.15.162:0/2246059306 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64540888e0 con 0x7f646406d7a0 2024-01-20T11:09:53.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.829+0000 7f6463400640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f643c06aed0 0x7f643c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:53.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.829+0000 7f6463400640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f643c06aed0 0x7f643c06d390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f646406e0a0 tx=0x7f644c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:53.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:53.833+0000 7f645be00640 1 -- 172.21.15.162:0/2246059306 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f64540537b0 con 0x7f646406d7a0 2024-01-20T11:09:54.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.063+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f646404e970 con 0x7f646406d7a0 2024-01-20T11:09:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.064+0000 7f645be00640 1 -- 172.21.15.162:0/2246059306 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f6454056dd0 con 0x7f646406d7a0 2024-01-20T11:09:54.065 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:54.065 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3643822826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3643822826},{"type":"v1","addr":"172.21.15.162:6837","nonce":3643822826}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3084491175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3084491175},{"type":"v1","addr":"172.21.15.179:6834","nonce":3084491175}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3459133230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3459133230},{"type":"v1","addr":"172.21.15.162:6836","nonce":3459133230}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:09:26.112913+0000","modified":"2024-01-20T11:09:29.172569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/4241600456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4241600456},{"type":"v1","addr":"172.21.15.179:6835","nonce":4241600456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T11:09:54.065 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 23 2024-01-20T11:09:54.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f643c06aed0 msgr2=0x7f643c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f643c06aed0 0x7f643c06d390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f646406e0a0 tx=0x7f644c008040 comp rx=0 tx=0).stop 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646406d7a0 msgr2=0x7f64641ef7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646406d7a0 0x7f64641ef7c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f645400c3f0 tx=0x7f645400c8b0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 shutdown_connections 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f646415a530 0x7f64640ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f643c06aed0 0x7f643c06d390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464071260 0x7f646415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 --2- 172.21.15.162:0/2246059306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f646406d7a0 0x7f64641ef7c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 >> 172.21.15.162:0/2246059306 conn(0x7f64640b0cd0 msgr2=0x7f64640cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 shutdown_connections 2024-01-20T11:09:54.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.067+0000 7f646b000640 1 -- 172.21.15.162:0/2246059306 wait complete. 2024-01-20T11:09:54.086 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:54.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.290+0000 7fa3c6a00640 1 Processor -- start 2024-01-20T11:09:54.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.290+0000 7fa3c6a00640 1 -- start start 2024-01-20T11:09:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.291+0000 7fa3c6a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 0x7fa3c00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3c6a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3c0070630 0x7fa3c00adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3c6a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c0070b60 con 0x7fa3c015c6e0 2024-01-20T11:09:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3c6a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c015ba10 con 0x7fa3c0070630 2024-01-20T11:09:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3c6a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c015bc00 con 0x7fa3c0155a30 2024-01-20T11:09:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3c4a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa3c015c6e0 0x7fa3c006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57708/0 (socket says 172.21.15.162:57708) 2024-01-20T11:09:54.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1770277425 learned_addr learned my addr 172.21.15.162:0/1770277425 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:54.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3bfe00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 0x7fa3c00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3bf400640 1 --2- 172.21.15.162:0/1770277425 >> v2:172.21.15.179:3300/0 conn(0x7fa3c0070630 0x7fa3c00adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715710194 0 0) 0x7fa3c0070b60 con 0x7fa3c015c6e0 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.292+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a0003520 con 0x7fa3c015c6e0 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458814576 0 0) 0x7fa3a0003520 con 0x7fa3c015c6e0 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 msgr2=0x7fa3c00ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 0x7fa3c00ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 >> v2:172.21.15.179:3300/0 conn(0x7fa3c0070630 msgr2=0x7fa3c00adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 --2- 172.21.15.162:0/1770277425 >> v2:172.21.15.179:3300/0 conn(0x7fa3c0070630 0x7fa3c00adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c015bee0 con 0x7fa3c015c6e0 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fa3b80019f0 con 0x7fa3c015c6e0 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 >> v1:172.21.15.162:6789/0 conn(0x7fa3c015c6e0 legacy=0x7fa3c006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 0x7fa3a0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3a0003f40 0x7fa3a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a0004d00 0x7fa3a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c015bc00 con 0x7fa3a0004d00 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a000ba60 con 0x7fa3a0003f40 2024-01-20T11:09:54.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a000bc20 con 0x7fa3c0155a30 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bf400640 1 --2- 172.21.15.162:0/1770277425 >> v2:172.21.15.179:3300/0 conn(0x7fa3c0070630 0x7fa3c00adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3c4a00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a0004d00 0x7fa3a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.293+0000 7fa3bfe00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 0x7fa3a0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.294+0000 7fa3bf400640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3a0003f40 0x7fa3a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.294+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 msgr2=0x7fa3a0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.294+0000 7fa3c4a00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3c0155a30 0x7fa3a0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.294+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3a0003f40 msgr2=0x7fa3a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.294+0000 7fa3c4a00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3a0003f40 0x7fa3a00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.294+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1770277425 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0003520 con 0x7fa3a0004d00 2024-01-20T11:09:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.295+0000 7fa3c4a00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a0004d00 0x7fa3a0005180 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800a760 tx=0x7fa3a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360caad69b15e03e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.295+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8034630 con 0x7fa3a0004d00 2024-01-20T11:09:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.295+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b802f070 con 0x7fa3a0004d00 2024-01-20T11:09:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.295+0000 7fa3bea00640 1 -- 172.21.15.162:0/1770277425 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80349d0 con 0x7fa3a0004d00 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.295+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1770277425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a0004d00 msgr2=0x7fa3a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.295+0000 7fa3c6a00640 1 --2- 172.21.15.162:0/1770277425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a0004d00 0x7fa3a0005180 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800a760 tx=0x7fa3a00057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.296+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1770277425 reap_dead start 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.296+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1770277425 shutdown_connections 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.296+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1770277425 >> 172.21.15.162:0/1770277425 conn(0x7fa3c00b0cd0 msgr2=0x7fa3c00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.296+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1770277425 shutdown_connections 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.296+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1770277425 wait complete. 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.298+0000 7fa3c6a00640 1 Processor -- start 2024-01-20T11:09:54.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.298+0000 7fa3c6a00640 1 -- start start 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c6a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3a0004d00 0x7fa3c0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c6a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3c00cf000 0x7fa3c00cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c009b4b0 0x7fa3c009b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c6a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00cf9a0 con 0x7fa3c009b4b0 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c6a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00ae600 con 0x7fa3c00cf000 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c6a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00b2250 con 0x7fa3a0004d00 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c009b4b0 0x7fa3c009b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c009b4b0 0x7fa3c009b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57100/0 (socket says 172.21.15.162:57100) 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.299+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1246631711 learned_addr learned my addr 172.21.15.162:0/1246631711 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3bfe00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3a0004d00 0x7fa3c0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3bf400640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3c00cf000 0x7fa3c00cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3a0004d00 msgr2=0x7fa3c0149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3c4a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3a0004d00 0x7fa3c0149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3c00cf000 msgr2=0x7fa3c00cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3c4a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3c00cf000 0x7fa3c00cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3c4a00640 1 -- 172.21.15.162:0/1246631711 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c0155f90 con 0x7fa3c009b4b0 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3bf400640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3c00cf000 0x7fa3c00cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3c4a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c009b4b0 0x7fa3c009b930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa3b802cb80 tx=0x7fa3c0071300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3b7e00640 1 -- 172.21.15.162:0/1246631711 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8034630 con 0x7fa3c009b4b0 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3b7e00640 1 -- 172.21.15.162:0/1246631711 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8034790 con 0x7fa3c009b4b0 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3b7e00640 1 -- 172.21.15.162:0/1246631711 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8034b00 con 0x7fa3c009b4b0 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.300+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c009be70 con 0x7fa3c009b4b0 2024-01-20T11:09:54.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.301+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c00adcd0 con 0x7fa3c009b4b0 2024-01-20T11:09:54.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.302+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c00ae770 con 0x7fa3c009b4b0 2024-01-20T11:09:54.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.303+0000 7fa3b7e00640 1 -- 172.21.15.162:0/1246631711 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa3b8031030 con 0x7fa3c009b4b0 2024-01-20T11:09:54.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.304+0000 7fa3b7e00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa39806af00 0x7fa39806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.304+0000 7fa3b7e00640 1 -- 172.21.15.162:0/1246631711 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3b80ab850 con 0x7fa3c009b4b0 2024-01-20T11:09:54.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.304+0000 7fa3bfe00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa39806af00 0x7fa39806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.305+0000 7fa3bfe00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa39806af00 0x7fa39806d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009a10 tx=0x7fa3b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:54.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.308+0000 7fa3b7e00640 1 -- 172.21.15.162:0/1246631711 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa3b8076680 con 0x7fa3c009b4b0 2024-01-20T11:09:54.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.501+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3c00ae770 con 0x7fa3c009b4b0 2024-01-20T11:09:54.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.504+0000 7fa3b7e00640 1 -- 172.21.15.162:0/1246631711 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16538 (secure 0 0 0) 0x7fa3b8079ca0 con 0x7fa3c009b4b0 2024-01-20T11:09:54.505 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:54.505 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":47,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:27.671415+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:09:23.943994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-20T11:09:25.120343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:54.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.506+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa39806af00 msgr2=0x7fa39806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.506+0000 7fa3c6a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa39806af00 0x7fa39806d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009a10 tx=0x7fa3b0008040 comp rx=0 tx=0).stop 2024-01-20T11:09:54.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.506+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c009b4b0 msgr2=0x7fa3c009b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.506+0000 7fa3c6a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c009b4b0 0x7fa3c009b930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa3b802cb80 tx=0x7fa3c0071300 comp rx=0 tx=0).stop 2024-01-20T11:09:54.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 shutdown_connections 2024-01-20T11:09:54.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c009b4b0 0x7fa3c009b930 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa39806af00 0x7fa39806d3c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3c00cf000 0x7fa3c00cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 --2- 172.21.15.162:0/1246631711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3a0004d00 0x7fa3c0149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 >> 172.21.15.162:0/1246631711 conn(0x7fa3c00b0cd0 msgr2=0x7fa3c00ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:54.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 shutdown_connections 2024-01-20T11:09:54.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.507+0000 7fa3c6a00640 1 -- 172.21.15.162:0/1246631711 wait complete. 2024-01-20T11:09:54.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T11:07:25.650897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T11:09:23.943994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T11:09:25.120343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T11:09:54.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T11:09:54.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.743+0000 7fa6e6800640 1 Processor -- start 2024-01-20T11:09:54.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.743+0000 7fa6e6800640 1 -- start start 2024-01-20T11:09:54.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.745+0000 7fa6e6800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa6e0141bb0 0x7fa6e00ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.745+0000 7fa6e6800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00ce6a0 0x7fa6e006c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.745+0000 7fa6e6800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00cee70 con 0x7fa6e00cdc30 2024-01-20T11:09:54.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.745+0000 7fa6e6800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e00cd7a0 con 0x7fa6e0141bb0 2024-01-20T11:09:54.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.745+0000 7fa6e6800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00ceb90 con 0x7fa6e00ce6a0 2024-01-20T11:09:54.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.746+0000 7fa6df400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa6e0141bb0 0x7fa6e00ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.746+0000 7fa6d7e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00ce6a0 0x7fa6e006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.746+0000 7fa6dfe00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa6e00cdc30 0x7fa6e015f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:41340/0 (socket says 172.21.15.162:41340) 2024-01-20T11:09:54.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.746+0000 7fa6dfe00640 1 -- 172.21.15.162:0/591562223 learned_addr learned my addr 172.21.15.162:0/591562223 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:54.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.746+0000 7fa6dea00640 1 -- 172.21.15.162:0/591562223 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178300892 0 0) 0x7fa6d8001490 con 0x7fa6e00cdc30 2024-01-20T11:09:54.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.746+0000 7fa6dea00640 1 -- 172.21.15.162:0/591562223 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c0003520 con 0x7fa6e00cdc30 2024-01-20T11:09:54.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.747+0000 7fa6df400640 1 -- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00ce6a0 msgr2=0x7fa6e006c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:54.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.747+0000 7fa6df400640 1 --2- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00ce6a0 0x7fa6e006c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.747+0000 7fa6df400640 1 -- 172.21.15.162:0/591562223 >> v1:172.21.15.179:6789/0 conn(0x7fa6e00cdc30 legacy=0x7fa6e015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.747+0000 7fa6df400640 1 -- 172.21.15.162:0/591562223 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00cd150 con 0x7fa6e0141bb0 2024-01-20T11:09:54.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.747+0000 7fa6d7e00640 1 --2- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00ce6a0 0x7fa6e006c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:09:54.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.748+0000 7fa6df400640 1 --2- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e0141bb0 0x7fa6e00ce160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097a0 tx=0x7fa6d002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bebf5ceb0fe02f6d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:54.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.749+0000 7fa6dea00640 1 -- 172.21.15.162:0/591562223 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d002e070 con 0x7fa6e0141bb0 2024-01-20T11:09:54.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.749+0000 7fa6dea00640 1 -- 172.21.15.162:0/591562223 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d00315a0 con 0x7fa6e0141bb0 2024-01-20T11:09:54.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.749+0000 7fa6dea00640 1 -- 172.21.15.162:0/591562223 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0031930 con 0x7fa6e0141bb0 2024-01-20T11:09:54.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 -- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e0141bb0 msgr2=0x7fa6e00ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 --2- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e0141bb0 0x7fa6e00ce160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097a0 tx=0x7fa6d002b840 comp rx=0 tx=0).stop 2024-01-20T11:09:54.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 -- 172.21.15.162:0/591562223 shutdown_connections 2024-01-20T11:09:54.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 --2- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00ce6a0 0x7fa6e006c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 --2- 172.21.15.162:0/591562223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e0141bb0 0x7fa6e00ce160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 -- 172.21.15.162:0/591562223 >> 172.21.15.162:0/591562223 conn(0x7fa6e006a600 msgr2=0x7fa6e006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:54.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 -- 172.21.15.162:0/591562223 shutdown_connections 2024-01-20T11:09:54.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.750+0000 7fa6e6800640 1 -- 172.21.15.162:0/591562223 wait complete. 2024-01-20T11:09:54.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.752+0000 7fa6e6800640 1 Processor -- start 2024-01-20T11:09:54.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.752+0000 7fa6e6800640 1 -- start start 2024-01-20T11:09:54.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6e6800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00cdc30 0x7fa6e0151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6e6800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e00ce6a0 0x7fa6e01f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6e6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e0141bb0 0x7fa6e013a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6e6800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e01f3640 con 0x7fa6e0141bb0 2024-01-20T11:09:54.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6e6800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e013b180 con 0x7fa6e00ce6a0 2024-01-20T11:09:54.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6e6800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e01539e0 con 0x7fa6e00cdc30 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6dfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e0141bb0 0x7fa6e013a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6dfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e0141bb0 0x7fa6e013a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57116/0 (socket says 172.21.15.162:57116) 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.753+0000 7fa6dfe00640 1 -- 172.21.15.162:0/709310607 learned_addr learned my addr 172.21.15.162:0/709310607 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6df400640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00cdc30 0x7fa6e0151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6d7e00640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e00ce6a0 0x7fa6e01f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6dfe00640 1 -- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00cdc30 msgr2=0x7fa6e0151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6dfe00640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00cdc30 0x7fa6e0151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6dfe00640 1 -- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e00ce6a0 msgr2=0x7fa6e01f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6dfe00640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e00ce6a0 0x7fa6e01f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6dfe00640 1 -- 172.21.15.162:0/709310607 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8009400 con 0x7fa6e0141bb0 2024-01-20T11:09:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6dfe00640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e0141bb0 0x7fa6e013a4c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800cb70 tx=0x7fa6d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:54.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6d7400640 1 -- 172.21.15.162:0/709310607 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800ad40 con 0x7fa6e0141bb0 2024-01-20T11:09:54.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6d7400640 1 -- 172.21.15.162:0/709310607 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d8012400 con 0x7fa6e0141bb0 2024-01-20T11:09:54.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6d7400640 1 -- 172.21.15.162:0/709310607 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800aea0 con 0x7fa6e0141bb0 2024-01-20T11:09:54.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d0009400 con 0x7fa6e0141bb0 2024-01-20T11:09:54.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.754+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e013ea80 con 0x7fa6e0141bb0 2024-01-20T11:09:54.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.756+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e004e970 con 0x7fa6e0141bb0 2024-01-20T11:09:54.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.756+0000 7fa6d7400640 1 -- 172.21.15.162:0/709310607 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa6d8007070 con 0x7fa6e0141bb0 2024-01-20T11:09:54.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.757+0000 7fa6d7400640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa6b806aed0 0x7fa6b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:54.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.757+0000 7fa6d7400640 1 -- 172.21.15.162:0/709310607 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6d8089450 con 0x7fa6e0141bb0 2024-01-20T11:09:54.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.758+0000 7fa6df400640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa6b806aed0 0x7fa6b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:54.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.758+0000 7fa6df400640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa6b806aed0 0x7fa6b806d390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0036000 tx=0x7fa6d003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:54.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.762+0000 7fa6d7400640 1 -- 172.21.15.162:0/709310607 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa6d80543b0 con 0x7fa6e0141bb0 2024-01-20T11:09:54.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.951+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6e00cee70 con 0x7fa6e0141bb0 2024-01-20T11:09:54.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.952+0000 7fa6d7400640 1 -- 172.21.15.162:0/709310607 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6e00cee70 con 0x7fa6e0141bb0 2024-01-20T11:09:54.953 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa6b806aed0 msgr2=0x7fa6b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa6b806aed0 0x7fa6b806d390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0036000 tx=0x7fa6d003d040 comp rx=0 tx=0).stop 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e0141bb0 msgr2=0x7fa6e013a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e0141bb0 0x7fa6e013a4c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800cb70 tx=0x7fa6d800a430 comp rx=0 tx=0).stop 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 shutdown_connections 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e0141bb0 0x7fa6e013a4c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa6b806aed0 0x7fa6b806d390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6e00ce6a0 0x7fa6e01f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 --2- 172.21.15.162:0/709310607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6e00cdc30 0x7fa6e0151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 >> 172.21.15.162:0/709310607 conn(0x7fa6e006a600 msgr2=0x7fa6e01372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:54.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 shutdown_connections 2024-01-20T11:09:54.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:54.955+0000 7fa6e6800640 1 -- 172.21.15.162:0/709310607 wait complete. 2024-01-20T11:09:54.974 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T11:09:55.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.183+0000 7fc3e4a00640 1 Processor -- start 2024-01-20T11:09:55.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.184+0000 7fc3e4a00640 1 -- start start 2024-01-20T11:09:55.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e4a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3dc0b91e0 0x7fc3dc0d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e4a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3dc0d19a0 0x7fc3dc0b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e4a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc0b6f30 con 0x7fc3dc15d750 2024-01-20T11:09:55.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e4a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc15db30 con 0x7fc3dc0b91e0 2024-01-20T11:09:55.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e4a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0b7210 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e2000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc3dc15d750 0x7fc3dc0b6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57716/0 (socket says 172.21.15.162:57716) 2024-01-20T11:09:55.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e2000640 1 -- 172.21.15.162:0/385501437 learned_addr learned my addr 172.21.15.162:0/385501437 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.185+0000 7fc3e1600640 1 --2- 172.21.15.162:0/385501437 >> v2:172.21.15.162:3300/0 conn(0x7fc3dc0b91e0 0x7fc3dc0d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.186+0000 7fc3e0c00640 1 -- 172.21.15.162:0/385501437 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852945491 0 0) 0x7fc3dc0b6f30 con 0x7fc3dc15d750 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.186+0000 7fc3e2a00640 1 --2- 172.21.15.162:0/385501437 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc0d19a0 0x7fc3dc0b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.186+0000 7fc3e0c00640 1 -- 172.21.15.162:0/385501437 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3bc003520 con 0x7fc3dc15d750 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.186+0000 7fc3e1600640 1 -- 172.21.15.162:0/385501437 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc0d19a0 msgr2=0x7fc3dc0b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.186+0000 7fc3e1600640 1 --2- 172.21.15.162:0/385501437 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc0d19a0 0x7fc3dc0b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.186+0000 7fc3e1600640 1 -- 172.21.15.162:0/385501437 >> v1:172.21.15.162:6789/0 conn(0x7fc3dc15d750 legacy=0x7fc3dc0b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.186+0000 7fc3e1600640 1 -- 172.21.15.162:0/385501437 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0b74f0 con 0x7fc3dc0b91e0 2024-01-20T11:09:55.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.187+0000 7fc3e1600640 1 --2- 172.21.15.162:0/385501437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc0d1460 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0cd910 tx=0x7fc3c402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50469855545d2228 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:55.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.187+0000 7fc3e0c00640 1 -- 172.21.15.162:0/385501437 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c402cc80 con 0x7fc3dc0b91e0 2024-01-20T11:09:55.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.187+0000 7fc3e0c00640 1 -- 172.21.15.162:0/385501437 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c402cde0 con 0x7fc3dc0b91e0 2024-01-20T11:09:55.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.187+0000 7fc3e0c00640 1 -- 172.21.15.162:0/385501437 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4034660 con 0x7fc3dc0b91e0 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 -- 172.21.15.162:0/385501437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0b91e0 msgr2=0x7fc3dc0d1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/385501437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc0d1460 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0cd910 tx=0x7fc3c402bed0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 -- 172.21.15.162:0/385501437 shutdown_connections 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/385501437 >> v2:172.21.15.179:3300/0 conn(0x7fc3dc0d19a0 0x7fc3dc0b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/385501437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc0d1460 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 -- 172.21.15.162:0/385501437 >> 172.21.15.162:0/385501437 conn(0x7fc3dc066760 msgr2=0x7fc3dc066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 -- 172.21.15.162:0/385501437 shutdown_connections 2024-01-20T11:09:55.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.188+0000 7fc3e4a00640 1 -- 172.21.15.162:0/385501437 wait complete. 2024-01-20T11:09:55.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.190+0000 7fc3e4a00640 1 Processor -- start 2024-01-20T11:09:55.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.190+0000 7fc3e4a00640 1 -- start start 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e4a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0d19a0 0x7fc3dc156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e4a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc15d750 0x7fc3dc159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e4a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc1589c0 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e4a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc158400 con 0x7fc3dc0b91e0 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e4a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc1586e0 con 0x7fc3dc15d750 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0d19a0 0x7fc3dc156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0d19a0 0x7fc3dc156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57140/0 (socket says 172.21.15.162:57140) 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e1600640 1 -- 172.21.15.162:0/524452743 learned_addr learned my addr 172.21.15.162:0/524452743 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e2a00640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc15d750 0x7fc3dc159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e1600640 1 -- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc15d750 msgr2=0x7fc3dc159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e2000640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e1600640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc15d750 0x7fc3dc159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.191+0000 7fc3e1600640 1 -- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc0b91e0 msgr2=0x7fc3dc157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3e1600640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3e1600640 1 -- 172.21.15.162:0/524452743 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4009a70 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3e2000640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3e1600640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0d19a0 0x7fc3dc156c30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4037040 tx=0x7fc3c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3da000640 1 -- 172.21.15.162:0/524452743 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4040650 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3da000640 1 -- 172.21.15.162:0/524452743 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c40407b0 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc15de10 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3da000640 1 -- 172.21.15.162:0/524452743 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4040b60 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.192+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc157170 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.193+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc15dc70 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.194+0000 7fc3da000640 1 -- 172.21.15.162:0/524452743 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc3c4040cc0 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.195+0000 7fc3da000640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.195+0000 7fc3da000640 1 -- 172.21.15.162:0/524452743 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3c40ac2e0 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.195+0000 7fc3e2000640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.196+0000 7fc3e2000640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4005880 tx=0x7fc3d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:55.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.199+0000 7fc3da000640 1 -- 172.21.15.162:0/524452743 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc3dc15dc70 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.389+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3dc15e330 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.390+0000 7fc3da000640 1 -- 172.21.15.162:0/524452743 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3dc15e330 con 0x7fc3dc0d19a0 2024-01-20T11:09:55.391 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 msgr2=0x7fc3b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4005880 tx=0x7fc3d4009040 comp rx=0 tx=0).stop 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0d19a0 msgr2=0x7fc3dc156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0d19a0 0x7fc3dc156c30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4037040 tx=0x7fc3c4004a40 comp rx=0 tx=0).stop 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 shutdown_connections 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3dc15d750 0x7fc3dc159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3dc0d19a0 0x7fc3dc156c30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fc3b406aed0 0x7fc3b406d390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 --2- 172.21.15.162:0/524452743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3dc0b91e0 0x7fc3dc157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 >> 172.21.15.162:0/524452743 conn(0x7fc3dc066760 msgr2=0x7fc3dc0d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 shutdown_connections 2024-01-20T11:09:55.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.393+0000 7fc3e4a00640 1 -- 172.21.15.162:0/524452743 wait complete. 2024-01-20T11:09:55.411 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T11:09:55.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.612+0000 7f0ef5800640 1 Processor -- start 2024-01-20T11:09:55.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.612+0000 7f0ef5800640 1 -- start start 2024-01-20T11:09:55.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.613+0000 7f0ef5800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ef00b2040 0x7f0ef015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.613+0000 7f0ef5800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00b2ec0 con 0x7f0ef00cf060 2024-01-20T11:09:55.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.613+0000 7f0ef5800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00ce700 con 0x7f0ef015a380 2024-01-20T11:09:55.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.613+0000 7f0ef5800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef0070eb0 con 0x7f0ef00b2040 2024-01-20T11:09:55.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.614+0000 7f0eee000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ef00b2040 0x7f0ef015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.614+0000 7f0eef400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0ef00cf060 0x7f0ef006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57722/0 (socket says 172.21.15.162:57722) 2024-01-20T11:09:55.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.614+0000 7f0eef400640 1 -- 172.21.15.162:0/3763306026 learned_addr learned my addr 172.21.15.162:0/3763306026 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:55.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.614+0000 7f0eee000640 1 -- 172.21.15.162:0/3763306026 >> v1:172.21.15.179:6789/0 conn(0x7f0ef015a380 legacy=0x7f0ef00707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:55.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.614+0000 7f0eee000640 1 -- 172.21.15.162:0/3763306026 >> v1:172.21.15.162:6789/0 conn(0x7f0ef00cf060 legacy=0x7f0ef006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.614+0000 7f0eee000640 1 -- 172.21.15.162:0/3763306026 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00b2590 con 0x7f0ef00b2040 2024-01-20T11:09:55.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.615+0000 7f0eee000640 1 --2- 172.21.15.162:0/3763306026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef015e8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80097a0 tx=0x7f0ed802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288b731f9439127e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:55.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.615+0000 7f0eed600640 1 -- 172.21.15.162:0/3763306026 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed802e070 con 0x7f0ef00b2040 2024-01-20T11:09:55.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.615+0000 7f0eed600640 1 -- 172.21.15.162:0/3763306026 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80315a0 con 0x7f0ef00b2040 2024-01-20T11:09:55.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.615+0000 7f0eed600640 1 -- 172.21.15.162:0/3763306026 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8031930 con 0x7f0ef00b2040 2024-01-20T11:09:55.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.616+0000 7f0ef5800640 1 -- 172.21.15.162:0/3763306026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 msgr2=0x7f0ef015e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.616+0000 7f0ef5800640 1 --2- 172.21.15.162:0/3763306026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef015e8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80097a0 tx=0x7f0ed802b840 comp rx=0 tx=0).stop 2024-01-20T11:09:55.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.616+0000 7f0ef5800640 1 -- 172.21.15.162:0/3763306026 shutdown_connections 2024-01-20T11:09:55.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.616+0000 7f0ef5800640 1 --2- 172.21.15.162:0/3763306026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef015e8f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.616+0000 7f0ef5800640 1 -- 172.21.15.162:0/3763306026 >> 172.21.15.162:0/3763306026 conn(0x7f0ef006a600 msgr2=0x7f0ef006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:55.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.616+0000 7f0ef5800640 1 -- 172.21.15.162:0/3763306026 shutdown_connections 2024-01-20T11:09:55.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.616+0000 7f0ef5800640 1 -- 172.21.15.162:0/3763306026 wait complete. 2024-01-20T11:09:55.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.618+0000 7f0ef5800640 1 Processor -- start 2024-01-20T11:09:55.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.618+0000 7f0ef5800640 1 -- start start 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0ef5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef0145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0ef5800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef00cf060 0x7f0ef0157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0ef5800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef015a380 0x7f0ef0157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0ef5800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00c8bb0 con 0x7f0ef00b2040 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0ef5800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0158530 con 0x7f0ef00cf060 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0ef5800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0158810 con 0x7f0ef015a380 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0eeea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef0145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0eeea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef0145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57158/0 (socket says 172.21.15.162:57158) 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0eeea00640 1 -- 172.21.15.162:0/2206376509 learned_addr learned my addr 172.21.15.162:0/2206376509 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:55.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.619+0000 7f0eee000640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef00cf060 0x7f0ef0157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0eef400640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef015a380 0x7f0ef0157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0eeea00640 1 -- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef015a380 msgr2=0x7f0ef0157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0eeea00640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef015a380 0x7f0ef0157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0eeea00640 1 -- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef00cf060 msgr2=0x7f0ef0157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0eeea00640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef00cf060 0x7f0ef0157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0eeea00640 1 -- 172.21.15.162:0/2206376509 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009400 con 0x7f0ef00b2040 2024-01-20T11:09:55.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0eeea00640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef0145710 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000b3f0 tx=0x7f0ee000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:55.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2206376509 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0011830 con 0x7f0ef00b2040 2024-01-20T11:09:55.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2206376509 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0011990 con 0x7f0ef00b2040 2024-01-20T11:09:55.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2206376509 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0011d40 con 0x7f0ef00b2040 2024-01-20T11:09:55.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0158af0 con 0x7f0ef00b2040 2024-01-20T11:09:55.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.620+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef01590b0 con 0x7f0ef00b2040 2024-01-20T11:09:55.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.621+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef01592a0 con 0x7f0ef00b2040 2024-01-20T11:09:55.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.622+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2206376509 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0ee001a400 con 0x7f0ef00b2040 2024-01-20T11:09:55.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.623+0000 7f0ee6a00640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:55.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.623+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2206376509 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee0089520 con 0x7f0ef00b2040 2024-01-20T11:09:55.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.623+0000 7f0eee000640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:55.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.624+0000 7f0eee000640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8036000 tx=0x7f0ed803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:55.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.628+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2206376509 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0ee0054350 con 0x7f0ef00b2040 2024-01-20T11:09:55.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.825+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ef004e970 con 0x7f0ef00b2040 2024-01-20T11:09:55.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.826+0000 7f0ee6a00640 1 -- 172.21.15.162:0/2206376509 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ee0057970 con 0x7f0ef00b2040 2024-01-20T11:09:55.827 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 msgr2=0x7f0ec806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8036000 tx=0x7f0ed803d040 comp rx=0 tx=0).stop 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 msgr2=0x7f0ef0145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef0145710 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000b3f0 tx=0x7f0ee000b8b0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 shutdown_connections 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef015a380 0x7f0ef0157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f0ec806aed0 0x7f0ec806d390 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef00cf060 0x7f0ef0157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 --2- 172.21.15.162:0/2206376509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef00b2040 0x7f0ef0145710 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 >> 172.21.15.162:0/2206376509 conn(0x7f0ef006a600 msgr2=0x7f0ef006c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 shutdown_connections 2024-01-20T11:09:55.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:55.829+0000 7f0ef5800640 1 -- 172.21.15.162:0/2206376509 wait complete. 2024-01-20T11:09:55.848 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:56.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.056+0000 7fa4d7600640 1 Processor -- start 2024-01-20T11:09:56.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.056+0000 7fa4d7600640 1 -- start start 2024-01-20T11:09:56.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.057+0000 7fa4d7600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4d015a530 0x7fa4d00cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.057+0000 7fa4d7600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4d0071260 0x7fa4d00716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.057+0000 7fa4d7600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 0x7fa4d006dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d7600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00ca390 con 0x7fa4d015a530 2024-01-20T11:09:56.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d7600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d006e170 con 0x7fa4d0071260 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d7600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015a910 con 0x7fa4d006d7a0 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4d015a530 0x7fa4d00cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4d015a530 0x7fa4d00cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57170/0 (socket says 172.21.15.162:57170) 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 -- 172.21.15.162:0/2100407891 learned_addr learned my addr 172.21.15.162:0/2100407891 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 -- 172.21.15.162:0/2100407891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 msgr2=0x7fa4d006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 --2- 172.21.15.162:0/2100407891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 0x7fa4d006dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 -- 172.21.15.162:0/2100407891 >> v2:172.21.15.179:3300/0 conn(0x7fa4d0071260 msgr2=0x7fa4d00716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 --2- 172.21.15.162:0/2100407891 >> v2:172.21.15.179:3300/0 conn(0x7fa4d0071260 0x7fa4d00716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.058+0000 7fa4d4c00640 1 -- 172.21.15.162:0/2100407891 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0072960 con 0x7fa4d015a530 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.059+0000 7fa4d4c00640 1 --2- 172.21.15.162:0/2100407891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00cddb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009870 tx=0x7fa4c002da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245598cdcdeffc78 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.060+0000 7fa4cfe00640 1 -- 172.21.15.162:0/2100407891 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c002f830 con 0x7fa4d015a530 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.060+0000 7fa4cfe00640 1 -- 172.21.15.162:0/2100407891 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c002f990 con 0x7fa4d015a530 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.060+0000 7fa4cfe00640 1 -- 172.21.15.162:0/2100407891 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c002fd20 con 0x7fa4d015a530 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.060+0000 7fa4d7600640 1 -- 172.21.15.162:0/2100407891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 msgr2=0x7fa4d00cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.060+0000 7fa4d7600640 1 --2- 172.21.15.162:0/2100407891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00cddb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009870 tx=0x7fa4c002da70 comp rx=0 tx=0).stop 2024-01-20T11:09:56.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.061+0000 7fa4d7600640 1 -- 172.21.15.162:0/2100407891 shutdown_connections 2024-01-20T11:09:56.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.061+0000 7fa4d7600640 1 --2- 172.21.15.162:0/2100407891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 0x7fa4d006dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.061+0000 7fa4d7600640 1 --2- 172.21.15.162:0/2100407891 >> v2:172.21.15.179:3300/0 conn(0x7fa4d0071260 0x7fa4d00716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.061+0000 7fa4d7600640 1 --2- 172.21.15.162:0/2100407891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00cddb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.061+0000 7fa4d7600640 1 -- 172.21.15.162:0/2100407891 >> 172.21.15.162:0/2100407891 conn(0x7fa4d00b0cd0 msgr2=0x7fa4d00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:56.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.061+0000 7fa4d7600640 1 -- 172.21.15.162:0/2100407891 shutdown_connections 2024-01-20T11:09:56.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.061+0000 7fa4d7600640 1 -- 172.21.15.162:0/2100407891 wait complete. 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.062+0000 7fa4d7600640 1 Processor -- start 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.063+0000 7fa4d7600640 1 -- start start 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.063+0000 7fa4d7600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 0x7fa4d015d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.063+0000 7fa4d7600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d0071260 0x7fa4d015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d014d7b0 con 0x7fa4d015a530 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d7600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015bf30 con 0x7fa4d0071260 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d7600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d014a2c0 con 0x7fa4d006d7a0 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57172/0 (socket says 172.21.15.162:57172) 2024-01-20T11:09:56.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 -- 172.21.15.162:0/4194527917 learned_addr learned my addr 172.21.15.162:0/4194527917 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 -- 172.21.15.162:0/4194527917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 msgr2=0x7fa4d015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 0x7fa4d015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 -- 172.21.15.162:0/4194527917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d0071260 msgr2=0x7fa4d015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4c7c00640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d0071260 0x7fa4d015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d0071260 0x7fa4d015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.064+0000 7fa4d5600640 1 -- 172.21.15.162:0/4194527917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00094d0 con 0x7fa4d015a530 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.065+0000 7fa4d5600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00aed90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800b970 tx=0x7fa4c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.065+0000 7fa4cd600640 1 -- 172.21.15.162:0/4194527917 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800cb40 con 0x7fa4d015a530 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.065+0000 7fa4cd600640 1 -- 172.21.15.162:0/4194527917 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800ccc0 con 0x7fa4d015a530 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.065+0000 7fa4cd600640 1 -- 172.21.15.162:0/4194527917 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8014680 con 0x7fa4d015a530 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.065+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d015b9f0 con 0x7fa4d015a530 2024-01-20T11:09:56.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.065+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d014a7b0 con 0x7fa4d015a530 2024-01-20T11:09:56.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.066+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d004e970 con 0x7fa4d015a530 2024-01-20T11:09:56.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.067+0000 7fa4cd600640 1 -- 172.21.15.162:0/4194527917 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa4c801d3b0 con 0x7fa4d015a530 2024-01-20T11:09:56.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.068+0000 7fa4cd600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa4a806aed0 0x7fa4a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.068+0000 7fa4cd600640 1 -- 172.21.15.162:0/4194527917 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4c8089700 con 0x7fa4d015a530 2024-01-20T11:09:56.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.068+0000 7fa4d4c00640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa4a806aed0 0x7fa4a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.069+0000 7fa4d4c00640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa4a806aed0 0x7fa4a806d390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0038000 tx=0x7fa4c0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.072+0000 7fa4cd600640 1 -- 172.21.15.162:0/4194527917 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa4c80544a0 con 0x7fa4d015a530 2024-01-20T11:09:56.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.290+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4d00cd680 con 0x7fa4d015a530 2024-01-20T11:09:56.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.290+0000 7fa4cd600640 1 -- 172.21.15.162:0/4194527917 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fa4c8019090 con 0x7fa4d015a530 2024-01-20T11:09:56.291 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:56.291 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3643822826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3643822826},{"type":"v1","addr":"172.21.15.162:6837","nonce":3643822826}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3084491175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3084491175},{"type":"v1","addr":"172.21.15.179:6834","nonce":3084491175}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3459133230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3459133230},{"type":"v1","addr":"172.21.15.162:6836","nonce":3459133230}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:09:26.112913+0000","modified":"2024-01-20T11:09:29.172569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/4241600456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4241600456},{"type":"v1","addr":"172.21.15.179:6835","nonce":4241600456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T11:09:56.291 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 23 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa4a806aed0 msgr2=0x7fa4a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa4a806aed0 0x7fa4a806d390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0038000 tx=0x7fa4c0032000 comp rx=0 tx=0).stop 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 msgr2=0x7fa4d00aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00aed90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800b970 tx=0x7fa4c800be30 comp rx=0 tx=0).stop 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 shutdown_connections 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d015a530 0x7fa4d00aed90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa4a806aed0 0x7fa4a806d390 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d0071260 0x7fa4d015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 --2- 172.21.15.162:0/4194527917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d006d7a0 0x7fa4d015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 >> 172.21.15.162:0/4194527917 conn(0x7fa4d00b0cd0 msgr2=0x7fa4d015e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:56.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 shutdown_connections 2024-01-20T11:09:56.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.293+0000 7fa4d7600640 1 -- 172.21.15.162:0/4194527917 wait complete. 2024-01-20T11:09:56.312 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:56.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.520+0000 7fb75c000640 1 Processor -- start 2024-01-20T11:09:56.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.520+0000 7fb75c000640 1 -- start start 2024-01-20T11:09:56.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.521+0000 7fb75c000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7540ae2c0 0x7fb7540ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.521+0000 7fb75c000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7540cba60 0x7fb7540c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.521+0000 7fb75c000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75406d0a0 con 0x7fb75406daf0 2024-01-20T11:09:56.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.521+0000 7fb75c000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540cee20 con 0x7fb7540cba60 2024-01-20T11:09:56.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.521+0000 7fb75c000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540ca3b0 con 0x7fb7540ae2c0 2024-01-20T11:09:56.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.522+0000 7fb75a000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7540cba60 0x7fb7540c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.522+0000 7fb75a000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7540cba60 0x7fb7540c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39636/0 (socket says 172.21.15.162:39636) 2024-01-20T11:09:56.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.522+0000 7fb75a000640 1 -- 172.21.15.162:0/3289952434 learned_addr learned my addr 172.21.15.162:0/3289952434 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:56.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.522+0000 7fb759600640 1 --2- 172.21.15.162:0/3289952434 >> v2:172.21.15.179:3300/0 conn(0x7fb7540ae2c0 0x7fb7540ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.522+0000 7fb75a000640 1 -- 172.21.15.162:0/3289952434 >> v2:172.21.15.179:3300/0 conn(0x7fb7540ae2c0 msgr2=0x7fb7540ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:56.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.522+0000 7fb75a000640 1 --2- 172.21.15.162:0/3289952434 >> v2:172.21.15.179:3300/0 conn(0x7fb7540ae2c0 0x7fb7540ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.522+0000 7fb75a000640 1 -- 172.21.15.162:0/3289952434 >> v1:172.21.15.179:6789/0 conn(0x7fb75406daf0 legacy=0x7fb754159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:56.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.523+0000 7fb75a000640 1 -- 172.21.15.162:0/3289952434 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540ca690 con 0x7fb7540cba60 2024-01-20T11:09:56.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.524+0000 7fb75a000640 1 --2- 172.21.15.162:0/3289952434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7540c9630 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb7540b1c00 tx=0x7fb74c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0564d328276e059 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.524+0000 7fb753e00640 1 -- 172.21.15.162:0/3289952434 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c02cb20 con 0x7fb7540cba60 2024-01-20T11:09:56.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.524+0000 7fb753e00640 1 -- 172.21.15.162:0/3289952434 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c02cc80 con 0x7fb7540cba60 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.524+0000 7fb753e00640 1 -- 172.21.15.162:0/3289952434 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c0343f0 con 0x7fb7540cba60 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 -- 172.21.15.162:0/3289952434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 msgr2=0x7fb7540c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 --2- 172.21.15.162:0/3289952434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7540c9630 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb7540b1c00 tx=0x7fb74c02bf80 comp rx=0 tx=0).stop 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 -- 172.21.15.162:0/3289952434 shutdown_connections 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 --2- 172.21.15.162:0/3289952434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7540c9630 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 --2- 172.21.15.162:0/3289952434 >> v2:172.21.15.179:3300/0 conn(0x7fb7540ae2c0 0x7fb7540ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 -- 172.21.15.162:0/3289952434 >> 172.21.15.162:0/3289952434 conn(0x7fb7540b0cd0 msgr2=0x7fb7540b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 -- 172.21.15.162:0/3289952434 shutdown_connections 2024-01-20T11:09:56.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.525+0000 7fb75c000640 1 -- 172.21.15.162:0/3289952434 wait complete. 2024-01-20T11:09:56.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.526+0000 7fb75c000640 1 Processor -- start 2024-01-20T11:09:56.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.527+0000 7fb75c000640 1 -- start start 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.527+0000 7fb75c000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb75406daf0 0x7fb7541f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75c000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7540ae2c0 0x7fb7541f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75c000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7541f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75c000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541523d0 con 0x7fb7540cba60 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75c000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541f71d0 con 0x7fb75406daf0 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75c000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541f74b0 con 0x7fb7540ae2c0 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7541f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7541f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39650/0 (socket says 172.21.15.162:39650) 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 -- 172.21.15.162:0/1834082494 learned_addr learned my addr 172.21.15.162:0/1834082494 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb759600640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb75406daf0 0x7fb7541f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb758c00640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7540ae2c0 0x7fb7541f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 -- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7540ae2c0 msgr2=0x7fb7541f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7540ae2c0 0x7fb7541f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 -- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb75406daf0 msgr2=0x7fb7541f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb75406daf0 0x7fb7541f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb75a000640 1 -- 172.21.15.162:0/1834082494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c009b30 con 0x7fb7540cba60 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.528+0000 7fb759600640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb75406daf0 0x7fb7541f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.529+0000 7fb75a000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7541f3c20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb74c036040 tx=0x7fb74c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.529+0000 7fb751600640 1 -- 172.21.15.162:0/1834082494 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c007e70 con 0x7fb7540cba60 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.529+0000 7fb751600640 1 -- 172.21.15.162:0/1834082494 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c009510 con 0x7fb7540cba60 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.529+0000 7fb751600640 1 -- 172.21.15.162:0/1834082494 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c03e690 con 0x7fb7540cba60 2024-01-20T11:09:56.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.529+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7541f7790 con 0x7fb7540cba60 2024-01-20T11:09:56.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.529+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7541f6ee0 con 0x7fb7540cba60 2024-01-20T11:09:56.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.530+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75404e970 con 0x7fb7540cba60 2024-01-20T11:09:56.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.531+0000 7fb751600640 1 -- 172.21.15.162:0/1834082494 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb74c03e7f0 con 0x7fb7540cba60 2024-01-20T11:09:56.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.532+0000 7fb751600640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb72c06aed0 0x7fb72c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.532+0000 7fb751600640 1 -- 172.21.15.162:0/1834082494 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb74c0ac210 con 0x7fb7540cba60 2024-01-20T11:09:56.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.532+0000 7fb759600640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb72c06aed0 0x7fb72c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.533+0000 7fb759600640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb72c06aed0 0x7fb72c06d390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb744006fd0 tx=0x7fb744008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.537+0000 7fb751600640 1 -- 172.21.15.162:0/1834082494 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb74c0771f0 con 0x7fb7540cba60 2024-01-20T11:09:56.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.733+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb75409b8a0 con 0x7fb7540cba60 2024-01-20T11:09:56.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.737+0000 7fb751600640 1 -- 172.21.15.162:0/1834082494 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16538 (secure 0 0 0) 0x7fb74c07a810 con 0x7fb7540cba60 2024-01-20T11:09:56.737 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:56.738 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":47,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:27.671415+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:09:23.943994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-20T11:09:25.120343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb72c06aed0 msgr2=0x7fb72c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb72c06aed0 0x7fb72c06d390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb744006fd0 tx=0x7fb744008040 comp rx=0 tx=0).stop 2024-01-20T11:09:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 msgr2=0x7fb7541f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7541f3c20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb74c036040 tx=0x7fb74c004a40 comp rx=0 tx=0).stop 2024-01-20T11:09:56.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 shutdown_connections 2024-01-20T11:09:56.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540cba60 0x7fb7541f3c20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7540ae2c0 0x7fb7541f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fb72c06aed0 0x7fb72c06d390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 --2- 172.21.15.162:0/1834082494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb75406daf0 0x7fb7541f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.739+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 >> 172.21.15.162:0/1834082494 conn(0x7fb7540b0cd0 msgr2=0x7fb7540cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:56.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.740+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 shutdown_connections 2024-01-20T11:09:56.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.740+0000 7fb75c000640 1 -- 172.21.15.162:0/1834082494 wait complete. 2024-01-20T11:09:56.760 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T11:09:56.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:56.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.970+0000 7fce92e00640 1 Processor -- start 2024-01-20T11:09:56.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.970+0000 7fce92e00640 1 -- start start 2024-01-20T11:09:56.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.971+0000 7fce92e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c15a530 0x7fce8c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.971+0000 7fce92e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce8c071260 0x7fce8c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.971+0000 7fce92e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce8c06d7a0 0x7fce8c06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.971+0000 7fce92e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c0ca390 con 0x7fce8c06d7a0 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.971+0000 7fce92e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c06e170 con 0x7fce8c071260 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.971+0000 7fce92e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15a910 con 0x7fce8c15a530 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce8c06d7a0 0x7fce8c06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce8c06d7a0 0x7fce8c06dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39660/0 (socket says 172.21.15.162:39660) 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 -- 172.21.15.162:0/3310581419 learned_addr learned my addr 172.21.15.162:0/3310581419 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce8be00640 1 --2- 172.21.15.162:0/3310581419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c15a530 0x7fce8c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce83200640 1 --2- 172.21.15.162:0/3310581419 >> v2:172.21.15.179:3300/0 conn(0x7fce8c071260 0x7fce8c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 -- 172.21.15.162:0/3310581419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c15a530 msgr2=0x7fce8c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 --2- 172.21.15.162:0/3310581419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c15a530 0x7fce8c0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 -- 172.21.15.162:0/3310581419 >> v2:172.21.15.179:3300/0 conn(0x7fce8c071260 msgr2=0x7fce8c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:56.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 --2- 172.21.15.162:0/3310581419 >> v2:172.21.15.179:3300/0 conn(0x7fce8c071260 0x7fce8c0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.972+0000 7fce90e00640 1 -- 172.21.15.162:0/3310581419 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c072960 con 0x7fce8c06d7a0 2024-01-20T11:09:56.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.973+0000 7fce90e00640 1 --2- 172.21.15.162:0/3310581419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c06d7a0 0x7fce8c06dc30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0ccaf0 tx=0x7fce8402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1992b03b74bfcdf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce8b400640 1 -- 172.21.15.162:0/3310581419 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8402c9e0 con 0x7fce8c06d7a0 2024-01-20T11:09:56.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce8b400640 1 -- 172.21.15.162:0/3310581419 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8402cb40 con 0x7fce8c06d7a0 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce8b400640 1 -- 172.21.15.162:0/3310581419 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840343f0 con 0x7fce8c06d7a0 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 -- 172.21.15.162:0/3310581419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c06d7a0 msgr2=0x7fce8c06dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 --2- 172.21.15.162:0/3310581419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c06d7a0 0x7fce8c06dc30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0ccaf0 tx=0x7fce8402be40 comp rx=0 tx=0).stop 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 -- 172.21.15.162:0/3310581419 shutdown_connections 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 --2- 172.21.15.162:0/3310581419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c06d7a0 0x7fce8c06dc30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 --2- 172.21.15.162:0/3310581419 >> v2:172.21.15.179:3300/0 conn(0x7fce8c071260 0x7fce8c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 --2- 172.21.15.162:0/3310581419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c15a530 0x7fce8c0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 -- 172.21.15.162:0/3310581419 >> 172.21.15.162:0/3310581419 conn(0x7fce8c0b0cd0 msgr2=0x7fce8c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 -- 172.21.15.162:0/3310581419 shutdown_connections 2024-01-20T11:09:56.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.974+0000 7fce92e00640 1 -- 172.21.15.162:0/3310581419 wait complete. 2024-01-20T11:09:56.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.976+0000 7fce92e00640 1 Processor -- start 2024-01-20T11:09:56.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.976+0000 7fce92e00640 1 -- start start 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.977+0000 7fce92e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c06d7a0 0x7fce8c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.977+0000 7fce92e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c071260 0x7fce8c151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.977+0000 7fce92e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce8c15a530 0x7fce8c0ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.977+0000 7fce92e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15ad10 con 0x7fce8c071260 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.977+0000 7fce92e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c1539e0 con 0x7fce8c15a530 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.977+0000 7fce92e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c154d20 con 0x7fce8c06d7a0 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c071260 0x7fce8c151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c071260 0x7fce8c151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39668/0 (socket says 172.21.15.162:39668) 2024-01-20T11:09:56.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 -- 172.21.15.162:0/494753076 learned_addr learned my addr 172.21.15.162:0/494753076 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce8be00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c06d7a0 0x7fce8c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce90e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce8c15a530 0x7fce8c0ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 -- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c06d7a0 msgr2=0x7fce8c1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c06d7a0 0x7fce8c1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 -- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce8c15a530 msgr2=0x7fce8c0ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce8c15a530 0x7fce8c0ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce83200640 1 -- 172.21.15.162:0/494753076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84009b30 con 0x7fce8c071260 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.978+0000 7fce90e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce8c15a530 0x7fce8c0ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.979+0000 7fce83200640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c071260 0x7fce8c151c90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fce7400d800 tx=0x7fce7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.979+0000 7fce88c00640 1 -- 172.21.15.162:0/494753076 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740096a0 con 0x7fce8c071260 2024-01-20T11:09:56.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.979+0000 7fce88c00640 1 -- 172.21.15.162:0/494753076 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74009800 con 0x7fce8c071260 2024-01-20T11:09:56.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.979+0000 7fce88c00640 1 -- 172.21.15.162:0/494753076 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74009b90 con 0x7fce8c071260 2024-01-20T11:09:56.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.979+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c153c80 con 0x7fce8c071260 2024-01-20T11:09:56.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.979+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c154240 con 0x7fce8c071260 2024-01-20T11:09:56.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.980+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c04e970 con 0x7fce8c071260 2024-01-20T11:09:56.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.981+0000 7fce88c00640 1 -- 172.21.15.162:0/494753076 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fce74009cf0 con 0x7fce8c071260 2024-01-20T11:09:56.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.982+0000 7fce88c00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce6406aed0 0x7fce6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:56.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.983+0000 7fce88c00640 1 -- 172.21.15.162:0/494753076 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce74089c00 con 0x7fce8c071260 2024-01-20T11:09:56.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.983+0000 7fce8be00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce6406aed0 0x7fce6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:56.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.983+0000 7fce8be00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce6406aed0 0x7fce6406d390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006fd0 tx=0x7fce7c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:56.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:56.987+0000 7fce88c00640 1 -- 172.21.15.162:0/494753076 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fce74054a30 con 0x7fce8c071260 2024-01-20T11:09:57.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.220+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce8c0cd680 con 0x7fce8c071260 2024-01-20T11:09:57.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.222+0000 7fce88c00640 1 -- 172.21.15.162:0/494753076 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fce7400b440 con 0x7fce8c071260 2024-01-20T11:09:57.222 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:57.222 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3643822826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3643822826},{"type":"v1","addr":"172.21.15.162:6837","nonce":3643822826}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3084491175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3084491175},{"type":"v1","addr":"172.21.15.179:6834","nonce":3084491175}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3459133230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3459133230},{"type":"v1","addr":"172.21.15.162:6836","nonce":3459133230}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:09:26.112913+0000","modified":"2024-01-20T11:09:29.172569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/4241600456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4241600456},{"type":"v1","addr":"172.21.15.179:6835","nonce":4241600456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T11:09:57.223 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 23 2024-01-20T11:09:57.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.224+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce6406aed0 msgr2=0x7fce6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.224+0000 7fce92e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce6406aed0 0x7fce6406d390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006fd0 tx=0x7fce7c008040 comp rx=0 tx=0).stop 2024-01-20T11:09:57.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.224+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c071260 msgr2=0x7fce8c151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c071260 0x7fce8c151c90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fce7400d800 tx=0x7fce7400dcc0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 shutdown_connections 2024-01-20T11:09:57.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fce6406aed0 0x7fce6406d390 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce8c15a530 0x7fce8c0ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce8c071260 0x7fce8c151c90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 --2- 172.21.15.162:0/494753076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8c06d7a0 0x7fce8c1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 >> 172.21.15.162:0/494753076 conn(0x7fce8c0b0cd0 msgr2=0x7fce8c0ac040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:57.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 shutdown_connections 2024-01-20T11:09:57.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.225+0000 7fce92e00640 1 -- 172.21.15.162:0/494753076 wait complete. 2024-01-20T11:09:57.243 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:09:57.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.441+0000 7fcedac00640 1 Processor -- start 2024-01-20T11:09:57.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.441+0000 7fcedac00640 1 -- start start 2024-01-20T11:09:57.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.442+0000 7fcedac00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fced4070630 0x7fced40adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.442+0000 7fcedac00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 0x7fced40ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.442+0000 7fcedac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4070b60 con 0x7fced4155a30 2024-01-20T11:09:57.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.442+0000 7fcedac00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced415ba10 con 0x7fced4070630 2024-01-20T11:09:57.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.442+0000 7fcedac00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced415bc00 con 0x7fced415c6e0 2024-01-20T11:09:57.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.443+0000 7fced3e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fced4155a30 0x7fced40ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33924/0 (socket says 172.21.15.162:33924) 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.443+0000 7fced3e00640 1 -- 172.21.15.162:0/514902630 learned_addr learned my addr 172.21.15.162:0/514902630 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.443+0000 7fcecb200640 1 --2- 172.21.15.162:0/514902630 >> v2:172.21.15.179:3300/0 conn(0x7fced4070630 0x7fced40adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.443+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811348041 0 0) 0x7fced4070b60 con 0x7fced4155a30 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.443+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb4003520 con 0x7fced4155a30 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.443+0000 7fced8c00640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 0x7fced40ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.443+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3474936497 0 0) 0x7fceb4003520 con 0x7fced4155a30 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 msgr2=0x7fced40ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 0x7fced40ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 >> v2:172.21.15.179:3300/0 conn(0x7fced4070630 msgr2=0x7fced40adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 --2- 172.21.15.162:0/514902630 >> v2:172.21.15.179:3300/0 conn(0x7fced4070630 0x7fced40adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced415bee0 con 0x7fced4155a30 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fcec4001670 con 0x7fced4155a30 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 >> v1:172.21.15.162:6789/0 conn(0x7fced4155a30 legacy=0x7fced40ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 0x7fceb4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fceb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fceb4004d00 0x7fceb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced415bc00 con 0x7fceb4003f40 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb400b980 con 0x7fceb4004d00 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb400bac0 con 0x7fced415c6e0 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fcecb200640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fceb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced3e00640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 0x7fceb4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fcecb200640 1 -- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 msgr2=0x7fceb4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fced8c00640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fceb4004d00 0x7fceb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fcecb200640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced415c6e0 0x7fceb4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fcecb200640 1 -- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fceb4004d00 msgr2=0x7fceb4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:57.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fcecb200640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fceb4004d00 0x7fceb4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.444+0000 7fcecb200640 1 -- 172.21.15.162:0/514902630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4003520 con 0x7fceb4003f40 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.445+0000 7fcecb200640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fceb40047c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009af0 tx=0x7fceb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265677cbd44c6df2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc02c710 con 0x7fceb4003f40 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc02c870 con 0x7fceb4003f40 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fced3400640 1 -- 172.21.15.162:0/514902630 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc02cc00 con 0x7fceb4003f40 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fcedac00640 1 -- 172.21.15.162:0/514902630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 msgr2=0x7fceb40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fcedac00640 1 --2- 172.21.15.162:0/514902630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fceb40047c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009af0 tx=0x7fceb40057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fced8c00640 1 -- 172.21.15.162:0/514902630 reap_dead start 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fcedac00640 1 -- 172.21.15.162:0/514902630 shutdown_connections 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fcedac00640 1 -- 172.21.15.162:0/514902630 >> 172.21.15.162:0/514902630 conn(0x7fced40b0cd0 msgr2=0x7fced40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.446+0000 7fcedac00640 1 -- 172.21.15.162:0/514902630 shutdown_connections 2024-01-20T11:09:57.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.447+0000 7fcedac00640 1 -- 172.21.15.162:0/514902630 wait complete. 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.448+0000 7fcedac00640 1 Processor -- start 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.448+0000 7fcedac00640 1 -- start start 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.449+0000 7fcedac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fced40ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.449+0000 7fcedac00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced40cb300 0x7fced414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.449+0000 7fcedac00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced409b550 0x7fced409b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.449+0000 7fcedac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced40b27a0 con 0x7fceb4003f40 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.449+0000 7fcedac00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced40b2a80 con 0x7fced40cb300 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.449+0000 7fcedac00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced40b2d60 con 0x7fced409b550 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fced40ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fced40ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39688/0 (socket says 172.21.15.162:39688) 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 -- 172.21.15.162:0/3902731120 learned_addr learned my addr 172.21.15.162:0/3902731120 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:57.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fcecb200640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced40cb300 0x7fced414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced8c00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced409b550 0x7fced409b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 -- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced409b550 msgr2=0x7fced409b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced409b550 0x7fced409b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 -- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced40cb300 msgr2=0x7fced414ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced40cb300 0x7fced414ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 -- 172.21.15.162:0/3902731120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4155f90 con 0x7fceb4003f40 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fcecb200640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced40cb300 0x7fced414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.450+0000 7fced3e00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fced40ae9d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcec400d7a0 tx=0x7fcec400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.451+0000 7fced0c00640 1 -- 172.21.15.162:0/3902731120 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40074e0 con 0x7fceb4003f40 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.451+0000 7fced0c00640 1 -- 172.21.15.162:0/3902731120 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4007640 con 0x7fceb4003f40 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.451+0000 7fced0c00640 1 -- 172.21.15.162:0/3902731120 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4004a20 con 0x7fceb4003f40 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.451+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced40b3040 con 0x7fceb4003f40 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.451+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced409b030 con 0x7fceb4003f40 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.452+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced409abb0 con 0x7fceb4003f40 2024-01-20T11:09:57.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.453+0000 7fced0c00640 1 -- 172.21.15.162:0/3902731120 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcec4004b80 con 0x7fceb4003f40 2024-01-20T11:09:57.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.454+0000 7fced0c00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fceac06af00 0x7fceac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.454+0000 7fced0c00640 1 -- 172.21.15.162:0/3902731120 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcec40893a0 con 0x7fceb4003f40 2024-01-20T11:09:57.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.454+0000 7fcecb200640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fceac06af00 0x7fceac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.455+0000 7fcecb200640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fceac06af00 0x7fceac06d3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcebc036000 tx=0x7fcebc030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:57.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.458+0000 7fced0c00640 1 -- 172.21.15.162:0/3902731120 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fced409abb0 con 0x7fceb4003f40 2024-01-20T11:09:57.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.694+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fced409abb0 con 0x7fceb4003f40 2024-01-20T11:09:57.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.695+0000 7fced0c00640 1 -- 172.21.15.162:0/3902731120 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fced409abb0 con 0x7fceb4003f40 2024-01-20T11:09:57.696 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:57.697 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3643822826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3643822826},{"type":"v1","addr":"172.21.15.162:6837","nonce":3643822826}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3084491175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3084491175},{"type":"v1","addr":"172.21.15.179:6834","nonce":3084491175}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3459133230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3459133230},{"type":"v1","addr":"172.21.15.162:6836","nonce":3459133230}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T11:09:26.112913+0000","modified":"2024-01-20T11:09:29.172569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/4241600456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4241600456},{"type":"v1","addr":"172.21.15.179:6835","nonce":4241600456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T11:09:57.697 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 23 2024-01-20T11:09:57.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.698+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fceac06af00 msgr2=0x7fceac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.698+0000 7fcedac00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fceac06af00 0x7fceac06d3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcebc036000 tx=0x7fcebc030000 comp rx=0 tx=0).stop 2024-01-20T11:09:57.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.698+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 msgr2=0x7fced40ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.698+0000 7fcedac00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fced40ae9d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcec400d7a0 tx=0x7fcec400dc60 comp rx=0 tx=0).stop 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 shutdown_connections 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced409b550 0x7fced409b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fceac06af00 0x7fceac06d3c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced40cb300 0x7fced414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 --2- 172.21.15.162:0/3902731120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceb4003f40 0x7fced40ae9d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 >> 172.21.15.162:0/3902731120 conn(0x7fced40b0cd0 msgr2=0x7fced40c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 shutdown_connections 2024-01-20T11:09:57.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.699+0000 7fcedac00640 1 -- 172.21.15.162:0/3902731120 wait complete. 2024-01-20T11:09:57.719 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:09:57.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:09:57.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:09:57.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.922+0000 7fdea3c00640 1 Processor -- start 2024-01-20T11:09:57.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.922+0000 7fdea3c00640 1 -- start start 2024-01-20T11:09:57.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.924+0000 7fdea3c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde9c155a30 0x7fde9c0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.924+0000 7fdea3c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c070b60 con 0x7fde9c0ae6b0 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.924+0000 7fdea3c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c15bc00 con 0x7fde9c070630 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.924+0000 7fdea3c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c15ba10 con 0x7fde9c155a30 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.924+0000 7fdea1c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fde9c0ae6b0 0x7fde9c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33936/0 (socket says 172.21.15.162:33936) 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fdea1c00640 1 -- 172.21.15.162:0/518112918 learned_addr learned my addr 172.21.15.162:0/518112918 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fdea1200640 1 --2- 172.21.15.162:0/518112918 >> v2:172.21.15.179:3300/0 conn(0x7fde9c155a30 0x7fde9c0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138292400 0 0) 0x7fde9c070b60 con 0x7fde9c0ae6b0 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde7c003520 con 0x7fde9c0ae6b0 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200607924 0 0) 0x7fde9c15bc00 con 0x7fde9c070630 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c070b60 con 0x7fde9c070630 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3597337386 0 0) 0x7fde7c003520 con 0x7fde9c0ae6b0 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 >> v2:172.21.15.179:3300/0 conn(0x7fde9c155a30 msgr2=0x7fde9c0ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 --2- 172.21.15.162:0/518112918 >> v2:172.21.15.179:3300/0 conn(0x7fde9c155a30 0x7fde9c0ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 >> v1:172.21.15.179:6789/0 conn(0x7fde9c070630 legacy=0x7fde9c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c15bee0 con 0x7fde9c0ae6b0 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fde94001670 con 0x7fde9c0ae6b0 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.925+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 >> v1:172.21.15.162:6789/0 conn(0x7fde9c0ae6b0 legacy=0x7fde9c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9b400640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde7c003b50 0x7fde7c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9b400640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9b400640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde7c0051d0 0x7fde7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c00c0d0 con 0x7fde7c0047c0 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c00c240 con 0x7fde7c003b50 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c00c400 con 0x7fde7c0051d0 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9be00640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fdea1c00640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde7c0051d0 0x7fde7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fdea1200640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde7c003b50 0x7fde7c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9be00640 1 -- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde7c0051d0 msgr2=0x7fde7c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:57.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9be00640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde7c0051d0 0x7fde7c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9be00640 1 -- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde7c003b50 msgr2=0x7fde7c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9be00640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde7c003b50 0x7fde7c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fde9be00640 1 -- 172.21.15.162:0/518112918 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c003520 con 0x7fde7c0047c0 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fdea1c00640 1 -- 172.21.15.162:0/518112918 reap_dead start 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.926+0000 7fdea1200640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde7c003b50 0x7fde7c003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.927+0000 7fde9be00640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde7c004c40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fde840018d0 tx=0x7fde7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402a4d20b1b3354f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840052d0 con 0x7fde7c0047c0 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84005430 con 0x7fde7c0047c0 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fde9b400640 1 -- 172.21.15.162:0/518112918 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84003810 con 0x7fde7c0047c0 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fdea3c00640 1 -- 172.21.15.162:0/518112918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 msgr2=0x7fde7c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fdea3c00640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde7c004c40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fde840018d0 tx=0x7fde7c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fdea3c00640 1 -- 172.21.15.162:0/518112918 shutdown_connections 2024-01-20T11:09:57.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fdea3c00640 1 --2- 172.21.15.162:0/518112918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde7c004c40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fdea3c00640 1 -- 172.21.15.162:0/518112918 >> 172.21.15.162:0/518112918 conn(0x7fde9c0b0cd0 msgr2=0x7fde9c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fdea3c00640 1 -- 172.21.15.162:0/518112918 shutdown_connections 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.928+0000 7fdea3c00640 1 -- 172.21.15.162:0/518112918 wait complete. 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.930+0000 7fdea3c00640 1 Processor -- start 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.930+0000 7fdea3c00640 1 -- start start 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea3c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde9c0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea3c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde9c0b1dc0 0x7fde9c151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea3c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde9c15d7c0 0x7fde9c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea3c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c15e1b0 con 0x7fde7c0047c0 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea3c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c152140 con 0x7fde9c15d7c0 2024-01-20T11:09:57.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea3c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c0b2250 con 0x7fde9c0b1dc0 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde9c0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde9c0b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39704/0 (socket says 172.21.15.162:39704) 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.931+0000 7fdea1200640 1 -- 172.21.15.162:0/1632784050 learned_addr learned my addr 172.21.15.162:0/1632784050 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde9c15d7c0 0x7fde9c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fde9be00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde9c0b1dc0 0x7fde9c151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1200640 1 -- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde9c0b1dc0 msgr2=0x7fde9c151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1200640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde9c0b1dc0 0x7fde9c151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1200640 1 -- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde9c15d7c0 msgr2=0x7fde9c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1200640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde9c15d7c0 0x7fde9c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1200640 1 -- 172.21.15.162:0/1632784050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c155f90 con 0x7fde7c0047c0 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde9c15d7c0 0x7fde9c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:09:57.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fdea1200640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde9c0b3f00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00f3b0 tx=0x7fde8c00f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:57.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.932+0000 7fde98c00640 1 -- 172.21.15.162:0/1632784050 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c01a070 con 0x7fde7c0047c0 2024-01-20T11:09:57.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.933+0000 7fde98c00640 1 -- 172.21.15.162:0/1632784050 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c003990 con 0x7fde7c0047c0 2024-01-20T11:09:57.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.933+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c0b2530 con 0x7fde7c0047c0 2024-01-20T11:09:57.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.933+0000 7fde98c00640 1 -- 172.21.15.162:0/1632784050 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c003d20 con 0x7fde7c0047c0 2024-01-20T11:09:57.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.933+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c0b2af0 con 0x7fde7c0047c0 2024-01-20T11:09:57.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.934+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c04e970 con 0x7fde7c0047c0 2024-01-20T11:09:57.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.935+0000 7fde98c00640 1 -- 172.21.15.162:0/1632784050 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fde8c004020 con 0x7fde7c0047c0 2024-01-20T11:09:57.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.935+0000 7fde98c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fde7406aed0 0x7fde7406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:57.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.935+0000 7fde98c00640 1 -- 172.21.15.162:0/1632784050 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde8c08a040 con 0x7fde7c0047c0 2024-01-20T11:09:57.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.936+0000 7fde9be00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fde7406aed0 0x7fde7406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:57.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.936+0000 7fde9be00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fde7406aed0 0x7fde7406d390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde84034000 tx=0x7fde84031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:57.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:57.940+0000 7fde98c00640 1 -- 172.21.15.162:0/1632784050 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fde8c054fa0 con 0x7fde7c0047c0 2024-01-20T11:09:58.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.135+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde9c06db40 con 0x7fde7c0047c0 2024-01-20T11:09:58.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.137+0000 7fde98c00640 1 -- 172.21.15.162:0/1632784050 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16538 (secure 0 0 0) 0x7fde8c0585c0 con 0x7fde7c0047c0 2024-01-20T11:09:58.139 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:09:58.139 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":47,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:09:27.671415+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-01-20T11:09:23.943994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-01-20T11:09:25.120343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:09:58.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fde7406aed0 msgr2=0x7fde7406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fde7406aed0 0x7fde7406d390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde84034000 tx=0x7fde84031000 comp rx=0 tx=0).stop 2024-01-20T11:09:58.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 msgr2=0x7fde9c0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde9c0b3f00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00f3b0 tx=0x7fde8c00f870 comp rx=0 tx=0).stop 2024-01-20T11:09:58.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 shutdown_connections 2024-01-20T11:09:58.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fde7406aed0 0x7fde7406d390 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde9c15d7c0 0x7fde9c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.140+0000 7fdea3c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde9c0b1dc0 0x7fde9c151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.141+0000 7fdea3c00640 1 --2- 172.21.15.162:0/1632784050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde7c0047c0 0x7fde9c0b3f00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.141+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 >> 172.21.15.162:0/1632784050 conn(0x7fde9c0b0cd0 msgr2=0x7fde9c06cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:58.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.141+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 shutdown_connections 2024-01-20T11:09:58.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.141+0000 7fdea3c00640 1 -- 172.21.15.162:0/1632784050 wait complete. 2024-01-20T11:09:58.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-20T11:09:58.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.410+0000 7f7f8b400640 1 Processor -- start 2024-01-20T11:09:58.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.410+0000 7f7f8b400640 1 -- start start 2024-01-20T11:09:58.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f8b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f84157830 0x7f7f8415a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f8b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f840ceb50 0x7f7f840b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f8b400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7f840cbac0 0x7f7f840cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.413 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f8b400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840cc490 con 0x7f7f840ceb50 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f8b400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8415b0c0 con 0x7f7f840cbac0 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f8b400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8415a5d0 con 0x7f7f84157830 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f83e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f840ceb50 0x7f7f840b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f83e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f840ceb50 0x7f7f840b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39710/0 (socket says 172.21.15.162:39710) 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.412+0000 7f7f83e00640 1 -- 172.21.15.162:0/3964581795 learned_addr learned my addr 172.21.15.162:0/3964581795 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f89400640 1 --2- 172.21.15.162:0/3964581795 >> v2:172.21.15.179:3300/0 conn(0x7f7f840cbac0 0x7f7f840cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f88a00640 1 --2- 172.21.15.162:0/3964581795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f84157830 0x7f7f8415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f83e00640 1 -- 172.21.15.162:0/3964581795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f84157830 msgr2=0x7f7f8415a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f83e00640 1 --2- 172.21.15.162:0/3964581795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f84157830 0x7f7f8415a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f83e00640 1 -- 172.21.15.162:0/3964581795 >> v2:172.21.15.179:3300/0 conn(0x7f7f840cbac0 msgr2=0x7f7f840cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f83e00640 1 --2- 172.21.15.162:0/3964581795 >> v2:172.21.15.179:3300/0 conn(0x7f7f840cbac0 0x7f7f840cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f83e00640 1 -- 172.21.15.162:0/3964581795 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840b4360 con 0x7f7f840ceb50 2024-01-20T11:09:58.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.413+0000 7f7f89400640 1 --2- 172.21.15.162:0/3964581795 >> v2:172.21.15.179:3300/0 conn(0x7f7f840cbac0 0x7f7f840cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.414+0000 7f7f83e00640 1 --2- 172.21.15.162:0/3964581795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b3e20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f840b3680 tx=0x7f7f6c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1806fd5385a74eef server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.414+0000 7f7f83400640 1 -- 172.21.15.162:0/3964581795 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c02ee90 con 0x7f7f840ceb50 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.414+0000 7f7f83400640 1 -- 172.21.15.162:0/3964581795 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c036440 con 0x7f7f840ceb50 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.414+0000 7f7f83400640 1 -- 172.21.15.162:0/3964581795 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0367d0 con 0x7f7f840ceb50 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 -- 172.21.15.162:0/3964581795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 msgr2=0x7f7f840b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 --2- 172.21.15.162:0/3964581795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b3e20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f840b3680 tx=0x7f7f6c02e0e0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 -- 172.21.15.162:0/3964581795 shutdown_connections 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 --2- 172.21.15.162:0/3964581795 >> v2:172.21.15.179:3300/0 conn(0x7f7f840cbac0 0x7f7f840cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 --2- 172.21.15.162:0/3964581795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b3e20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 --2- 172.21.15.162:0/3964581795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f84157830 0x7f7f8415a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 -- 172.21.15.162:0/3964581795 >> 172.21.15.162:0/3964581795 conn(0x7f7f8406a600 msgr2=0x7f7f8406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:58.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 -- 172.21.15.162:0/3964581795 shutdown_connections 2024-01-20T11:09:58.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.415+0000 7f7f8b400640 1 -- 172.21.15.162:0/3964581795 wait complete. 2024-01-20T11:09:58.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.417+0000 7f7f8b400640 1 Processor -- start 2024-01-20T11:09:58.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.417+0000 7f7f8b400640 1 -- start start 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f8b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f840cbac0 0x7f7f84146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f8b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f8b400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f84157830 0x7f7f840b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f8b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840b0640 con 0x7f7f840ceb50 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f8b400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840a8f10 con 0x7f7f84157830 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f8b400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840a85e0 con 0x7f7f840cbac0 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f83e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f83e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39714/0 (socket says 172.21.15.162:39714) 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f83e00640 1 -- 172.21.15.162:0/2722750781 learned_addr learned my addr 172.21.15.162:0/2722750781 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:58.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f88a00640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f840cbac0 0x7f7f84146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.418+0000 7f7f89400640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f84157830 0x7f7f840b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f83e00640 1 -- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f840cbac0 msgr2=0x7f7f84146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f83e00640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f840cbac0 0x7f7f84146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f83e00640 1 -- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f84157830 msgr2=0x7f7f840b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f83e00640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f84157830 0x7f7f840b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f83e00640 1 -- 172.21.15.162:0/2722750781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c00b770 con 0x7f7f840ceb50 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f83e00640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b0ec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00b2c0 tx=0x7f7f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f80c00640 1 -- 172.21.15.162:0/2722750781 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0348d0 con 0x7f7f840ceb50 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f80c00640 1 -- 172.21.15.162:0/2722750781 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c034a30 con 0x7f7f840ceb50 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f80c00640 1 -- 172.21.15.162:0/2722750781 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c034de0 con 0x7f7f840ceb50 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.419+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f840a88c0 con 0x7f7f840ceb50 2024-01-20T11:09:58.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.420+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f84147040 con 0x7f7f840ceb50 2024-01-20T11:09:58.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.421+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8404e970 con 0x7f7f840ceb50 2024-01-20T11:09:58.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.421+0000 7f7f80c00640 1 -- 172.21.15.162:0/2722750781 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7f6c03d040 con 0x7f7f840ceb50 2024-01-20T11:09:58.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.422+0000 7f7f80c00640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f5c06aed0 0x7f7f5c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.422+0000 7f7f80c00640 1 -- 172.21.15.162:0/2722750781 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f6c0ae340 con 0x7f7f840ceb50 2024-01-20T11:09:58.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.423+0000 7f7f88a00640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f5c06aed0 0x7f7f5c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.423+0000 7f7f88a00640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f5c06aed0 0x7f7f5c06d390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f74006fd0 tx=0x7f7f74008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:58.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.427+0000 7f7f80c00640 1 -- 172.21.15.162:0/2722750781 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7f6c079200 con 0x7f7f840ceb50 2024-01-20T11:09:58.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.660+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7f840a8720 con 0x7f7f840ceb50 2024-01-20T11:09:58.661 INFO:tasks.ceph.mon.a.smithi162.stderr:2024-01-20T11:09:58.661+0000 7f7926600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T11:09:58.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.664+0000 7f7f80c00640 1 -- 172.21.15.162:0/2722750781 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7f840a8720 con 0x7f7f840ceb50 2024-01-20T11:09:58.665 INFO:teuthology.orchestra.run.smithi162.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T11:09:58.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.667+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f5c06aed0 msgr2=0x7f7f5c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.667+0000 7f7f8b400640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f5c06aed0 0x7f7f5c06d390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f74006fd0 tx=0x7f7f74008040 comp rx=0 tx=0).stop 2024-01-20T11:09:58.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.667+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 msgr2=0x7f7f840b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.667+0000 7f7f8b400640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b0ec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00b2c0 tx=0x7f7f6c0046c0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 shutdown_connections 2024-01-20T11:09:58.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7f5c06aed0 0x7f7f5c06d390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f84157830 0x7f7f840b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f840ceb50 0x7f7f840b0ec0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 --2- 172.21.15.162:0/2722750781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f840cbac0 0x7f7f84146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 >> 172.21.15.162:0/2722750781 conn(0x7f7f8406a600 msgr2=0x7f7f84158840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:58.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 shutdown_connections 2024-01-20T11:09:58.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.668+0000 7f7f8b400640 1 -- 172.21.15.162:0/2722750781 wait complete. 2024-01-20T11:09:58.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-20T11:09:58.788 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-01-20T11:09:58.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.908+0000 7f5e6d600640 1 Processor -- start 2024-01-20T11:09:58.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.908+0000 7f5e6d600640 1 -- start start 2024-01-20T11:09:58.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.909+0000 7f5e6d600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e68141bb0 0x7f5e680ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.909+0000 7f5e6d600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5e680ce6a0 0x7f5e6806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.909+0000 7f5e6d600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680cee70 con 0x7f5e680cdc30 2024-01-20T11:09:58.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.909+0000 7f5e6d600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e680cd7a0 con 0x7f5e680ce6a0 2024-01-20T11:09:58.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.909+0000 7f5e6d600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680ceb90 con 0x7f5e68141bb0 2024-01-20T11:09:58.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.910+0000 7f5e67400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5e680cdc30 0x7f5e6815f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33944/0 (socket says 172.21.15.162:33944) 2024-01-20T11:09:58.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.910+0000 7f5e67400640 1 -- 172.21.15.162:0/675236555 learned_addr learned my addr 172.21.15.162:0/675236555 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:58.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.910+0000 7f5e66a00640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e68141bb0 0x7f5e680ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.910+0000 7f5e66000640 1 --2- 172.21.15.162:0/675236555 >> v2:172.21.15.179:3300/0 conn(0x7f5e680ce6a0 0x7f5e6806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.910+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990196111 0 0) 0x7f5e60001490 con 0x7f5e680cdc30 2024-01-20T11:09:58.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.910+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e48003520 con 0x7f5e680cdc30 2024-01-20T11:09:58.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.910+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 113865538 0 0) 0x7f5e48003520 con 0x7f5e680cdc30 2024-01-20T11:09:58.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e68141bb0 msgr2=0x7f5e680ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:58.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e68141bb0 0x7f5e680ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 >> v2:172.21.15.179:3300/0 conn(0x7f5e680ce6a0 msgr2=0x7f5e6806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:58.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 --2- 172.21.15.162:0/675236555 >> v2:172.21.15.179:3300/0 conn(0x7f5e680ce6a0 0x7f5e6806c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680cd150 con 0x7f5e680cdc30 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f5e60001b80 con 0x7f5e680cdc30 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66000640 1 --2- 172.21.15.162:0/675236555 >> v2:172.21.15.179:3300/0 conn(0x7f5e680ce6a0 0x7f5e6806c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 >> v1:172.21.15.162:6789/0 conn(0x7f5e680cdc30 legacy=0x7f5e6815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e480047c0 0x7f5e48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e68141bb0 0x7f5e48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680cd7a0 con 0x7f5e48003970 2024-01-20T11:09:58.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680ceb90 con 0x7f5e480047c0 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4800ba30 con 0x7f5e68141bb0 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66a00640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66000640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e480047c0 0x7f5e48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66a00640 1 -- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e68141bb0 msgr2=0x7f5e48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66a00640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e68141bb0 0x7f5e48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66a00640 1 -- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e480047c0 msgr2=0x7f5e48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66a00640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e480047c0 0x7f5e48004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.911+0000 7f5e66a00640 1 -- 172.21.15.162:0/675236555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48003520 con 0x7f5e48003970 2024-01-20T11:09:58.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.912+0000 7f5e66a00640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e48003d90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009650 tx=0x7f5e480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9390ad1bb10901 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:58.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58030a10 con 0x7f5e48003970 2024-01-20T11:09:58.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58030b70 con 0x7f5e48003970 2024-01-20T11:09:58.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e65600640 1 -- 172.21.15.162:0/675236555 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58038440 con 0x7f5e48003970 2024-01-20T11:09:58.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e6d600640 1 -- 172.21.15.162:0/675236555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 msgr2=0x7f5e48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e6d600640 1 --2- 172.21.15.162:0/675236555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e48003d90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009650 tx=0x7f5e480057f0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e67400640 1 -- 172.21.15.162:0/675236555 reap_dead start 2024-01-20T11:09:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e6d600640 1 -- 172.21.15.162:0/675236555 shutdown_connections 2024-01-20T11:09:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.913+0000 7f5e6d600640 1 -- 172.21.15.162:0/675236555 >> 172.21.15.162:0/675236555 conn(0x7f5e6806a600 msgr2=0x7f5e6806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.914+0000 7f5e6d600640 1 -- 172.21.15.162:0/675236555 shutdown_connections 2024-01-20T11:09:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.914+0000 7f5e6d600640 1 -- 172.21.15.162:0/675236555 wait complete. 2024-01-20T11:09:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.915+0000 7f5e6d600640 1 Processor -- start 2024-01-20T11:09:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.915+0000 7f5e6d600640 1 -- start start 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.916+0000 7f5e6d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e680b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.916+0000 7f5e6d600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e680b1590 0x7f5e68138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.916+0000 7f5e6d600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e6815af80 0x7f5e680b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.916+0000 7f5e6d600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680aff50 con 0x7f5e48003970 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.916+0000 7f5e6d600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680b0230 con 0x7f5e6815af80 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.916+0000 7f5e6d600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680b0510 con 0x7f5e680b1590 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e680b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e680b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39736/0 (socket says 172.21.15.162:39736) 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 -- 172.21.15.162:0/3887926455 learned_addr learned my addr 172.21.15.162:0/3887926455 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:58.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e67400640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e6815af80 0x7f5e680b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66000640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e680b1590 0x7f5e68138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 -- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e680b1590 msgr2=0x7f5e68138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e680b1590 0x7f5e68138d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 -- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e6815af80 msgr2=0x7f5e680b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e6815af80 0x7f5e680b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66a00640 1 -- 172.21.15.162:0/3887926455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680b07f0 con 0x7f5e48003970 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e67400640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e6815af80 0x7f5e680b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.917+0000 7f5e66000640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e680b1590 0x7f5e68138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.918+0000 7f5e66a00640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e680b0ff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5e58000c00 tx=0x7f5e58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.918+0000 7f5e5ea00640 1 -- 172.21.15.162:0/3887926455 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58003a20 con 0x7f5e48003970 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.918+0000 7f5e5ea00640 1 -- 172.21.15.162:0/3887926455 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58003b80 con 0x7f5e48003970 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.918+0000 7f5e5ea00640 1 -- 172.21.15.162:0/3887926455 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58044450 con 0x7f5e48003970 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.918+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e680b0ad0 con 0x7f5e48003970 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.918+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6815b430 con 0x7f5e48003970 2024-01-20T11:09:58.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.919+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6815e7c0 con 0x7f5e48003970 2024-01-20T11:09:58.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.920+0000 7f5e5ea00640 1 -- 172.21.15.162:0/3887926455 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5e580445b0 con 0x7f5e48003970 2024-01-20T11:09:58.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.921+0000 7f5e5ea00640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5e4006af00 0x7f5e4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:58.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.921+0000 7f5e5ea00640 1 -- 172.21.15.162:0/3887926455 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5e580af9f0 con 0x7f5e48003970 2024-01-20T11:09:58.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.921+0000 7f5e66000640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5e4006af00 0x7f5e4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:58.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.922+0000 7f5e66000640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5e4006af00 0x7f5e4006d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e680b1a20 tx=0x7f5e50008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:58.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:58.925+0000 7f5e5ea00640 1 -- 172.21.15.162:0/3887926455 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5e5807a7c0 con 0x7f5e48003970 2024-01-20T11:09:59.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.157+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5e6804e970 con 0x7f5e48003970 2024-01-20T11:09:59.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.743+0000 7f5e5ea00640 1 -- 172.21.15.162:0/3887926455 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e5807dde0 con 0x7f5e48003970 2024-01-20T11:09:59.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5e4006af00 msgr2=0x7f5e4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:59.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5e4006af00 0x7f5e4006d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e680b1a20 tx=0x7f5e50008040 comp rx=0 tx=0).stop 2024-01-20T11:09:59.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 msgr2=0x7f5e680b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:59.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e680b0ff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5e58000c00 tx=0x7f5e58004730 comp rx=0 tx=0).stop 2024-01-20T11:09:59.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 shutdown_connections 2024-01-20T11:09:59.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5e4006af00 0x7f5e4006d3c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e6815af80 0x7f5e680b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e680b1590 0x7f5e68138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 --2- 172.21.15.162:0/3887926455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e48003970 0x7f5e680b0ff0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 >> 172.21.15.162:0/3887926455 conn(0x7f5e6806a600 msgr2=0x7f5e681385f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:59.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 shutdown_connections 2024-01-20T11:09:59.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.747+0000 7f5e6d600640 1 -- 172.21.15.162:0/3887926455 wait complete. 2024-01-20T11:09:59.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-20T11:09:59.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.974+0000 7f9698600640 1 Processor -- start 2024-01-20T11:09:59.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.974+0000 7f9698600640 1 -- start start 2024-01-20T11:09:59.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.975+0000 7f9698600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9690152290 0x7f96900cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:59.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.975+0000 7f9698600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f969006dc50 0x7f969015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:59.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.975+0000 7f9698600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900d0070 con 0x7f96900ca490 2024-01-20T11:09:59.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.975+0000 7f9698600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969015c910 con 0x7f969006dc50 2024-01-20T11:09:59.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.975+0000 7f9698600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900b27d0 con 0x7f9690152290 2024-01-20T11:09:59.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9696600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f969006dc50 0x7f969015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:59.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9695200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f96900ca490 0x7f969006d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33960/0 (socket says 172.21.15.162:33960) 2024-01-20T11:09:59.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9695200640 1 -- 172.21.15.162:0/768016263 learned_addr learned my addr 172.21.15.162:0/768016263 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:09:59.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9695c00640 1 --2- 172.21.15.162:0/768016263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9690152290 0x7f96900cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:59.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9696600640 1 -- 172.21.15.162:0/768016263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9690152290 msgr2=0x7f96900cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:09:59.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9696600640 1 --2- 172.21.15.162:0/768016263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9690152290 0x7f96900cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9696600640 1 -- 172.21.15.162:0/768016263 >> v1:172.21.15.162:6789/0 conn(0x7f96900ca490 legacy=0x7f969006d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:59.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f9696600640 1 -- 172.21.15.162:0/768016263 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900cf7d0 con 0x7f969006dc50 2024-01-20T11:09:59.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.976+0000 7f968fe00640 1 -- 172.21.15.162:0/768016263 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323192329 0 0) 0x7f96900d0070 con 0x7f96900ca490 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.977+0000 7f9696600640 1 --2- 172.21.15.162:0/768016263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f969006dc50 0x7f969015c3d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9688009d90 tx=0x7f968802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f4bb7a36af3c9a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.978+0000 7f968fe00640 1 -- 172.21.15.162:0/768016263 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968802cbc0 con 0x7f969006dc50 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.978+0000 7f968fe00640 1 -- 172.21.15.162:0/768016263 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968802cd20 con 0x7f969006dc50 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.978+0000 7f968fe00640 1 -- 172.21.15.162:0/768016263 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688034660 con 0x7f969006dc50 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.978+0000 7f9698600640 1 -- 172.21.15.162:0/768016263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f969006dc50 msgr2=0x7f969015c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.978+0000 7f9698600640 1 --2- 172.21.15.162:0/768016263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f969006dc50 0x7f969015c3d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9688009d90 tx=0x7f968802be10 comp rx=0 tx=0).stop 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.979+0000 7f9698600640 1 -- 172.21.15.162:0/768016263 shutdown_connections 2024-01-20T11:09:59.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.979+0000 7f9698600640 1 --2- 172.21.15.162:0/768016263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f969006dc50 0x7f969015c3d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.979+0000 7f9698600640 1 --2- 172.21.15.162:0/768016263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9690152290 0x7f96900cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.979+0000 7f9698600640 1 -- 172.21.15.162:0/768016263 >> 172.21.15.162:0/768016263 conn(0x7f969006a600 msgr2=0x7f969006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:09:59.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.979+0000 7f9698600640 1 -- 172.21.15.162:0/768016263 shutdown_connections 2024-01-20T11:09:59.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.979+0000 7f9698600640 1 -- 172.21.15.162:0/768016263 wait complete. 2024-01-20T11:09:59.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.980+0000 7f9698600640 1 Processor -- start 2024-01-20T11:09:59.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.981+0000 7f9698600640 1 -- start start 2024-01-20T11:09:59.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9698600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969006dc50 0x7f96900af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:59.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9698600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96900ca490 0x7f96900cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:59.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9698600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690152290 0x7f969015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:59.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9698600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690153ab0 con 0x7f96900ca490 2024-01-20T11:09:59.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9698600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900aeab0 con 0x7f9690152290 2024-01-20T11:09:59.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9698600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900ce650 con 0x7f969006dc50 2024-01-20T11:09:59.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96900ca490 0x7f96900cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:59.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96900ca490 0x7f96900cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39762/0 (socket says 172.21.15.162:39762) 2024-01-20T11:09:59.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 -- 172.21.15.162:0/642284779 learned_addr learned my addr 172.21.15.162:0/642284779 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:09:59.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695c00640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969006dc50 0x7f96900af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:59.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9696600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690152290 0x7f969015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:59.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 -- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969006dc50 msgr2=0x7f96900af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:59.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969006dc50 0x7f96900af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 -- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690152290 msgr2=0x7f969015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:09:59.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690152290 0x7f969015a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:09:59.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9695200640 1 -- 172.21.15.162:0/642284779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688009a70 con 0x7f96900ca490 2024-01-20T11:09:59.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.982+0000 7f9696600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690152290 0x7f969015a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:09:59.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.983+0000 7f9695200640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96900ca490 0x7f96900cdb90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f967800c4d0 tx=0x7f967800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:59.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.983+0000 7f968d600640 1 -- 172.21.15.162:0/642284779 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96780074e0 con 0x7f96900ca490 2024-01-20T11:09:59.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.983+0000 7f968d600640 1 -- 172.21.15.162:0/642284779 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678007660 con 0x7f96900ca490 2024-01-20T11:09:59.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.983+0000 7f968d600640 1 -- 172.21.15.162:0/642284779 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678004a20 con 0x7f96900ca490 2024-01-20T11:09:59.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.983+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96900ce930 con 0x7f96900ca490 2024-01-20T11:09:59.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.983+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9690153d30 con 0x7f96900ca490 2024-01-20T11:09:59.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.984+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96900cee50 con 0x7f96900ca490 2024-01-20T11:09:59.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.985+0000 7f968d600640 1 -- 172.21.15.162:0/642284779 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9678004b80 con 0x7f96900ca490 2024-01-20T11:09:59.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.986+0000 7f968d600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f966806aed0 0x7f966806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:09:59.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.987+0000 7f968d600640 1 -- 172.21.15.162:0/642284779 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9678088880 con 0x7f96900ca490 2024-01-20T11:09:59.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.987+0000 7f9695c00640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f966806aed0 0x7f966806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:09:59.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.987+0000 7f9695c00640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f966806aed0 0x7f966806d390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9680006fd0 tx=0x7f9680008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:09:59.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:09:59.991+0000 7f968d600640 1 -- 172.21.15.162:0/642284779 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f96900cee50 con 0x7f96900ca490 2024-01-20T11:10:00.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.183+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96900cee50 con 0x7f96900ca490 2024-01-20T11:10:00.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.750+0000 7f968d600640 1 -- 172.21.15.162:0/642284779 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7f96900cee50 con 0x7f96900ca490 2024-01-20T11:10:00.751 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' removed 2024-01-20T11:10:00.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f966806aed0 msgr2=0x7f966806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:00.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f966806aed0 0x7f966806d390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9680006fd0 tx=0x7f9680008040 comp rx=0 tx=0).stop 2024-01-20T11:10:00.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96900ca490 msgr2=0x7f96900cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:00.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96900ca490 0x7f96900cdb90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f967800c4d0 tx=0x7f967800c990 comp rx=0 tx=0).stop 2024-01-20T11:10:00.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 shutdown_connections 2024-01-20T11:10:00.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f966806aed0 0x7f966806d390 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:00.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690152290 0x7f969015a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:00.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96900ca490 0x7f96900cdb90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:00.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 --2- 172.21.15.162:0/642284779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969006dc50 0x7f96900af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:00.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.754+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 >> 172.21.15.162:0/642284779 conn(0x7f969006a600 msgr2=0x7f9690071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:00.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.755+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 shutdown_connections 2024-01-20T11:10:00.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.755+0000 7f9698600640 1 -- 172.21.15.162:0/642284779 wait complete. 2024-01-20T11:10:00.787 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-20T11:10:00.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.996+0000 7f4bb6e00640 1 Processor -- start 2024-01-20T11:10:00.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.996+0000 7f4bb6e00640 1 -- start start 2024-01-20T11:10:00.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4bb6e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cee40 0x7f4bb0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:00.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4bb6e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4bb00cf220 0x7f4bb015b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:00.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4bb6e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb0070070 con 0x7f4bb015bbc0 2024-01-20T11:10:00.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4bb6e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb0071000 con 0x7f4bb00cf220 2024-01-20T11:10:00.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4bb6e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb015c4c0 con 0x7f4bb00cee40 2024-01-20T11:10:00.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4ba7200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4bb00cf220 0x7f4bb015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4ba7200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4bb00cf220 0x7f4bb015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39772/0 (socket says 172.21.15.162:39772) 2024-01-20T11:10:01.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.998+0000 7f4ba7200640 1 -- 172.21.15.162:0/2001118393 learned_addr learned my addr 172.21.15.162:0/2001118393 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:01.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.999+0000 7f4bafe00640 1 --2- 172.21.15.162:0/2001118393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cee40 0x7f4bb0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.999+0000 7f4ba7200640 1 -- 172.21.15.162:0/2001118393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cee40 msgr2=0x7f4bb0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:01.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.999+0000 7f4ba7200640 1 --2- 172.21.15.162:0/2001118393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cee40 0x7f4bb0070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.999+0000 7f4ba7200640 1 -- 172.21.15.162:0/2001118393 >> v1:172.21.15.179:6789/0 conn(0x7f4bb015bbc0 legacy=0x7f4bb013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:01.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:00.999+0000 7f4ba7200640 1 -- 172.21.15.162:0/2001118393 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb015c7a0 con 0x7f4bb00cf220 2024-01-20T11:10:01.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.000+0000 7f4ba7200640 1 --2- 172.21.15.162:0/2001118393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb00cf220 0x7f4bb015b680 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009870 tx=0x7f4b9802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f3a9dfca5d2041 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:01.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.000+0000 7f4baf400640 1 -- 172.21.15.162:0/2001118393 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98031640 con 0x7f4bb00cf220 2024-01-20T11:10:01.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.000+0000 7f4baf400640 1 -- 172.21.15.162:0/2001118393 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b980317a0 con 0x7f4bb00cf220 2024-01-20T11:10:01.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.000+0000 7f4baf400640 1 -- 172.21.15.162:0/2001118393 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98031b30 con 0x7f4bb00cf220 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 -- 172.21.15.162:0/2001118393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb00cf220 msgr2=0x7f4bb015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/2001118393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb00cf220 0x7f4bb015b680 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009870 tx=0x7f4b9802b8f0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 -- 172.21.15.162:0/2001118393 shutdown_connections 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/2001118393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb00cf220 0x7f4bb015b680 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/2001118393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cee40 0x7f4bb0070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 -- 172.21.15.162:0/2001118393 >> 172.21.15.162:0/2001118393 conn(0x7f4bb00b2ec0 msgr2=0x7f4bb00b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 -- 172.21.15.162:0/2001118393 shutdown_connections 2024-01-20T11:10:01.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.001+0000 7f4bb6e00640 1 -- 172.21.15.162:0/2001118393 wait complete. 2024-01-20T11:10:01.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.003+0000 7f4bb6e00640 1 Processor -- start 2024-01-20T11:10:01.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.003+0000 7f4bb6e00640 1 -- start start 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb6e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bb00cee40 0x7f4bb0154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb6e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cf220 0x7f4bb00c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb6e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb015bbc0 0x7f4bb00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb6e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01591a0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb6e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0154ea0 con 0x7f4bb00cee40 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb6e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0157740 con 0x7f4bb00cf220 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb015bbc0 0x7f4bb00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb015bbc0 0x7f4bb00c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39774/0 (socket says 172.21.15.162:39774) 2024-01-20T11:10:01.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.004+0000 7f4bb4e00640 1 -- 172.21.15.162:0/242343402 learned_addr learned my addr 172.21.15.162:0/242343402 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:01.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4ba7200640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cf220 0x7f4bb00c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4bafe00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bb00cee40 0x7f4bb0154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4bb4e00640 1 -- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cf220 msgr2=0x7f4bb00c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4bb4e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cf220 0x7f4bb00c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4bb4e00640 1 -- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bb00cee40 msgr2=0x7f4bb0154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4bb4e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bb00cee40 0x7f4bb0154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4bb4e00640 1 -- 172.21.15.162:0/242343402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980094d0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.005+0000 7f4bb4e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb015bbc0 0x7f4bb00c7cb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800b990 tx=0x7f4ba800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:01.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.006+0000 7f4bacc00640 1 -- 172.21.15.162:0/242343402 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800cba0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.006+0000 7f4bacc00640 1 -- 172.21.15.162:0/242343402 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba800cd00 con 0x7f4bb015bbc0 2024-01-20T11:10:01.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.006+0000 7f4bacc00640 1 -- 172.21.15.162:0/242343402 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8014680 con 0x7f4bb015bbc0 2024-01-20T11:10:01.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.006+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb0156ea0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.006+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb0157460 con 0x7f4bb015bbc0 2024-01-20T11:10:01.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.007+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb0158f00 con 0x7f4bb015bbc0 2024-01-20T11:10:01.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.008+0000 7f4bacc00640 1 -- 172.21.15.162:0/242343402 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4ba801d3b0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.009+0000 7f4bacc00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4b8806aed0 0x7f4b8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.009+0000 7f4bacc00640 1 -- 172.21.15.162:0/242343402 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4ba80894d0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.009+0000 7f4bafe00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4b8806aed0 0x7f4b8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.010+0000 7f4bafe00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4b8806aed0 0x7f4b8806d390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0006fd0 tx=0x7f4ba0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:01.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.014+0000 7f4bacc00640 1 -- 172.21.15.162:0/242343402 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4bb0158f00 con 0x7f4bb015bbc0 2024-01-20T11:10:01.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.211+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4bb01592e0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.753+0000 7f4bacc00640 1 -- 172.21.15.162:0/242343402 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4bb01592e0 con 0x7f4bb015bbc0 2024-01-20T11:10:01.754 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' removed 2024-01-20T11:10:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4b8806aed0 msgr2=0x7f4b8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4b8806aed0 0x7f4b8806d390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0006fd0 tx=0x7f4ba0008040 comp rx=0 tx=0).stop 2024-01-20T11:10:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb015bbc0 msgr2=0x7f4bb00c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb015bbc0 0x7f4bb00c7cb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800b990 tx=0x7f4ba800be50 comp rx=0 tx=0).stop 2024-01-20T11:10:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 shutdown_connections 2024-01-20T11:10:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb015bbc0 0x7f4bb00c7cb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bb00cf220 0x7f4bb00c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f4b8806aed0 0x7f4b8806d390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 --2- 172.21.15.162:0/242343402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bb00cee40 0x7f4bb0154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.757+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 >> 172.21.15.162:0/242343402 conn(0x7f4bb00b2ec0 msgr2=0x7f4bb00b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:01.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.758+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 shutdown_connections 2024-01-20T11:10:01.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.758+0000 7f4bb6e00640 1 -- 172.21.15.162:0/242343402 wait complete. 2024-01-20T11:10:01.789 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-20T11:10:01.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.966+0000 7f46d1000640 1 Processor -- start 2024-01-20T11:10:01.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.966+0000 7f46d1000640 1 -- start start 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46d1000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46cc15d5b0 0x7f46cc06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46d1000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f46cc1618e0 0x7f46cc161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46d1000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc0ae130 con 0x7f46cc0b2040 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46d1000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc0ae410 con 0x7f46cc15d5b0 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46d1000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc0ae6f0 con 0x7f46cc1618e0 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46c9e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46cc15d5b0 0x7f46cc06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46c9e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46cc15d5b0 0x7f46cc06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39784/0 (socket says 172.21.15.162:39784) 2024-01-20T11:10:01.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.968+0000 7f46c9e00640 1 -- 172.21.15.162:0/1515305888 learned_addr learned my addr 172.21.15.162:0/1515305888 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:01.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.969+0000 7f46c9e00640 1 -- 172.21.15.162:0/1515305888 >> v2:172.21.15.179:3300/0 conn(0x7f46cc1618e0 msgr2=0x7f46cc161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:01.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.969+0000 7f46c9e00640 1 --2- 172.21.15.162:0/1515305888 >> v2:172.21.15.179:3300/0 conn(0x7f46cc1618e0 0x7f46cc161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.969+0000 7f46c9e00640 1 -- 172.21.15.162:0/1515305888 >> v1:172.21.15.179:6789/0 conn(0x7f46cc0b2040 legacy=0x7f46cc0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:01.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.969+0000 7f46c9e00640 1 -- 172.21.15.162:0/1515305888 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc1613c0 con 0x7f46cc15d5b0 2024-01-20T11:10:01.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.970+0000 7f46c9e00640 1 --2- 172.21.15.162:0/1515305888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc15d5b0 0x7f46cc06c3b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f46cc162340 tx=0x7f46bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8400c0848abdc6bf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:01.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.970+0000 7f46c9400640 1 -- 172.21.15.162:0/1515305888 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0317e0 con 0x7f46cc15d5b0 2024-01-20T11:10:01.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.970+0000 7f46c9400640 1 -- 172.21.15.162:0/1515305888 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc031940 con 0x7f46cc15d5b0 2024-01-20T11:10:01.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.970+0000 7f46c9400640 1 -- 172.21.15.162:0/1515305888 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc031cd0 con 0x7f46cc15d5b0 2024-01-20T11:10:01.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 -- 172.21.15.162:0/1515305888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc15d5b0 msgr2=0x7f46cc06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 --2- 172.21.15.162:0/1515305888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc15d5b0 0x7f46cc06c3b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f46cc162340 tx=0x7f46bc02b880 comp rx=0 tx=0).stop 2024-01-20T11:10:01.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 -- 172.21.15.162:0/1515305888 shutdown_connections 2024-01-20T11:10:01.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 --2- 172.21.15.162:0/1515305888 >> v2:172.21.15.179:3300/0 conn(0x7f46cc1618e0 0x7f46cc161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 --2- 172.21.15.162:0/1515305888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc15d5b0 0x7f46cc06c3b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 -- 172.21.15.162:0/1515305888 >> 172.21.15.162:0/1515305888 conn(0x7f46cc06a600 msgr2=0x7f46cc06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:01.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 -- 172.21.15.162:0/1515305888 shutdown_connections 2024-01-20T11:10:01.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.971+0000 7f46d1000640 1 -- 172.21.15.162:0/1515305888 wait complete. 2024-01-20T11:10:01.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.972+0000 7f46d1000640 1 Processor -- start 2024-01-20T11:10:01.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.973+0000 7f46d1000640 1 -- start start 2024-01-20T11:10:01.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.973+0000 7f46d1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc0b2040 0x7f46cc0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.973+0000 7f46d1000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46cc15d5b0 0x7f46cc0b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.973+0000 7f46d1000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46cc1618e0 0x7f46cc0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.973+0000 7f46d1000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0b0010 con 0x7f46cc0b2040 2024-01-20T11:10:01.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.973+0000 7f46d1000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0b02f0 con 0x7f46cc1618e0 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.973+0000 7f46d1000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0b05d0 con 0x7f46cc15d5b0 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc0b2040 0x7f46cc0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc0b2040 0x7f46cc0af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39788/0 (socket says 172.21.15.162:39788) 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 -- 172.21.15.162:0/2989707634 learned_addr learned my addr 172.21.15.162:0/2989707634 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 -- 172.21.15.162:0/2989707634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46cc15d5b0 msgr2=0x7f46cc0b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46cc15d5b0 0x7f46cc0b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 -- 172.21.15.162:0/2989707634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46cc1618e0 msgr2=0x7f46cc0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46cc1618e0 0x7f46cc0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 -- 172.21.15.162:0/2989707634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0094d0 con 0x7f46cc0b2040 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.974+0000 7f46c9e00640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc0b2040 0x7f46cc0af5c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46bc02b8c0 tx=0x7f46bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.975+0000 7f46c2a00640 1 -- 172.21.15.162:0/2989707634 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc032940 con 0x7f46cc0b2040 2024-01-20T11:10:01.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.975+0000 7f46c2a00640 1 -- 172.21.15.162:0/2989707634 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc032aa0 con 0x7f46cc0b2040 2024-01-20T11:10:01.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.975+0000 7f46c2a00640 1 -- 172.21.15.162:0/2989707634 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc032e50 con 0x7f46cc0b2040 2024-01-20T11:10:01.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.975+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc0b08b0 con 0x7f46cc0b2040 2024-01-20T11:10:01.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.975+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc1530a0 con 0x7f46cc0b2040 2024-01-20T11:10:01.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.976+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc0b0dd0 con 0x7f46cc0b2040 2024-01-20T11:10:01.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.977+0000 7f46c2a00640 1 -- 172.21.15.162:0/2989707634 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f46bc04e450 con 0x7f46cc0b2040 2024-01-20T11:10:01.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.978+0000 7f46c2a00640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f46a406aed0 0x7f46a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:01.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.978+0000 7f46c2a00640 1 -- 172.21.15.162:0/2989707634 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f46bc0ab580 con 0x7f46cc0b2040 2024-01-20T11:10:01.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.978+0000 7f46c1200640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f46a406aed0 0x7f46a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:01.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.979+0000 7f46c1200640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f46a406aed0 0x7f46a406d390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0b3400 tx=0x7f46b4006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:01.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:01.982+0000 7f46c2a00640 1 -- 172.21.15.162:0/2989707634 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f46cc0b0dd0 con 0x7f46cc0b2040 2024-01-20T11:10:02.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.159+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f46cc0b0dd0 con 0x7f46cc0b2040 2024-01-20T11:10:02.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.166+0000 7f46c2a00640 1 -- 172.21.15.162:0/2989707634 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46cc0b0dd0 con 0x7f46cc0b2040 2024-01-20T11:10:02.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f46a406aed0 msgr2=0x7f46a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f46a406aed0 0x7f46a406d390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0b3400 tx=0x7f46b4006bf0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc0b2040 msgr2=0x7f46cc0af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc0b2040 0x7f46cc0af5c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46bc02b8c0 tx=0x7f46bc0046c0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 shutdown_connections 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f46a406aed0 0x7f46a406d390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46cc1618e0 0x7f46cc0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46cc15d5b0 0x7f46cc0b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 --2- 172.21.15.162:0/2989707634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46cc0b2040 0x7f46cc0af5c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 >> 172.21.15.162:0/2989707634 conn(0x7f46cc06a600 msgr2=0x7f46cc06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.168+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 shutdown_connections 2024-01-20T11:10:02.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.169+0000 7f46d1000640 1 -- 172.21.15.162:0/2989707634 wait complete. 2024-01-20T11:10:02.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_fragment_size_max 2024-01-20T11:10:02.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.387+0000 7f5ff9800640 1 Processor -- start 2024-01-20T11:10:02.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.387+0000 7f5ff9800640 1 -- start start 2024-01-20T11:10:02.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.388+0000 7f5ff9800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff415a380 0x7f5ff415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff9800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ff40cf060 0x7f5ff40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff9800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40b2ec0 con 0x7f5ff40b2040 2024-01-20T11:10:02.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff9800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff415ee30 con 0x7f5ff40cf060 2024-01-20T11:10:02.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff9800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4070eb0 con 0x7f5ff415a380 2024-01-20T11:10:02.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5febe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5ff40b2040 0x7f5ff40707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33976/0 (socket says 172.21.15.162:33976) 2024-01-20T11:10:02.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5febe00640 1 -- 172.21.15.162:0/1290761987 learned_addr learned my addr 172.21.15.162:0/1290761987 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:02.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff3400640 1 --2- 172.21.15.162:0/1290761987 >> v2:172.21.15.179:3300/0 conn(0x7f5ff40cf060 0x7f5ff40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff2a00640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff415a380 0x7f5ff415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893869443 0 0) 0x7f5fdc001110 con 0x7f5ff40b2040 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.389+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd4003520 con 0x7f5ff40b2040 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89399430 0 0) 0x7f5fd4003520 con 0x7f5ff40b2040 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff415a380 msgr2=0x7f5ff415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff415a380 0x7f5ff415e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 >> v2:172.21.15.179:3300/0 conn(0x7f5ff40cf060 msgr2=0x7f5ff40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 --2- 172.21.15.162:0/1290761987 >> v2:172.21.15.179:3300/0 conn(0x7f5ff40cf060 0x7f5ff40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40ce700 con 0x7f5ff40b2040 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f5fdc001800 con 0x7f5ff40b2040 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 >> v1:172.21.15.162:6789/0 conn(0x7f5ff40b2040 legacy=0x7f5ff40707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd4003970 0x7f5fd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd40047c0 0x7f5fd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff415a380 0x7f5fd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd400b980 con 0x7f5fd40047c0 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd400bac0 con 0x7f5fd4003970 2024-01-20T11:10:02.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd400bc00 con 0x7f5ff415a380 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5febe00640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd40047c0 0x7f5fd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.390+0000 7f5ff2a00640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd4003970 0x7f5fd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.391+0000 7f5febe00640 1 -- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff415a380 msgr2=0x7f5fd4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.391+0000 7f5febe00640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff415a380 0x7f5fd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.391+0000 7f5febe00640 1 -- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd4003970 msgr2=0x7f5fd4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.391+0000 7f5febe00640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd4003970 0x7f5fd4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.391+0000 7f5febe00640 1 -- 172.21.15.162:0/1290761987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4003520 con 0x7f5fd40047c0 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.392+0000 7f5febe00640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd40047c0 0x7f5fd4004c40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c240 tx=0x7f5fd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc13fdf8b8c0f527 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.392+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc005ad0 con 0x7f5fd40047c0 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.392+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc005c50 con 0x7f5fd40047c0 2024-01-20T11:10:02.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.392+0000 7f5ff2000640 1 -- 172.21.15.162:0/1290761987 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc02c8d0 con 0x7f5fd40047c0 2024-01-20T11:10:02.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.392+0000 7f5ff9800640 1 -- 172.21.15.162:0/1290761987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd40047c0 msgr2=0x7f5fd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.392+0000 7f5ff9800640 1 --2- 172.21.15.162:0/1290761987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd40047c0 0x7f5fd4004c40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c240 tx=0x7f5fd40057f0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.392+0000 7f5ff3400640 1 -- 172.21.15.162:0/1290761987 reap_dead start 2024-01-20T11:10:02.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.393+0000 7f5ff9800640 1 -- 172.21.15.162:0/1290761987 shutdown_connections 2024-01-20T11:10:02.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.393+0000 7f5ff9800640 1 -- 172.21.15.162:0/1290761987 >> 172.21.15.162:0/1290761987 conn(0x7f5ff406a600 msgr2=0x7f5ff406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:02.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.393+0000 7f5ff9800640 1 -- 172.21.15.162:0/1290761987 shutdown_connections 2024-01-20T11:10:02.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.393+0000 7f5ff9800640 1 -- 172.21.15.162:0/1290761987 wait complete. 2024-01-20T11:10:02.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.394+0000 7f5ff9800640 1 Processor -- start 2024-01-20T11:10:02.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.395+0000 7f5ff9800640 1 -- start start 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.395+0000 7f5ff9800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40047c0 0x7f5ff4142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.395+0000 7f5ff9800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff415a9c0 0x7f5ff415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.395+0000 7f5ff9800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff4151570 0x7f5ff41519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.395+0000 7f5ff9800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff415b380 con 0x7f5ff4151570 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.395+0000 7f5ff9800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff41522c0 con 0x7f5ff415a9c0 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.395+0000 7f5ff9800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff41525a0 con 0x7f5fd40047c0 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff4151570 0x7f5ff41519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff4151570 0x7f5ff41519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39808/0 (socket says 172.21.15.162:39808) 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 -- 172.21.15.162:0/3811781412 learned_addr learned my addr 172.21.15.162:0/3811781412 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5febe00640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff415a9c0 0x7f5ff415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff2a00640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40047c0 0x7f5ff4142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 -- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40047c0 msgr2=0x7f5ff4142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40047c0 0x7f5ff4142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 -- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff415a9c0 msgr2=0x7f5ff415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff415a9c0 0x7f5ff415ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 -- 172.21.15.162:0/3811781412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff4152880 con 0x7f5ff4151570 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5febe00640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff415a9c0 0x7f5ff415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff2a00640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40047c0 0x7f5ff4142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.396+0000 7f5ff3400640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff4151570 0x7f5ff41519f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406e8d0 tx=0x7f5fec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.397+0000 7f5feaa00640 1 -- 172.21.15.162:0/3811781412 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec010040 con 0x7f5ff4151570 2024-01-20T11:10:02.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.397+0000 7f5feaa00640 1 -- 172.21.15.162:0/3811781412 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec00bce0 con 0x7f5ff4151570 2024-01-20T11:10:02.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.397+0000 7f5feaa00640 1 -- 172.21.15.162:0/3811781412 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec014640 con 0x7f5ff4151570 2024-01-20T11:10:02.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.397+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff4152b60 con 0x7f5ff4151570 2024-01-20T11:10:02.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.397+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff4142540 con 0x7f5ff4151570 2024-01-20T11:10:02.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.398+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff404e970 con 0x7f5ff4151570 2024-01-20T11:10:02.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.399+0000 7f5feaa00640 1 -- 172.21.15.162:0/3811781412 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5fec0147a0 con 0x7f5ff4151570 2024-01-20T11:10:02.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.400+0000 7f5feaa00640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5fcc06af00 0x7f5fcc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.400+0000 7f5feaa00640 1 -- 172.21.15.162:0/3811781412 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5fec089c00 con 0x7f5ff4151570 2024-01-20T11:10:02.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.401+0000 7f5ff2a00640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5fcc06af00 0x7f5fcc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.401+0000 7f5ff2a00640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5fcc06af00 0x7f5fcc06d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40098b0 tx=0x7f5fe4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:02.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.405+0000 7f5feaa00640 1 -- 172.21.15.162:0/3811781412 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5fec054e80 con 0x7f5ff4151570 2024-01-20T11:10:02.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.598+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"} v 0) v1 -- 0x7f5ff406d550 con 0x7f5ff4151570 2024-01-20T11:10:02.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.605+0000 7f5feaa00640 1 -- 172.21.15.162:0/3811781412 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"}]=0 v15) v1 ==== 108+0+0 (secure 0 0 0) 0x7f5fec0180b0 con 0x7f5ff4151570 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5fcc06af00 msgr2=0x7f5fcc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5fcc06af00 0x7f5fcc06d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40098b0 tx=0x7f5fe4008040 comp rx=0 tx=0).stop 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff4151570 msgr2=0x7f5ff41519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff4151570 0x7f5ff41519f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406e8d0 tx=0x7f5fec00b480 comp rx=0 tx=0).stop 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 shutdown_connections 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff4151570 0x7f5ff41519f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f5fcc06af00 0x7f5fcc06d3c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff415a9c0 0x7f5ff415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 --2- 172.21.15.162:0/3811781412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40047c0 0x7f5ff4142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 >> 172.21.15.162:0/3811781412 conn(0x7f5ff406a600 msgr2=0x7f5ff40c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 shutdown_connections 2024-01-20T11:10:02.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.608+0000 7f5ff9800640 1 -- 172.21.15.162:0/3811781412 wait complete. 2024-01-20T11:10:02.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2024-01-20T11:10:02.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.826+0000 7fbd64000640 1 Processor -- start 2024-01-20T11:10:02.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.826+0000 7fbd64000640 1 -- start start 2024-01-20T11:10:02.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.828+0000 7fbd64000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd5c0cf220 0x7fbd5c0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.828+0000 7fbd64000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5c0ce460 con 0x7fbd5c0adf80 2024-01-20T11:10:02.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.828+0000 7fbd64000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5c0ce740 con 0x7fbd5c0cf6b0 2024-01-20T11:10:02.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.828+0000 7fbd64000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5c06d1d0 con 0x7fbd5c0cf220 2024-01-20T11:10:02.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.828+0000 7fbd60c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd5c0cf220 0x7fbd5c0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.828+0000 7fbd61600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbd5c0adf80 0x7fbd5c0ae360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33990/0 (socket says 172.21.15.162:33990) 2024-01-20T11:10:02.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.828+0000 7fbd61600640 1 -- 172.21.15.162:0/1794489147 learned_addr learned my addr 172.21.15.162:0/1794489147 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:02.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.829+0000 7fbd60c00640 1 -- 172.21.15.162:0/1794489147 >> v1:172.21.15.179:6789/0 conn(0x7fbd5c0cf6b0 legacy=0x7fbd5c15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:02.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.829+0000 7fbd60c00640 1 -- 172.21.15.162:0/1794489147 >> v1:172.21.15.162:6789/0 conn(0x7fbd5c0adf80 legacy=0x7fbd5c0ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.829+0000 7fbd60c00640 1 -- 172.21.15.162:0/1794489147 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c0cea20 con 0x7fbd5c0cf220 2024-01-20T11:10:02.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.829+0000 7fbd5be00640 1 -- 172.21.15.162:0/1794489147 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151161331 0 0) 0x7fbd5c0ce460 con 0x7fbd5c0adf80 2024-01-20T11:10:02.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.830+0000 7fbd60c00640 1 --2- 172.21.15.162:0/1794489147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c0705a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbd440097a0 tx=0x7fbd4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13088b2cdfb0972f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:02.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.830+0000 7fbd5be00640 1 -- 172.21.15.162:0/1794489147 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44031830 con 0x7fbd5c0cf220 2024-01-20T11:10:02.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.830+0000 7fbd5be00640 1 -- 172.21.15.162:0/1794489147 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44031990 con 0x7fbd5c0cf220 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.830+0000 7fbd5be00640 1 -- 172.21.15.162:0/1794489147 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44031d20 con 0x7fbd5c0cf220 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.831+0000 7fbd64000640 1 -- 172.21.15.162:0/1794489147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 msgr2=0x7fbd5c0705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.831+0000 7fbd64000640 1 --2- 172.21.15.162:0/1794489147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c0705a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbd440097a0 tx=0x7fbd4402b8d0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.831+0000 7fbd64000640 1 -- 172.21.15.162:0/1794489147 shutdown_connections 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.831+0000 7fbd64000640 1 --2- 172.21.15.162:0/1794489147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c0705a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.831+0000 7fbd64000640 1 -- 172.21.15.162:0/1794489147 >> 172.21.15.162:0/1794489147 conn(0x7fbd5c06a600 msgr2=0x7fbd5c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.831+0000 7fbd64000640 1 -- 172.21.15.162:0/1794489147 shutdown_connections 2024-01-20T11:10:02.832 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.831+0000 7fbd64000640 1 -- 172.21.15.162:0/1794489147 wait complete. 2024-01-20T11:10:02.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.832+0000 7fbd64000640 1 Processor -- start 2024-01-20T11:10:02.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.833+0000 7fbd64000640 1 -- start start 2024-01-20T11:10:02.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.833+0000 7fbd64000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c0adf80 0x7fbd5c1f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.833+0000 7fbd64000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.833+0000 7fbd64000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c0cf6b0 0x7fbd5c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd64000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c1f3920 con 0x7fbd5c0cf220 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd64000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c15b570 con 0x7fbd5c0cf6b0 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd64000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c15b810 con 0x7fbd5c0adf80 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39828/0 (socket says 172.21.15.162:39828) 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 -- 172.21.15.162:0/3876611903 learned_addr learned my addr 172.21.15.162:0/3876611903 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 -- 172.21.15.162:0/3876611903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c0adf80 msgr2=0x7fbd5c1f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c0adf80 0x7fbd5c1f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 -- 172.21.15.162:0/3876611903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c0cf6b0 msgr2=0x7fbd5c1593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c0cf6b0 0x7fbd5c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:02.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 -- 172.21.15.162:0/3876611903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd44009400 con 0x7fbd5c0cf220 2024-01-20T11:10:02.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.834+0000 7fbd60c00640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c145ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbd440098c0 tx=0x7fbd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:02.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.835+0000 7fbd59600640 1 -- 172.21.15.162:0/3876611903 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4403ba70 con 0x7fbd5c0cf220 2024-01-20T11:10:02.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.835+0000 7fbd59600640 1 -- 172.21.15.162:0/3876611903 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4403bbd0 con 0x7fbd5c0cf220 2024-01-20T11:10:02.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.835+0000 7fbd59600640 1 -- 172.21.15.162:0/3876611903 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440453f0 con 0x7fbd5c0cf220 2024-01-20T11:10:02.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.835+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c15baf0 con 0x7fbd5c0cf220 2024-01-20T11:10:02.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.835+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c15c0b0 con 0x7fbd5c0cf220 2024-01-20T11:10:02.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.836+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5c15c2a0 con 0x7fbd5c0cf220 2024-01-20T11:10:02.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.837+0000 7fbd59600640 1 -- 172.21.15.162:0/3876611903 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbd4404e450 con 0x7fbd5c0cf220 2024-01-20T11:10:02.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.837+0000 7fbd59600640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbd3406aed0 0x7fbd3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:02.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.838+0000 7fbd59600640 1 -- 172.21.15.162:0/3876611903 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd440ab6d0 con 0x7fbd5c0cf220 2024-01-20T11:10:02.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.838+0000 7fbd61600640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbd3406aed0 0x7fbd3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:02.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.838+0000 7fbd61600640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbd3406aed0 0x7fbd3406d390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c007fd0 tx=0x7fbd4c007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:02.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:02.842+0000 7fbd59600640 1 -- 172.21.15.162:0/3876611903 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbd44076800 con 0x7fbd5c0cf220 2024-01-20T11:10:03.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.093+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) v1 -- 0x7fbd5c04e970 con 0x7fbd5c0cf220 2024-01-20T11:10:03.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.778+0000 7fbd59600640 1 -- 172.21.15.162:0/3876611903 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v149) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbd44079e20 con 0x7fbd5c0cf220 2024-01-20T11:10:03.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbd3406aed0 msgr2=0x7fbd3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbd3406aed0 0x7fbd3406d390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c007fd0 tx=0x7fbd4c007920 comp rx=0 tx=0).stop 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 msgr2=0x7fbd5c145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c145ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbd440098c0 tx=0x7fbd440046c0 comp rx=0 tx=0).stop 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 shutdown_connections 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fbd3406aed0 0x7fbd3406d390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c0cf6b0 0x7fbd5c1593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd5c0cf220 0x7fbd5c145ae0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 --2- 172.21.15.162:0/3876611903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c0adf80 0x7fbd5c1f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 >> 172.21.15.162:0/3876611903 conn(0x7fbd5c06a600 msgr2=0x7fbd5c15f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 shutdown_connections 2024-01-20T11:10:03.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:03.783+0000 7fbd64000640 1 -- 172.21.15.162:0/3876611903 wait complete. 2024-01-20T11:10:03.805 INFO:tasks.cephfs_test_runner:That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). ... FAIL 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner: 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner:FAIL: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner:That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/test_strays.py", line 932, in test_dirfrag_limit 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner: self.fail("fragment size exceeded") 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner:AssertionError: fragment size exceeded 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner: 2024-01-20T11:10:03.806 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:Ran 2 tests in 113.916s 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner: 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner: 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:FAIL: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/test_strays.py", line 932, in test_dirfrag_limit 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner: self.fail("fragment size exceeded") 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner:AssertionError: fragment size exceeded 2024-01-20T11:10:03.807 INFO:tasks.cephfs_test_runner: 2024-01-20T11:10:03.808 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2024-01-20T11:10:04.057 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=72643f03030a4c31850dfed73a3e124c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2024-01-20T11:10:04.059 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-20T11:10:04.068 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-20T11:10:04.094 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-20T11:10:04.095 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:10:04.095 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:10:04.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053860,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-20T11:10:04.165 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-01-20T11:10:04.165 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:10:04.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053860,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249404k,nr_inodes=812351,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498816k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-20T11:10:04.216 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:10:04.216 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:10:04.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:10:04.274 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-20T11:10:04.275 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T11:10:04.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053848,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-20T11:10:04.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.325 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:10:04.381 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T11:10:04.382 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-20T11:10:04.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.383 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T11:10:04.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.481 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-20T11:10:04.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.580 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-01-20T11:10:04.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.719 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-01-20T11:10:04.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.763 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-01-20T11:10:04.893 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-01-20T11:10:04.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:10:04.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.897 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-01-20T11:10:04.955 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T11:10:04.955 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-20T11:10:04.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:04.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T11:10:05.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:05.057 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-20T11:10:05.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:05.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-01-20T11:10:05.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:05.276 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-01-20T11:10:05.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T11:10:05.324 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-01-20T11:10:05.401 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-01-20T11:10:05.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:10:05.404 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-20T11:10:05.413 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-20T11:10:05.414 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:10:05.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.631+0000 7f3262000640 1 Processor -- start 2024-01-20T11:10:05.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.631+0000 7f3262000640 1 -- start start 2024-01-20T11:10:05.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f3262000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f325c15a530 0x7f325c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:05.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f3262000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c071260 0x7f325c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f3262000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c15a910 con 0x7f325c06d7a0 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f3262000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c0ca390 con 0x7f325c15a530 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f3262000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c072960 con 0x7f325c071260 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f325b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f325c15a530 0x7f325c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f325b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f325c15a530 0x7f325c0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39838/0 (socket says 172.21.15.162:39838) 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.633+0000 7f325b400640 1 -- 172.21.15.162:0/3554600909 learned_addr learned my addr 172.21.15.162:0/3554600909 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.634+0000 7f3252800640 1 --2- 172.21.15.162:0/3554600909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c071260 0x7f325c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:05.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.634+0000 7f325b400640 1 -- 172.21.15.162:0/3554600909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c071260 msgr2=0x7f325c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:05.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.634+0000 7f325b400640 1 --2- 172.21.15.162:0/3554600909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c071260 0x7f325c0716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.634+0000 7f325b400640 1 -- 172.21.15.162:0/3554600909 >> v1:172.21.15.179:6789/0 conn(0x7f325c06d7a0 legacy=0x7f325c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:05.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.634+0000 7f325b400640 1 -- 172.21.15.162:0/3554600909 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c0ce730 con 0x7f325c15a530 2024-01-20T11:10:05.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.635+0000 7f325b400640 1 --2- 172.21.15.162:0/3554600909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c15a530 0x7f325c0cddb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f324c00d150 tx=0x7f324c02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdde8ac9c393b07 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:05.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.635+0000 7f325aa00640 1 -- 172.21.15.162:0/3554600909 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c02e9e0 con 0x7f325c15a530 2024-01-20T11:10:05.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.635+0000 7f325aa00640 1 -- 172.21.15.162:0/3554600909 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c02eb40 con 0x7f325c15a530 2024-01-20T11:10:05.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.635+0000 7f325aa00640 1 -- 172.21.15.162:0/3554600909 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c009600 con 0x7f325c15a530 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 -- 172.21.15.162:0/3554600909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c15a530 msgr2=0x7f325c0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 --2- 172.21.15.162:0/3554600909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c15a530 0x7f325c0cddb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f324c00d150 tx=0x7f324c02e040 comp rx=0 tx=0).stop 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 -- 172.21.15.162:0/3554600909 shutdown_connections 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 --2- 172.21.15.162:0/3554600909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c071260 0x7f325c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 --2- 172.21.15.162:0/3554600909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c15a530 0x7f325c0cddb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 -- 172.21.15.162:0/3554600909 >> 172.21.15.162:0/3554600909 conn(0x7f325c0b0cd0 msgr2=0x7f325c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 -- 172.21.15.162:0/3554600909 shutdown_connections 2024-01-20T11:10:05.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.636+0000 7f3262000640 1 -- 172.21.15.162:0/3554600909 wait complete. 2024-01-20T11:10:05.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.638+0000 7f3262000640 1 Processor -- start 2024-01-20T11:10:05.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.638+0000 7f3262000640 1 -- start start 2024-01-20T11:10:05.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3262000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f325c06d7a0 0x7f325c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:05.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3262000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c071260 0x7f325c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:05.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3262000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c15a530 0x7f325c15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:05.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3262000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c15afe0 con 0x7f325c071260 2024-01-20T11:10:05.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3262000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c15b280 con 0x7f325c06d7a0 2024-01-20T11:10:05.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3262000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c15b560 con 0x7f325c15a530 2024-01-20T11:10:05.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3252800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c071260 0x7f325c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:05.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3252800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c071260 0x7f325c0afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39842/0 (socket says 172.21.15.162:39842) 2024-01-20T11:10:05.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3252800640 1 -- 172.21.15.162:0/1687112885 learned_addr learned my addr 172.21.15.162:0/1687112885 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:05.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f3252800640 1 -- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c15a530 msgr2=0x7f325c15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:05.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f325be00640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c15a530 0x7f325c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:05.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.639+0000 7f325b400640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f325c06d7a0 0x7f325c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:05.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3252800640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c15a530 0x7f325c15c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3252800640 1 -- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f325c06d7a0 msgr2=0x7f325c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:05.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3252800640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f325c06d7a0 0x7f325c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3252800640 1 -- 172.21.15.162:0/1687112885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c00bd40 con 0x7f325c071260 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f325b400640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f325c06d7a0 0x7f325c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3252800640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c071260 0x7f325c0afde0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f324400c7f0 tx=0x7f324400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3253e00640 1 -- 172.21.15.162:0/1687112885 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244004220 con 0x7f325c071260 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3253e00640 1 -- 172.21.15.162:0/1687112885 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32440043a0 con 0x7f325c071260 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3253e00640 1 -- 172.21.15.162:0/1687112885 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244007860 con 0x7f325c071260 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c15b840 con 0x7f325c071260 2024-01-20T11:10:05.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.640+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c15be00 con 0x7f325c071260 2024-01-20T11:10:05.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.642+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c15bff0 con 0x7f325c071260 2024-01-20T11:10:05.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.642+0000 7f3253e00640 1 -- 172.21.15.162:0/1687112885 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3244007bd0 con 0x7f325c071260 2024-01-20T11:10:05.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.644+0000 7f3253e00640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f323406aed0 0x7f323406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:05.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.644+0000 7f3253e00640 1 -- 172.21.15.162:0/1687112885 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3244089360 con 0x7f325c071260 2024-01-20T11:10:05.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.644+0000 7f325b400640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f323406aed0 0x7f323406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:05.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.645+0000 7f325b400640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f323406aed0 0x7f323406d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f324c037000 tx=0x7f324c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:05.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.648+0000 7f3253e00640 1 -- 172.21.15.162:0/1687112885 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3244054530 con 0x7f325c071260 2024-01-20T11:10:05.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.840+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f325c0c9fb0 con 0x7f323406aed0 2024-01-20T11:10:05.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.844+0000 7f3253e00640 1 -- 172.21.15.162:0/1687112885 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48280 (secure 0 0 0) 0x7f324c03f440 con 0x7f323406aed0 2024-01-20T11:10:05.845 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:10:05.846 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:10:05.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f323406aed0 msgr2=0x7f323406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:05.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f323406aed0 0x7f323406d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f324c037000 tx=0x7f324c032000 comp rx=0 tx=0).stop 2024-01-20T11:10:05.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c071260 msgr2=0x7f325c0afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:05.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c071260 0x7f325c0afde0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f324400c7f0 tx=0x7f324400ccb0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 shutdown_connections 2024-01-20T11:10:05.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f325c15a530 0x7f325c15c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f325c071260 0x7f325c0afde0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f323406aed0 0x7f323406d390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 --2- 172.21.15.162:0/1687112885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f325c06d7a0 0x7f325c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:05.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 >> 172.21.15.162:0/1687112885 conn(0x7f325c0b0cd0 msgr2=0x7f325c0c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:05.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 shutdown_connections 2024-01-20T11:10:05.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:05.847+0000 7f3262000640 1 -- 172.21.15.162:0/1687112885 wait complete. 2024-01-20T11:10:05.865 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-01-20T11:10:05.629537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":246940,"kb_used_data":5800,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727780,"statfs":{"total":773094113280,"available":772841246720,"internally_reserved":0,"allocated":5939200,"data_stored":3105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-346676,"num_objects":-72,"num_object_clones":0,"num_object_copies":-144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-106,"num_write_kb":-410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.961798"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-20T11:10:01.198656+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:10:01.198656+0000","last_peered":"2024-01-20T11:10:01.198656+0000","last_clean":"2024-01-20T11:10:01.198656+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:10:01.198656+0000","last_undegraded":"2024-01-20T11:10:01.198656+0000","last_fullsized":"2024-01-20T11:10:01.198656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.1859999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.042},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":0.874}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.099}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.278},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.1339999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.331}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.296,"5min":3.343,"15min":3.343},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6830000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.079}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.216,"15min":1.2410000000000001},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.675,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4710000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2450000000000001,"15min":1.248},"min":{"1min":0.85699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.514,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.294,"15min":1.3049999999999999},"min":{"1min":0.82299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.694,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.284,"15min":1.2929999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.609,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.4690000000000001,"15min":1.488},"min":{"1min":1.0700000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.708,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.534}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.4419999999999999},"min":{"1min":0.88600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.6399999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.347,"5min":1.355,"15min":1.3560000000000001},"min":{"1min":0.88100000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.768,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.2370000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5309999999999999,"15min":1.542},"min":{"1min":1.1180000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9099999999999999,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.486},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.5369999999999999,"15min":1.5509999999999999},"min":{"1min":0.94399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9370000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.6180000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":1.034,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.853,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.673,"15min":1.6910000000000001},"min":{"1min":1.0680000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9950000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.361}]}]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1220000000000001,"15min":1.1180000000000001},"min":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.4550000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.117,"15min":1.121},"min":{"1min":0.78200000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7130000000000001,"5min":1.845,"15min":1.845},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.177,"5min":1.129,"15min":1.121},"min":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.607,"5min":1.968,"15min":1.968},"last":1.266}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.4850000000000001,"5min":1.544,"15min":1.544},"last":1.048},{"interface":"front","average":{"1min":1.371,"5min":1.202,"15min":1.1739999999999999},"min":{"1min":0.91600000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.123}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2689999999999999,"15min":1.2669999999999999},"min":{"1min":0.86699999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.81599999999999995,"5min":0.748,"15min":0.748},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3640000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4710000000000001,"15min":1.4750000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8129999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.6890000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.52,"15min":1.5169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.405,"15min":1.3899999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.968,"5min":2.069,"15min":2.069},"last":1.514}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5640000000000001,"15min":1.577},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8149999999999999,"5min":1.956,"15min":1.956},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6359999999999999,"15min":1.6339999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.089,"5min":2.105,"15min":2.105},"last":1.5620000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.623},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.115,"15min":1.103},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.82599999999999996}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.125,"15min":1.1259999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5249999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.21,"15min":1.216},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.704,"5min":1.954,"15min":1.954},"last":0.91300000000000003}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1679999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.1679999999999999,"15min":1.1599999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":1.853,"15min":1.853},"last":1.024}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.516,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3300000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.617,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.139}]},{"osd":5,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3580000000000001,"15min":1.3540000000000001},"min":{"1min":0.89200000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.839,"5min":2.681,"15min":2.681},"last":1.413}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.9119999999999999,"5min":2.968,"15min":2.968},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.472,"15min":1.458},"min":{"1min":0.88900000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.0510000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.47}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7490000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.5209999999999999,"15min":1.522},"min":{"1min":0.876,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.853,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.518}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4079999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.875}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.145},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.97899999999999998}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.385}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.514},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.474}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.337},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.7270000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.3169999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92600000000000005,"15min":0.85199999999999998},"min":{"1min":0.622,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":9.8870000000000005,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.1080000000000001,"15min":1.05},"min":{"1min":0.66900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.026,"5min":10.026,"15min":10.026},"last":1.4299999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.137,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.008},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.2090000000000001,"15min":1.129},"min":{"1min":0.66600000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.21,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":11.414999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.4359999999999999,"15min":1.367},"min":{"1min":0.95399999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":10.919,"5min":10.919,"15min":10.919},"last":1.552}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.4990000000000001,"15min":1.4350000000000001},"min":{"1min":1.073,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":11.1,"5min":11.1,"15min":11.1},"last":1.806},{"interface":"front","average":{"1min":1.996,"5min":1.54,"15min":1.464},"min":{"1min":0.89600000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":11.141999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":2.0289999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.4199999999999999,"15min":1.3799999999999999},"min":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":10.077999999999999,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.401,"15min":1.3899999999999999},"min":{"1min":1.0920000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.5029999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.6499999999999999,"15min":1.5760000000000001},"min":{"1min":1.22,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":11.185,"5min":11.185,"15min":11.185},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.845,"5min":1.536,"15min":1.484},"min":{"1min":1.008,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":1.069}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.52,"15min":1.4670000000000001},"min":{"1min":0.96999999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":10.234999999999999,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.599},{"interface":"front","average":{"1min":1.956,"5min":1.512,"15min":1.4379999999999999},"min":{"1min":1.2549999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":9.843,"5min":9.843,"15min":9.843},"last":1.748}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.0549999999999999,"15min":1.01},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":12.061,"5min":12.061,"15min":12.061},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1739999999999999,"15min":1.165},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.04,"15min":1.054},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.3929999999999998,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.889,"5min":1.3520000000000001,"15min":1.262},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.204999999999998,"5min":20.204999999999998,"15min":20.204999999999998},"last":0.92100000000000004}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.278,"15min":1.232},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":11.978999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":1.25}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.325,"15min":1.3540000000000001},"min":{"1min":0.77900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6839999999999999,"5min":5.21,"15min":5.21},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.528,"15min":1.46},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":15.596,"5min":15.596,"15min":15.596},"last":1.3300000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.5740000000000001,"15min":1.5649999999999999},"min":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.296},{"interface":"front","average":{"1min":1.296,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.966,"5min":5.242,"15min":5.242},"last":1.121}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.6040000000000001,"15min":1.5900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":10.784000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.423,"15min":1.4470000000000001},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.931,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.4610000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.601,"15min":1.5569999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.7150000000000001,"15min":1.6990000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":10.869999999999999,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.492}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.113,"5min":0.91000000000000003,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.1109999999999998,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":1.486}]},{"osd":2,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":1.02},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.90400000000000003,"15min":0.85999999999999999},"min":{"1min":0.48999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.976,"5min":5.976,"15min":5.976},"last":1.0800000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.03,"15min":1.006},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":1.194},{"interface":"front","average":{"1min":1.29,"5min":1.042,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.2110000000000003,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":1.153}]},{"osd":4,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.2450000000000001,"15min":1.2110000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.2640000000000002,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.25,"15min":1.234},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.387},{"interface":"front","average":{"1min":1.51,"5min":1.25,"15min":1.206},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":1.3580000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.2949999999999999,"15min":1.2749999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3899999999999999,"15min":1.3620000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5629999999999997,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.282}]},{"osd":7,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.337,"15min":1.296},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":6.1660000000000004,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.528}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:10:05.867 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:10:06.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.077+0000 7feeb9800640 1 Processor -- start 2024-01-20T11:10:06.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.078+0000 7feeb9800640 1 -- start start 2024-01-20T11:10:06.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.079+0000 7feeb9800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 0x7feeb40adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.079+0000 7feeb9800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb4070b60 con 0x7feeb4155a30 2024-01-20T11:10:06.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.079+0000 7feeb9800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb415bc00 con 0x7feeb415c6e0 2024-01-20T11:10:06.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.079+0000 7feeb9800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb415ba10 con 0x7feeb4070630 2024-01-20T11:10:06.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7feeb4155a30 0x7feeb40ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:33998/0 (socket says 172.21.15.162:33998) 2024-01-20T11:10:06.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2a00640 1 -- 172.21.15.162:0/1356384915 learned_addr learned my addr 172.21.15.162:0/1356384915 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:06.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231515868 0 0) 0x7feeb4070b60 con 0x7feeb4155a30 2024-01-20T11:10:06.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feea9e00640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 0x7feeb40adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee94003520 con 0x7feeb4155a30 2024-01-20T11:10:06.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 152220695 0 0) 0x7fee94003520 con 0x7feeb4155a30 2024-01-20T11:10:06.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 msgr2=0x7feeb40adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2000640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 0x7feeb40adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 >> v1:172.21.15.179:6789/0 conn(0x7feeb415c6e0 legacy=0x7feeb406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.080+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb415bee0 con 0x7feeb4155a30 2024-01-20T11:10:06.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7feea40019f0 con 0x7feeb4155a30 2024-01-20T11:10:06.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 >> v1:172.21.15.162:6789/0 conn(0x7feeb4155a30 legacy=0x7feeb40ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee940039a0 0x7fee94003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 0x7fee940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7fee94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400bab0 con 0x7fee94004d00 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400bc20 con 0x7fee940039a0 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400bde0 con 0x7feeb4070630 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb3400640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7fee94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb2a00640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee940039a0 0x7fee94003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feea9e00640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 0x7fee940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb3400640 1 -- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 msgr2=0x7fee940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb3400640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb4070630 0x7fee940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb3400640 1 -- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee940039a0 msgr2=0x7fee94003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb3400640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee940039a0 0x7fee94003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.081+0000 7feeb3400640 1 -- 172.21.15.162:0/1356384915 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94003520 con 0x7fee94004d00 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb3400640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7fee94005180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7feeac001750 tx=0x7fee940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a8e4a2ddd3f075 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0052d0 con 0x7fee94004d00 2024-01-20T11:10:06.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac02e050 con 0x7fee94004d00 2024-01-20T11:10:06.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb2000640 1 -- 172.21.15.162:0/1356384915 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0035f0 con 0x7fee94004d00 2024-01-20T11:10:06.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb9800640 1 -- 172.21.15.162:0/1356384915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 msgr2=0x7fee94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb9800640 1 --2- 172.21.15.162:0/1356384915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7fee94005180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7feeac001750 tx=0x7fee940057f0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb3400640 1 -- 172.21.15.162:0/1356384915 reap_dead start 2024-01-20T11:10:06.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb9800640 1 -- 172.21.15.162:0/1356384915 shutdown_connections 2024-01-20T11:10:06.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.083+0000 7feeb9800640 1 -- 172.21.15.162:0/1356384915 >> 172.21.15.162:0/1356384915 conn(0x7feeb40b0cd0 msgr2=0x7feeb40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:06.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.084+0000 7feeb9800640 1 -- 172.21.15.162:0/1356384915 shutdown_connections 2024-01-20T11:10:06.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.084+0000 7feeb9800640 1 -- 172.21.15.162:0/1356384915 wait complete. 2024-01-20T11:10:06.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.085+0000 7feeb9800640 1 Processor -- start 2024-01-20T11:10:06.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.086+0000 7feeb9800640 1 -- start start 2024-01-20T11:10:06.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.086+0000 7feeb9800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7feeb409c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.086+0000 7feeb9800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb4151b50 0x7feeb40cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.086+0000 7feeb9800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb41f3310 0x7feeb414a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.086+0000 7feeb9800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40af350 con 0x7fee94004d00 2024-01-20T11:10:06.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.086+0000 7feeb9800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb409b170 con 0x7feeb4151b50 2024-01-20T11:10:06.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.086+0000 7feeb9800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb409cb50 con 0x7feeb41f3310 2024-01-20T11:10:06.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7feeb409c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7feeb409c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39852/0 (socket says 172.21.15.162:39852) 2024-01-20T11:10:06.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 -- 172.21.15.162:0/398198938 learned_addr learned my addr 172.21.15.162:0/398198938 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:06.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 -- 172.21.15.162:0/398198938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb41f3310 msgr2=0x7feeb414a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb41f3310 0x7feeb414a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 -- 172.21.15.162:0/398198938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb4151b50 msgr2=0x7feeb40cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feea9e00640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb4151b50 0x7feeb40cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb4151b50 0x7feeb40cbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 -- 172.21.15.162:0/398198938 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4155f90 con 0x7fee94004d00 2024-01-20T11:10:06.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.087+0000 7feeb2a00640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7feeb409c610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feea4005fd0 tx=0x7feea400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.088+0000 7feeab400640 1 -- 172.21.15.162:0/398198938 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400ee50 con 0x7fee94004d00 2024-01-20T11:10:06.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.088+0000 7feeab400640 1 -- 172.21.15.162:0/398198938 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4013420 con 0x7fee94004d00 2024-01-20T11:10:06.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.088+0000 7feeab400640 1 -- 172.21.15.162:0/398198938 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40137d0 con 0x7fee94004d00 2024-01-20T11:10:06.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.088+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb40ae6d0 con 0x7fee94004d00 2024-01-20T11:10:06.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.088+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb40aec90 con 0x7fee94004d00 2024-01-20T11:10:06.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.089+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb40cefa0 con 0x7fee94004d00 2024-01-20T11:10:06.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.090+0000 7feeab400640 1 -- 172.21.15.162:0/398198938 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feea4013930 con 0x7fee94004d00 2024-01-20T11:10:06.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.091+0000 7feeab400640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fee8c06aed0 0x7fee8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.091+0000 7feeab400640 1 -- 172.21.15.162:0/398198938 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feea4089c30 con 0x7fee94004d00 2024-01-20T11:10:06.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.091+0000 7feea9e00640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fee8c06aed0 0x7fee8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.092+0000 7feea9e00640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fee8c06aed0 0x7fee8c06d390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feeb40cc4e0 tx=0x7fee9c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.095+0000 7feeab400640 1 -- 172.21.15.162:0/398198938 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feea4054d60 con 0x7fee94004d00 2024-01-20T11:10:06.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.284+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feeb4070e40 con 0x7fee8c06aed0 2024-01-20T11:10:06.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.287+0000 7feeab400640 1 -- 172.21.15.162:0/398198938 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48280 (secure 0 0 0) 0x7fee9c0095c0 con 0x7fee8c06aed0 2024-01-20T11:10:06.288 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:10:06.288 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:10:06.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fee8c06aed0 msgr2=0x7fee8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fee8c06aed0 0x7fee8c06d390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feeb40cc4e0 tx=0x7fee9c008040 comp rx=0 tx=0).stop 2024-01-20T11:10:06.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 msgr2=0x7feeb409c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7feeb409c610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feea4005fd0 tx=0x7feea400e530 comp rx=0 tx=0).stop 2024-01-20T11:10:06.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 shutdown_connections 2024-01-20T11:10:06.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb41f3310 0x7feeb414a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fee8c06aed0 0x7fee8c06d390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb4151b50 0x7feeb40cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 --2- 172.21.15.162:0/398198938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee94004d00 0x7feeb409c610 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 >> 172.21.15.162:0/398198938 conn(0x7feeb40b0cd0 msgr2=0x7feeb40cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:06.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 shutdown_connections 2024-01-20T11:10:06.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.290+0000 7feeb9800640 1 -- 172.21.15.162:0/398198938 wait complete. 2024-01-20T11:10:06.310 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-01-20T11:10:05.629537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":246940,"kb_used_data":5800,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727780,"statfs":{"total":773094113280,"available":772841246720,"internally_reserved":0,"allocated":5939200,"data_stored":3105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-346676,"num_objects":-72,"num_object_clones":0,"num_object_copies":-144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-106,"num_write_kb":-410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.961798"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-20T11:10:01.198656+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:10:01.198656+0000","last_peered":"2024-01-20T11:10:01.198656+0000","last_clean":"2024-01-20T11:10:01.198656+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:10:01.198656+0000","last_undegraded":"2024-01-20T11:10:01.198656+0000","last_fullsized":"2024-01-20T11:10:01.198656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.1859999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.042},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":0.874}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.099}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.278},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.1339999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.331}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.296,"5min":3.343,"15min":3.343},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6830000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.079}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.216,"15min":1.2410000000000001},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.675,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4710000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2450000000000001,"15min":1.248},"min":{"1min":0.85699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.514,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.294,"15min":1.3049999999999999},"min":{"1min":0.82299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.694,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.284,"15min":1.2929999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.609,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.4690000000000001,"15min":1.488},"min":{"1min":1.0700000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.708,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.534}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.4419999999999999},"min":{"1min":0.88600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.6399999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.347,"5min":1.355,"15min":1.3560000000000001},"min":{"1min":0.88100000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.768,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.2370000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5309999999999999,"15min":1.542},"min":{"1min":1.1180000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9099999999999999,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.486},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.5369999999999999,"15min":1.5509999999999999},"min":{"1min":0.94399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9370000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.6180000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":1.034,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.853,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.673,"15min":1.6910000000000001},"min":{"1min":1.0680000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9950000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.361}]}]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1220000000000001,"15min":1.1180000000000001},"min":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.4550000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.117,"15min":1.121},"min":{"1min":0.78200000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7130000000000001,"5min":1.845,"15min":1.845},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.177,"5min":1.129,"15min":1.121},"min":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.607,"5min":1.968,"15min":1.968},"last":1.266}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.4850000000000001,"5min":1.544,"15min":1.544},"last":1.048},{"interface":"front","average":{"1min":1.371,"5min":1.202,"15min":1.1739999999999999},"min":{"1min":0.91600000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.123}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2689999999999999,"15min":1.2669999999999999},"min":{"1min":0.86699999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.81599999999999995,"5min":0.748,"15min":0.748},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3640000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4710000000000001,"15min":1.4750000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8129999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.6890000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.52,"15min":1.5169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.405,"15min":1.3899999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.968,"5min":2.069,"15min":2.069},"last":1.514}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5640000000000001,"15min":1.577},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8149999999999999,"5min":1.956,"15min":1.956},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6359999999999999,"15min":1.6339999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.089,"5min":2.105,"15min":2.105},"last":1.5620000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.623},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.115,"15min":1.103},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.82599999999999996}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.125,"15min":1.1259999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5249999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.21,"15min":1.216},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.704,"5min":1.954,"15min":1.954},"last":0.91300000000000003}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1679999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.1679999999999999,"15min":1.1599999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":1.853,"15min":1.853},"last":1.024}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.516,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3300000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.617,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.139}]},{"osd":5,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3580000000000001,"15min":1.3540000000000001},"min":{"1min":0.89200000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.839,"5min":2.681,"15min":2.681},"last":1.413}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.9119999999999999,"5min":2.968,"15min":2.968},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.472,"15min":1.458},"min":{"1min":0.88900000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.0510000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.47}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7490000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.5209999999999999,"15min":1.522},"min":{"1min":0.876,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.853,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.518}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4079999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.875}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.145},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.97899999999999998}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.385}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.514},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.474}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.337},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.7270000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.3169999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92600000000000005,"15min":0.85199999999999998},"min":{"1min":0.622,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":9.8870000000000005,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.1080000000000001,"15min":1.05},"min":{"1min":0.66900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.026,"5min":10.026,"15min":10.026},"last":1.4299999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.137,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.008},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.2090000000000001,"15min":1.129},"min":{"1min":0.66600000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.21,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":11.414999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.4359999999999999,"15min":1.367},"min":{"1min":0.95399999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":10.919,"5min":10.919,"15min":10.919},"last":1.552}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.4990000000000001,"15min":1.4350000000000001},"min":{"1min":1.073,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":11.1,"5min":11.1,"15min":11.1},"last":1.806},{"interface":"front","average":{"1min":1.996,"5min":1.54,"15min":1.464},"min":{"1min":0.89600000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":11.141999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":2.0289999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.4199999999999999,"15min":1.3799999999999999},"min":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":10.077999999999999,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.401,"15min":1.3899999999999999},"min":{"1min":1.0920000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.5029999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.6499999999999999,"15min":1.5760000000000001},"min":{"1min":1.22,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":11.185,"5min":11.185,"15min":11.185},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.845,"5min":1.536,"15min":1.484},"min":{"1min":1.008,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":1.069}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.52,"15min":1.4670000000000001},"min":{"1min":0.96999999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":10.234999999999999,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.599},{"interface":"front","average":{"1min":1.956,"5min":1.512,"15min":1.4379999999999999},"min":{"1min":1.2549999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":9.843,"5min":9.843,"15min":9.843},"last":1.748}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.0549999999999999,"15min":1.01},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":12.061,"5min":12.061,"15min":12.061},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1739999999999999,"15min":1.165},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.04,"15min":1.054},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.3929999999999998,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.889,"5min":1.3520000000000001,"15min":1.262},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.204999999999998,"5min":20.204999999999998,"15min":20.204999999999998},"last":0.92100000000000004}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.278,"15min":1.232},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":11.978999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":1.25}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.325,"15min":1.3540000000000001},"min":{"1min":0.77900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6839999999999999,"5min":5.21,"15min":5.21},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.528,"15min":1.46},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":15.596,"5min":15.596,"15min":15.596},"last":1.3300000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.5740000000000001,"15min":1.5649999999999999},"min":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.296},{"interface":"front","average":{"1min":1.296,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.966,"5min":5.242,"15min":5.242},"last":1.121}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.6040000000000001,"15min":1.5900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":10.784000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.423,"15min":1.4470000000000001},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.931,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.4610000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.601,"15min":1.5569999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.7150000000000001,"15min":1.6990000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":10.869999999999999,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.492}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.113,"5min":0.91000000000000003,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.1109999999999998,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":1.486}]},{"osd":2,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":1.02},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.90400000000000003,"15min":0.85999999999999999},"min":{"1min":0.48999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.976,"5min":5.976,"15min":5.976},"last":1.0800000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.03,"15min":1.006},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":1.194},{"interface":"front","average":{"1min":1.29,"5min":1.042,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.2110000000000003,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":1.153}]},{"osd":4,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.2450000000000001,"15min":1.2110000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.2640000000000002,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.25,"15min":1.234},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.387},{"interface":"front","average":{"1min":1.51,"5min":1.25,"15min":1.206},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":1.3580000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.2949999999999999,"15min":1.2749999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3899999999999999,"15min":1.3620000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5629999999999997,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.282}]},{"osd":7,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.337,"15min":1.296},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":6.1660000000000004,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.528}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:10:06.311 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-20T11:10:06.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:10:06.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.517+0000 7facb4a00640 1 Processor -- start 2024-01-20T11:10:06.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.518+0000 7facb4a00640 1 -- start start 2024-01-20T11:10:06.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.519+0000 7facb4a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7facb015d420 0x7facb00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.519+0000 7facb4a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 0x7facb00b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.519+0000 7facb4a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00b2880 con 0x7facb015d800 2024-01-20T11:10:06.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.519+0000 7facb4a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb0161110 con 0x7facb015d420 2024-01-20T11:10:06.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.519+0000 7facb4a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb01613f0 con 0x7facb00d1f90 2024-01-20T11:10:06.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7faca6800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7facb015d800 0x7facb00d1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42784/0 (socket says 172.21.15.162:42784) 2024-01-20T11:10:06.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7faca6800640 1 -- 172.21.15.162:0/3115641391 learned_addr learned my addr 172.21.15.162:0/3115641391 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:06.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaf400640 1 --2- 172.21.15.162:0/3115641391 >> v2:172.21.15.179:3300/0 conn(0x7facb015d420 0x7facb00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facafe00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 0x7facb00b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466506681 0 0) 0x7facb00b2880 con 0x7facb015d800 2024-01-20T11:10:06.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac90003520 con 0x7facb015d800 2024-01-20T11:10:06.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4260313097 0 0) 0x7fac90003520 con 0x7facb015d800 2024-01-20T11:10:06.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 msgr2=0x7facb00b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 0x7facb00b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 >> v2:172.21.15.179:3300/0 conn(0x7facb015d420 msgr2=0x7facb00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 --2- 172.21.15.162:0/3115641391 >> v2:172.21.15.179:3300/0 conn(0x7facb015d420 0x7facb00d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.520+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb01616d0 con 0x7facb015d800 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fac98001690 con 0x7facb015d800 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 >> v1:172.21.15.162:6789/0 conn(0x7facb015d800 legacy=0x7facb00d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac90003970 0x7fac90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 0x7fac900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90004d00 0x7fac90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb0161110 con 0x7fac90003970 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01613f0 con 0x7fac90004d00 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9000ba00 con 0x7facb00d1f90 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaf400640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac90003970 0x7fac90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7faca6800640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 0x7fac900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facafe00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90004d00 0x7fac90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaf400640 1 -- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 msgr2=0x7fac900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaf400640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00d1f90 0x7fac900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaf400640 1 -- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90004d00 msgr2=0x7fac90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.521+0000 7facaf400640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90004d00 0x7fac90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.522+0000 7facaf400640 1 -- 172.21.15.162:0/3115641391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90003520 con 0x7fac90003970 2024-01-20T11:10:06.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.522+0000 7facafe00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90004d00 0x7fac90005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:06.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.523+0000 7facaf400640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac90003970 0x7fac90003d90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7faca0009ac0 tx=0x7fac900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7a6eef582c73d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.523+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca002c710 con 0x7fac90003970 2024-01-20T11:10:06.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.523+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca002c870 con 0x7fac90003970 2024-01-20T11:10:06.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.523+0000 7facaea00640 1 -- 172.21.15.162:0/3115641391 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca002cc00 con 0x7fac90003970 2024-01-20T11:10:06.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.524+0000 7facb4a00640 1 -- 172.21.15.162:0/3115641391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac90003970 msgr2=0x7fac90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.524+0000 7facb4a00640 1 --2- 172.21.15.162:0/3115641391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac90003970 0x7fac90003d90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7faca0009ac0 tx=0x7fac900057f0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.524+0000 7facafe00640 1 -- 172.21.15.162:0/3115641391 reap_dead start 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.524+0000 7facb4a00640 1 -- 172.21.15.162:0/3115641391 shutdown_connections 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.524+0000 7facb4a00640 1 -- 172.21.15.162:0/3115641391 >> 172.21.15.162:0/3115641391 conn(0x7facb008cc50 msgr2=0x7facb009c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.524+0000 7facb4a00640 1 -- 172.21.15.162:0/3115641391 shutdown_connections 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.524+0000 7facb4a00640 1 -- 172.21.15.162:0/3115641391 wait complete. 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.526+0000 7facb4a00640 1 Processor -- start 2024-01-20T11:10:06.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.526+0000 7facb4a00640 1 -- start start 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facb4a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90003970 0x7facb0160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facb4a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00cce60 0x7facb006c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facb4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb0159a20 0x7facb0159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facb4a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb015a3e0 con 0x7facb0159a20 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facb4a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb0160ba0 con 0x7fac90003970 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facb4a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb015dd90 con 0x7facb00cce60 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facafe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb0159a20 0x7facb0159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facafe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb0159a20 0x7facb0159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60304/0 (socket says 172.21.15.162:60304) 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facafe00640 1 -- 172.21.15.162:0/50407096 learned_addr learned my addr 172.21.15.162:0/50407096 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7faca6800640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00cce60 0x7facb006c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.527+0000 7facaf400640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90003970 0x7facb0160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facafe00640 1 -- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00cce60 msgr2=0x7facb006c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facafe00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00cce60 0x7facb006c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facafe00640 1 -- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90003970 msgr2=0x7facb0160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facafe00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90003970 0x7facb0160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facafe00640 1 -- 172.21.15.162:0/50407096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb015e070 con 0x7facb0159a20 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facaf400640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90003970 0x7facb0160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7faca6800640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00cce60 0x7facb006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facafe00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb0159a20 0x7facb0159ea0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7facb00d40f0 tx=0x7faca800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7faca7e00640 1 -- 172.21.15.162:0/50407096 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8017400 con 0x7facb0159a20 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7faca7e00640 1 -- 172.21.15.162:0/50407096 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8011040 con 0x7facb0159a20 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7faca7e00640 1 -- 172.21.15.162:0/50407096 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca80177c0 con 0x7facb0159a20 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb015e350 con 0x7facb0159a20 2024-01-20T11:10:06.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.528+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb015e9a0 con 0x7facb0159a20 2024-01-20T11:10:06.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.529+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb00ca370 con 0x7facb0159a20 2024-01-20T11:10:06.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.530+0000 7faca7e00640 1 -- 172.21.15.162:0/50407096 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7faca80203b0 con 0x7facb0159a20 2024-01-20T11:10:06.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.531+0000 7faca7e00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fac8806af00 0x7fac8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.531+0000 7faca7e00640 1 -- 172.21.15.162:0/50407096 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faca80895a0 con 0x7facb0159a20 2024-01-20T11:10:06.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.531+0000 7facaf400640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fac8806af00 0x7fac8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.532+0000 7facaf400640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fac8806af00 0x7fac8806d3c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faca0036000 tx=0x7faca0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.535+0000 7faca7e00640 1 -- 172.21.15.162:0/50407096 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7facb00ca370 con 0x7facb0159a20 2024-01-20T11:10:06.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.727+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facb0161c90 con 0x7fac8806af00 2024-01-20T11:10:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.731+0000 7faca7e00640 1 -- 172.21.15.162:0/50407096 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48280 (secure 0 0 0) 0x7faca002cae0 con 0x7fac8806af00 2024-01-20T11:10:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:10:06.733 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:10:06.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fac8806af00 msgr2=0x7fac8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fac8806af00 0x7fac8806d3c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faca0036000 tx=0x7faca0030000 comp rx=0 tx=0).stop 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb0159a20 msgr2=0x7facb0159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb0159a20 0x7facb0159ea0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7facb00d40f0 tx=0x7faca800f4a0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 shutdown_connections 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb0159a20 0x7facb0159ea0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00cce60 0x7facb006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fac8806af00 0x7fac8806d3c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 --2- 172.21.15.162:0/50407096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac90003970 0x7facb0160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.734+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 >> 172.21.15.162:0/50407096 conn(0x7facb008cc50 msgr2=0x7facb00b3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:06.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.735+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 shutdown_connections 2024-01-20T11:10:06.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.735+0000 7facb4a00640 1 -- 172.21.15.162:0/50407096 wait complete. 2024-01-20T11:10:06.752 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-01-20T11:10:05.629537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":246940,"kb_used_data":5800,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727780,"statfs":{"total":773094113280,"available":772841246720,"internally_reserved":0,"allocated":5939200,"data_stored":3105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-346676,"num_objects":-72,"num_object_clones":0,"num_object_copies":-144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-106,"num_write_kb":-410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.961798"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-20T11:10:01.198656+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:10:01.198656+0000","last_peered":"2024-01-20T11:10:01.198656+0000","last_clean":"2024-01-20T11:10:01.198656+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:10:01.198656+0000","last_undegraded":"2024-01-20T11:10:01.198656+0000","last_fullsized":"2024-01-20T11:10:01.198656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.1859999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.042},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":0.874}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.099}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.278},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.1339999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.331}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.296,"5min":3.343,"15min":3.343},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6830000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.079}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.216,"15min":1.2410000000000001},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.675,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4710000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2450000000000001,"15min":1.248},"min":{"1min":0.85699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.514,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.294,"15min":1.3049999999999999},"min":{"1min":0.82299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.694,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.284,"15min":1.2929999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.609,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.4690000000000001,"15min":1.488},"min":{"1min":1.0700000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.708,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.534}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.4419999999999999},"min":{"1min":0.88600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.6399999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.347,"5min":1.355,"15min":1.3560000000000001},"min":{"1min":0.88100000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.768,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.2370000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5309999999999999,"15min":1.542},"min":{"1min":1.1180000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9099999999999999,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.486},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.5369999999999999,"15min":1.5509999999999999},"min":{"1min":0.94399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9370000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.6180000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":1.034,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.853,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.673,"15min":1.6910000000000001},"min":{"1min":1.0680000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9950000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.361}]}]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1220000000000001,"15min":1.1180000000000001},"min":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.4550000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.117,"15min":1.121},"min":{"1min":0.78200000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7130000000000001,"5min":1.845,"15min":1.845},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.177,"5min":1.129,"15min":1.121},"min":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.607,"5min":1.968,"15min":1.968},"last":1.266}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.4850000000000001,"5min":1.544,"15min":1.544},"last":1.048},{"interface":"front","average":{"1min":1.371,"5min":1.202,"15min":1.1739999999999999},"min":{"1min":0.91600000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.123}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2689999999999999,"15min":1.2669999999999999},"min":{"1min":0.86699999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.81599999999999995,"5min":0.748,"15min":0.748},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3640000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4710000000000001,"15min":1.4750000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8129999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.6890000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.52,"15min":1.5169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.405,"15min":1.3899999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.968,"5min":2.069,"15min":2.069},"last":1.514}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5640000000000001,"15min":1.577},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8149999999999999,"5min":1.956,"15min":1.956},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6359999999999999,"15min":1.6339999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.089,"5min":2.105,"15min":2.105},"last":1.5620000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.623},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.115,"15min":1.103},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.82599999999999996}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.125,"15min":1.1259999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5249999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.21,"15min":1.216},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.704,"5min":1.954,"15min":1.954},"last":0.91300000000000003}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1679999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.1679999999999999,"15min":1.1599999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":1.853,"15min":1.853},"last":1.024}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.516,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3300000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.617,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.139}]},{"osd":5,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3580000000000001,"15min":1.3540000000000001},"min":{"1min":0.89200000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.839,"5min":2.681,"15min":2.681},"last":1.413}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.9119999999999999,"5min":2.968,"15min":2.968},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.472,"15min":1.458},"min":{"1min":0.88900000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.0510000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.47}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7490000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.5209999999999999,"15min":1.522},"min":{"1min":0.876,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.853,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.518}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4079999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.875}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.145},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.97899999999999998}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.385}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.514},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.474}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.337},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.7270000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.3169999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92600000000000005,"15min":0.85199999999999998},"min":{"1min":0.622,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":9.8870000000000005,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.1080000000000001,"15min":1.05},"min":{"1min":0.66900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.026,"5min":10.026,"15min":10.026},"last":1.4299999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.137,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.008},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.2090000000000001,"15min":1.129},"min":{"1min":0.66600000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.21,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":11.414999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.4359999999999999,"15min":1.367},"min":{"1min":0.95399999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":10.919,"5min":10.919,"15min":10.919},"last":1.552}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.4990000000000001,"15min":1.4350000000000001},"min":{"1min":1.073,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":11.1,"5min":11.1,"15min":11.1},"last":1.806},{"interface":"front","average":{"1min":1.996,"5min":1.54,"15min":1.464},"min":{"1min":0.89600000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":11.141999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":2.0289999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.4199999999999999,"15min":1.3799999999999999},"min":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":10.077999999999999,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.401,"15min":1.3899999999999999},"min":{"1min":1.0920000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.5029999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.6499999999999999,"15min":1.5760000000000001},"min":{"1min":1.22,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":11.185,"5min":11.185,"15min":11.185},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.845,"5min":1.536,"15min":1.484},"min":{"1min":1.008,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":1.069}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.52,"15min":1.4670000000000001},"min":{"1min":0.96999999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":10.234999999999999,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.599},{"interface":"front","average":{"1min":1.956,"5min":1.512,"15min":1.4379999999999999},"min":{"1min":1.2549999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":9.843,"5min":9.843,"15min":9.843},"last":1.748}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.0549999999999999,"15min":1.01},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":12.061,"5min":12.061,"15min":12.061},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1739999999999999,"15min":1.165},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.04,"15min":1.054},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.3929999999999998,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.889,"5min":1.3520000000000001,"15min":1.262},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.204999999999998,"5min":20.204999999999998,"15min":20.204999999999998},"last":0.92100000000000004}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.278,"15min":1.232},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":11.978999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":1.25}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.325,"15min":1.3540000000000001},"min":{"1min":0.77900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6839999999999999,"5min":5.21,"15min":5.21},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.528,"15min":1.46},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":15.596,"5min":15.596,"15min":15.596},"last":1.3300000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.5740000000000001,"15min":1.5649999999999999},"min":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.296},{"interface":"front","average":{"1min":1.296,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.966,"5min":5.242,"15min":5.242},"last":1.121}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.6040000000000001,"15min":1.5900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":10.784000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.423,"15min":1.4470000000000001},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.931,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.4610000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.601,"15min":1.5569999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.7150000000000001,"15min":1.6990000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":10.869999999999999,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.492}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.113,"5min":0.91000000000000003,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.1109999999999998,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":1.486}]},{"osd":2,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":1.02},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.90400000000000003,"15min":0.85999999999999999},"min":{"1min":0.48999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.976,"5min":5.976,"15min":5.976},"last":1.0800000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.03,"15min":1.006},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":1.194},{"interface":"front","average":{"1min":1.29,"5min":1.042,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.2110000000000003,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":1.153}]},{"osd":4,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.2450000000000001,"15min":1.2110000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.2640000000000002,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.25,"15min":1.234},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.387},{"interface":"front","average":{"1min":1.51,"5min":1.25,"15min":1.206},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":1.3580000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.2949999999999999,"15min":1.2749999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3899999999999999,"15min":1.3620000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5629999999999997,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.282}]},{"osd":7,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.337,"15min":1.296},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":6.1660000000000004,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.528}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:10:06.754 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T11:10:06.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.961+0000 7ffb2ee00640 1 Processor -- start 2024-01-20T11:10:06.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.961+0000 7ffb2ee00640 1 -- start start 2024-01-20T11:10:06.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb2ee00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb2815b300 0x7ffb280ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb2ee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb280c8350 0x7ffb280c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb2ee00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2815b6e0 con 0x7ffb28161240 2024-01-20T11:10:06.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb2ee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb280c8d40 con 0x7ffb280c8350 2024-01-20T11:10:06.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb2ee00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb280ce580 con 0x7ffb2815b300 2024-01-20T11:10:06.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb2ce00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ffb28161240 0x7ffb281616b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42798/0 (socket says 172.21.15.162:42798) 2024-01-20T11:10:06.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb2ce00640 1 -- 172.21.15.162:0/3919294298 learned_addr learned my addr 172.21.15.162:0/3919294298 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:06.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.963+0000 7ffb1f200640 1 --2- 172.21.15.162:0/3919294298 >> v2:172.21.15.162:3300/0 conn(0x7ffb280c8350 0x7ffb280c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.964+0000 7ffb27e00640 1 --2- 172.21.15.162:0/3919294298 >> v2:172.21.15.179:3300/0 conn(0x7ffb2815b300 0x7ffb280ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.964+0000 7ffb27400640 1 -- 172.21.15.162:0/3919294298 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217800123 0 0) 0x7ffb2815b6e0 con 0x7ffb28161240 2024-01-20T11:10:06.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.964+0000 7ffb27400640 1 -- 172.21.15.162:0/3919294298 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb08003520 con 0x7ffb28161240 2024-01-20T11:10:06.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.964+0000 7ffb1f200640 1 -- 172.21.15.162:0/3919294298 >> v2:172.21.15.179:3300/0 conn(0x7ffb2815b300 msgr2=0x7ffb280ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:06.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.964+0000 7ffb1f200640 1 --2- 172.21.15.162:0/3919294298 >> v2:172.21.15.179:3300/0 conn(0x7ffb2815b300 0x7ffb280ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.964+0000 7ffb1f200640 1 -- 172.21.15.162:0/3919294298 >> v1:172.21.15.162:6789/0 conn(0x7ffb28161240 legacy=0x7ffb281616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.964+0000 7ffb1f200640 1 -- 172.21.15.162:0/3919294298 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280cd6d0 con 0x7ffb280c8350 2024-01-20T11:10:06.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.966+0000 7ffb1f200640 1 --2- 172.21.15.162:0/3919294298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb280c8350 0x7ffb280c8800 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b1c30 tx=0x7ffb1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314db143822b7de2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.966+0000 7ffb27400640 1 -- 172.21.15.162:0/3919294298 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10031830 con 0x7ffb280c8350 2024-01-20T11:10:06.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.966+0000 7ffb27400640 1 -- 172.21.15.162:0/3919294298 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10031990 con 0x7ffb280c8350 2024-01-20T11:10:06.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.966+0000 7ffb27400640 1 -- 172.21.15.162:0/3919294298 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10031d20 con 0x7ffb280c8350 2024-01-20T11:10:06.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3919294298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb280c8350 msgr2=0x7ffb280c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3919294298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb280c8350 0x7ffb280c8800 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b1c30 tx=0x7ffb1002b8d0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3919294298 shutdown_connections 2024-01-20T11:10:06.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3919294298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb280c8350 0x7ffb280c8800 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3919294298 >> v2:172.21.15.179:3300/0 conn(0x7ffb2815b300 0x7ffb280ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3919294298 >> 172.21.15.162:0/3919294298 conn(0x7ffb280b0cd0 msgr2=0x7ffb280b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:06.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3919294298 shutdown_connections 2024-01-20T11:10:06.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.967+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3919294298 wait complete. 2024-01-20T11:10:06.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.969+0000 7ffb2ee00640 1 Processor -- start 2024-01-20T11:10:06.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.969+0000 7ffb2ee00640 1 -- start start 2024-01-20T11:10:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ee00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb280c8350 0x7ffb280af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ee00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb2815b300 0x7ffb2814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28161240 0x7ffb280b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280af430 con 0x7ffb28161240 2024-01-20T11:10:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ee00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280afd90 con 0x7ffb280c8350 2024-01-20T11:10:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ee00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280aedd0 con 0x7ffb2815b300 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28161240 0x7ffb280b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28161240 0x7ffb280b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60314/0 (socket says 172.21.15.162:60314) 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.970+0000 7ffb2ce00640 1 -- 172.21.15.162:0/3710339394 learned_addr learned my addr 172.21.15.162:0/3710339394 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb27e00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb280c8350 0x7ffb280af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb1f200640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb2815b300 0x7ffb2814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb2ce00640 1 -- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb2815b300 msgr2=0x7ffb2814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb2ce00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb2815b300 0x7ffb2814ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb2ce00640 1 -- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb280c8350 msgr2=0x7ffb280af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:06.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb2ce00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb280c8350 0x7ffb280af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:06.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb2ce00640 1 -- 172.21.15.162:0/3710339394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009400 con 0x7ffb28161240 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb2ce00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28161240 0x7ffb280b2530 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000caa0 tx=0x7ffb2000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb24c00640 1 -- 172.21.15.162:0/3710339394 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000ac00 con 0x7ffb28161240 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb24c00640 1 -- 172.21.15.162:0/3710339394 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2000ad60 con 0x7ffb28161240 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2815bb20 con 0x7ffb28161240 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.971+0000 7ffb24c00640 1 -- 172.21.15.162:0/3710339394 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20012620 con 0x7ffb28161240 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.972+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2815c0e0 con 0x7ffb28161240 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.973+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb280af570 con 0x7ffb28161240 2024-01-20T11:10:06.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.974+0000 7ffb24c00640 1 -- 172.21.15.162:0/3710339394 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ffb20007070 con 0x7ffb28161240 2024-01-20T11:10:06.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.974+0000 7ffb24c00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffb0006af00 0x7ffb0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:06.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.974+0000 7ffb24c00640 1 -- 172.21.15.162:0/3710339394 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffb20089380 con 0x7ffb28161240 2024-01-20T11:10:06.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.975+0000 7ffb27e00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffb0006af00 0x7ffb0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:06.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.975+0000 7ffb27e00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffb0006af00 0x7ffb0006d3c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb18006fd0 tx=0x7ffb18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:06.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:06.979+0000 7ffb24c00640 1 -- 172.21.15.162:0/3710339394 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ffb280af570 con 0x7ffb28161240 2024-01-20T11:10:07.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.178+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb280af570 con 0x7ffb28161240 2024-01-20T11:10:07.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.180+0000 7ffb24c00640 1 -- 172.21.15.162:0/3710339394 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13013 (secure 0 0 0) 0x7ffb280af570 con 0x7ffb28161240 2024-01-20T11:10:07.180 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:10:07.180 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":50,"fsid":"c5cb0dc2-b452-4376-8c48-87e4df6f2999","created":"2024-01-20T11:07:12.548962+0000","modified":"2024-01-20T11:10:01.750713+0000","last_up_change":"2024-01-20T11:07:24.360601+0000","last_in_change":"2024-01-20T11:07:16.060191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T11:07:25.650897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b83ea49-f8a9-4680-a5e0-987cf35cd6cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6801","nonce":4175730261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6803","nonce":4175730261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6808","nonce":4175730261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4175730261},{"type":"v1","addr":"172.21.15.162:6805","nonce":4175730261}]},"public_addr":"172.21.15.162:6801/4175730261","cluster_addr":"172.21.15.162:6803/4175730261","heartbeat_back_addr":"172.21.15.162:6808/4175730261","heartbeat_front_addr":"172.21.15.162:6805/4175730261","state":["exists","up"]},{"osd":1,"uuid":"d8a0c454-5468-4fc5-aa84-3021187ba1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6817","nonce":1182855875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6822","nonce":1182855875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6827","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6829","nonce":1182855875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1182855875},{"type":"v1","addr":"172.21.15.162:6825","nonce":1182855875}]},"public_addr":"172.21.15.162:6817/1182855875","cluster_addr":"172.21.15.162:6822/1182855875","heartbeat_back_addr":"172.21.15.162:6829/1182855875","heartbeat_front_addr":"172.21.15.162:6825/1182855875","state":["exists","up"]},{"osd":2,"uuid":"1313e521-b516-4b4f-a4fc-bafe7fd242a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6820","nonce":1945956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6823","nonce":1945956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6831","nonce":1945956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1945956166},{"type":"v1","addr":"172.21.15.162:6828","nonce":1945956166}]},"public_addr":"172.21.15.162:6820/1945956166","cluster_addr":"172.21.15.162:6823/1945956166","heartbeat_back_addr":"172.21.15.162:6831/1945956166","heartbeat_front_addr":"172.21.15.162:6828/1945956166","state":["exists","up"]},{"osd":3,"uuid":"cae2210e-7938-4e34-a453-5ee2645537eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6809","nonce":6791816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6811","nonce":6791816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6815","nonce":6791816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":6791816},{"type":"v1","addr":"172.21.15.162:6813","nonce":6791816}]},"public_addr":"172.21.15.162:6809/6791816","cluster_addr":"172.21.15.162:6811/6791816","heartbeat_back_addr":"172.21.15.162:6815/6791816","heartbeat_front_addr":"172.21.15.162:6813/6791816","state":["exists","up"]},{"osd":4,"uuid":"77b3aa4d-2013-4d10-b8ed-591a88d2666d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6809","nonce":4012736393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6814","nonce":4012736393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6823","nonce":4012736393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4012736393},{"type":"v1","addr":"172.21.15.179:6820","nonce":4012736393}]},"public_addr":"172.21.15.179:6809/4012736393","cluster_addr":"172.21.15.179:6814/4012736393","heartbeat_back_addr":"172.21.15.179:6823/4012736393","heartbeat_front_addr":"172.21.15.179:6820/4012736393","state":["exists","up"]},{"osd":5,"uuid":"d17d29a2-c4be-43ba-81d0-53f275c718ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6808","nonce":2271063545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6813","nonce":2271063545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6821","nonce":2271063545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2271063545},{"type":"v1","addr":"172.21.15.179:6817","nonce":2271063545}]},"public_addr":"172.21.15.179:6808/2271063545","cluster_addr":"172.21.15.179:6813/2271063545","heartbeat_back_addr":"172.21.15.179:6821/2271063545","heartbeat_front_addr":"172.21.15.179:6817/2271063545","state":["exists","up"]},{"osd":6,"uuid":"a0fc21ba-e59e-4e41-bbf3-e3cf462352e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6801","nonce":1904262509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6803","nonce":1904262509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6811","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6815","nonce":1904262509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1904262509},{"type":"v1","addr":"172.21.15.179:6807","nonce":1904262509}]},"public_addr":"172.21.15.179:6801/1904262509","cluster_addr":"172.21.15.179:6803/1904262509","heartbeat_back_addr":"172.21.15.179:6815/1904262509","heartbeat_front_addr":"172.21.15.179:6807/1904262509","state":["exists","up"]},{"osd":7,"uuid":"20e916ea-78fb-4575-8a9a-b9eeda5f91b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6825","nonce":3678721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6827","nonce":3678721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6831","nonce":3678721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":3678721212},{"type":"v1","addr":"172.21.15.179:6829","nonce":3678721212}]},"public_addr":"172.21.15.179:6825/3678721212","cluster_addr":"172.21.15.179:6827/3678721212","heartbeat_back_addr":"172.21.15.179:6831/3678721212","heartbeat_front_addr":"172.21.15.179:6829/3678721212","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.384196+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.627612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.704900+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417302+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.635398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.379884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.419022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T11:07:21.417496+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6835/4241600456":"2024-01-21T11:09:58.662126+0000","172.21.15.179:6833/4241600456":"2024-01-21T11:09:58.662126+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T11:10:07.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.182+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffb0006af00 msgr2=0x7ffb0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:07.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.182+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffb0006af00 0x7ffb0006d3c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb18006fd0 tx=0x7ffb18008040 comp rx=0 tx=0).stop 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.182+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28161240 msgr2=0x7ffb280b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.182+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28161240 0x7ffb280b2530 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000caa0 tx=0x7ffb2000cf60 comp rx=0 tx=0).stop 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 shutdown_connections 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28161240 0x7ffb280b2530 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb2815b300 0x7ffb2814ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7ffb0006af00 0x7ffb0006d3c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 --2- 172.21.15.162:0/3710339394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb280c8350 0x7ffb280af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:07.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 >> 172.21.15.162:0/3710339394 conn(0x7ffb280b0cd0 msgr2=0x7ffb280b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:07.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 shutdown_connections 2024-01-20T11:10:07.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:07.183+0000 7ffb2ee00640 1 -- 172.21.15.162:0/3710339394 wait complete. 2024-01-20T11:10:08.202 INFO:tasks.ceph:Scrubbing osd.0 2024-01-20T11:10:08.203 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:08.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.422+0000 7f7c09800640 1 Processor -- start 2024-01-20T11:10:08.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.422+0000 7f7c09800640 1 -- start start 2024-01-20T11:10:08.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c09800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c0406dc50 0x7f7c040cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c09800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040d0070 con 0x7f7c040ca490 2024-01-20T11:10:08.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c09800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040b27d0 con 0x7f7c04152290 2024-01-20T11:10:08.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c09800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c040cf7d0 con 0x7f7c0406dc50 2024-01-20T11:10:08.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c03400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7c040ca490 0x7f7c040cb9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42802/0 (socket says 172.21.15.162:42802) 2024-01-20T11:10:08.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c03400640 1 -- 172.21.15.162:0/1524770423 learned_addr learned my addr 172.21.15.162:0/1524770423 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:08.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c02000640 1 --2- 172.21.15.162:0/1524770423 >> v2:172.21.15.179:3300/0 conn(0x7f7c0406dc50 0x7f7c040cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.424+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093725517 0 0) 0x7f7c040d0070 con 0x7f7c040ca490 2024-01-20T11:10:08.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be4003520 con 0x7f7c040ca490 2024-01-20T11:10:08.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 800636521 0 0) 0x7f7be4003520 con 0x7f7c040ca490 2024-01-20T11:10:08.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 >> v2:172.21.15.179:3300/0 conn(0x7f7c0406dc50 msgr2=0x7f7c040cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:08.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 --2- 172.21.15.162:0/1524770423 >> v2:172.21.15.179:3300/0 conn(0x7f7c0406dc50 0x7f7c040cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 >> v1:172.21.15.179:6789/0 conn(0x7f7c04152290 legacy=0x7f7c0406d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040cfab0 con 0x7f7c040ca490 2024-01-20T11:10:08.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f7bfc0019f0 con 0x7f7c040ca490 2024-01-20T11:10:08.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 >> v1:172.21.15.162:6789/0 conn(0x7f7c040ca490 legacy=0x7f7c040cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be4003970 0x7f7be4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7be40047c0 0x7f7be4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4005180 0x7f7be400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040cf7d0 con 0x7f7be4003970 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be400c120 con 0x7f7be40047c0 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be400c2e0 con 0x7f7be4005180 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.425+0000 7f7c02a00640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be4003970 0x7f7be4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c02000640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7be40047c0 0x7f7be4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c03400640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4005180 0x7f7be400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c02a00640 1 -- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4005180 msgr2=0x7f7be400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:08.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c02a00640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4005180 0x7f7be400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c02a00640 1 -- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7be40047c0 msgr2=0x7f7be4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:08.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c02a00640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7be40047c0 0x7f7be4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c02a00640 1 -- 172.21.15.162:0/1524770423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4003520 con 0x7f7be4003970 2024-01-20T11:10:08.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.426+0000 7f7c03400640 1 -- 172.21.15.162:0/1524770423 reap_dead start 2024-01-20T11:10:08.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.427+0000 7f7c02a00640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be4003970 0x7f7be4003d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001750 tx=0x7f7be40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53162eca5f059 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:08.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.427+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40052d0 con 0x7f7be4003970 2024-01-20T11:10:08.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.427+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf402e050 con 0x7f7be4003970 2024-01-20T11:10:08.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.427+0000 7f7c01600640 1 -- 172.21.15.162:0/1524770423 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4003830 con 0x7f7be4003970 2024-01-20T11:10:08.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.428+0000 7f7c09800640 1 -- 172.21.15.162:0/1524770423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be4003970 msgr2=0x7f7be4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.428+0000 7f7c09800640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be4003970 0x7f7be4003d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4001750 tx=0x7f7be40057f0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.428+0000 7f7c09800640 1 -- 172.21.15.162:0/1524770423 shutdown_connections 2024-01-20T11:10:08.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.428+0000 7f7c09800640 1 --2- 172.21.15.162:0/1524770423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be4003970 0x7f7be4003d90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.428+0000 7f7c09800640 1 -- 172.21.15.162:0/1524770423 >> 172.21.15.162:0/1524770423 conn(0x7f7c0406a600 msgr2=0x7f7c0406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.428+0000 7f7c09800640 1 -- 172.21.15.162:0/1524770423 shutdown_connections 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.428+0000 7f7c09800640 1 -- 172.21.15.162:0/1524770423 wait complete. 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.430+0000 7f7c09800640 1 Processor -- start 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.430+0000 7f7c09800640 1 -- start start 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c09800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4003970 0x7f7c0414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c09800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c040ce7c0 0x7f7c040b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c09800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c04071770 0x7f7c040c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c09800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040b0c90 con 0x7f7c04071770 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c09800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04070760 con 0x7f7c040ce7c0 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c09800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040cec40 con 0x7f7be4003970 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c04071770 0x7f7c040c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c04071770 0x7f7c040c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60332/0 (socket says 172.21.15.162:60332) 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 -- 172.21.15.162:0/2600044721 learned_addr learned my addr 172.21.15.162:0/2600044721 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c02a00640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4003970 0x7f7c0414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c02000640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c040ce7c0 0x7f7c040b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 -- 172.21.15.162:0/2600044721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4003970 msgr2=0x7f7c0414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7be4003970 0x7f7c0414cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 -- 172.21.15.162:0/2600044721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c040ce7c0 msgr2=0x7f7c040b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c040ce7c0 0x7f7c040b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.431+0000 7f7c03400640 1 -- 172.21.15.162:0/2600044721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040709b0 con 0x7f7c04071770 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.432+0000 7f7c03400640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c04071770 0x7f7c040c8560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7c0406e560 tx=0x7f7bfc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.432+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc017070 con 0x7f7c04071770 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.432+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00ea80 con 0x7f7c04071770 2024-01-20T11:10:08.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.432+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00ec10 con 0x7f7c04071770 2024-01-20T11:10:08.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.432+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c04070c90 con 0x7f7c04071770 2024-01-20T11:10:08.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.432+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c04071250 con 0x7f7c04071770 2024-01-20T11:10:08.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.433+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c040cf110 con 0x7f7c04071770 2024-01-20T11:10:08.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.434+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7bfc00ed70 con 0x7f7c04071770 2024-01-20T11:10:08.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.435+0000 7f7bfaa00640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7bdc06aed0 0x7f7bdc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.435+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7bfc089ba0 con 0x7f7c04071770 2024-01-20T11:10:08.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.435+0000 7f7c02a00640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7bdc06aed0 0x7f7bdc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.436+0000 7f7bfaa00640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7f7bdc070d30 0x7f7bdc073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.436+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 --> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bdc073800 con 0x7f7bdc070d30 2024-01-20T11:10:08.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.436+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bfc089f10 con 0x7f7c04071770 2024-01-20T11:10:08.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.436+0000 7f7c02000640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7f7bdc070d30 0x7f7bdc073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.436+0000 7f7c02a00640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7bdc06aed0 0x7f7bdc06d390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4033000 tx=0x7f7bf4009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:08.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.437+0000 7f7c02000640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7f7bdc070d30 0x7f7bdc073150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:08.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.437+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== osd.0 v2:172.21.15.162:6800/4175730261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7bdc073800 con 0x7f7bdc070d30 2024-01-20T11:10:08.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.452+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 --> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c0404e970 con 0x7f7bdc070d30 2024-01-20T11:10:08.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.452+0000 7f7bfaa00640 1 -- 172.21.15.162:0/2600044721 <== osd.0 v2:172.21.15.162:6800/4175730261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c0404e970 con 0x7f7bdc070d30 2024-01-20T11:10:08.453 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:08.453 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:08.453 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:08.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7f7bdc070d30 msgr2=0x7f7bdc073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6800/4175730261,v1:172.21.15.162:6801/4175730261] conn(0x7f7bdc070d30 0x7f7bdc073150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7bdc06aed0 msgr2=0x7f7bdc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7bdc06aed0 0x7f7bdc06d390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4033000 tx=0x7f7bf4009030 comp rx=0 tx=0).stop 2024-01-20T11:10:08.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c04071770 msgr2=0x7f7c040c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 --2- 172.21.15.162:0/2600044721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c04071770 0x7f7c040c8560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7c0406e560 tx=0x7f7bfc007bc0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c03400640 1 -- 172.21.15.162:0/2600044721 reap_dead start 2024-01-20T11:10:08.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 shutdown_connections 2024-01-20T11:10:08.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 >> 172.21.15.162:0/2600044721 conn(0x7f7c0406a600 msgr2=0x7f7c040ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:08.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 shutdown_connections 2024-01-20T11:10:08.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.453+0000 7f7c09800640 1 -- 172.21.15.162:0/2600044721 wait complete. 2024-01-20T11:10:08.470 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-20T11:10:08.672 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.672+0000 7f1b47800640 1 Processor -- start 2024-01-20T11:10:08.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.672+0000 7f1b47800640 1 -- start start 2024-01-20T11:10:08.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.673+0000 7f1b47800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1b40141bb0 0x7f1b400ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.673+0000 7f1b47800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b400cee70 con 0x7f1b4006cdf0 2024-01-20T11:10:08.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.673+0000 7f1b47800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b400cd7a0 con 0x7f1b400ce6a0 2024-01-20T11:10:08.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.673+0000 7f1b47800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b400ceb90 con 0x7f1b40141bb0 2024-01-20T11:10:08.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.674+0000 7f1b44e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1b40141bb0 0x7f1b400ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.674+0000 7f1b45800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1b4006cdf0 0x7f1b400717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42812/0 (socket says 172.21.15.162:42812) 2024-01-20T11:10:08.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.674+0000 7f1b45800640 1 -- 172.21.15.162:0/1785317150 learned_addr learned my addr 172.21.15.162:0/1785317150 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:08.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.674+0000 7f1b44e00640 1 -- 172.21.15.162:0/1785317150 >> v1:172.21.15.179:6789/0 conn(0x7f1b400ce6a0 legacy=0x7f1b4006c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.674+0000 7f1b44e00640 1 -- 172.21.15.162:0/1785317150 >> v1:172.21.15.162:6789/0 conn(0x7f1b4006cdf0 legacy=0x7f1b400717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.674+0000 7f1b3f400640 1 -- 172.21.15.162:0/1785317150 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254456953 0 0) 0x7f1b38001110 con 0x7f1b4006cdf0 2024-01-20T11:10:08.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.674+0000 7f1b44e00640 1 -- 172.21.15.162:0/1785317150 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400cd150 con 0x7f1b40141bb0 2024-01-20T11:10:08.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.676+0000 7f1b44e00640 1 --2- 172.21.15.162:0/1785317150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b40141bb0 0x7f1b400ce160 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009d90 tx=0x7f1b3002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379cda53571092fb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:08.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.676+0000 7f1b3f400640 1 -- 172.21.15.162:0/1785317150 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3002cc60 con 0x7f1b40141bb0 2024-01-20T11:10:08.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.676+0000 7f1b3f400640 1 -- 172.21.15.162:0/1785317150 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3002cdc0 con 0x7f1b40141bb0 2024-01-20T11:10:08.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.676+0000 7f1b3f400640 1 -- 172.21.15.162:0/1785317150 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30034660 con 0x7f1b40141bb0 2024-01-20T11:10:08.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.677+0000 7f1b47800640 1 -- 172.21.15.162:0/1785317150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b40141bb0 msgr2=0x7f1b400ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.677+0000 7f1b47800640 1 --2- 172.21.15.162:0/1785317150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b40141bb0 0x7f1b400ce160 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009d90 tx=0x7f1b3002beb0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.677+0000 7f1b47800640 1 -- 172.21.15.162:0/1785317150 shutdown_connections 2024-01-20T11:10:08.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.677+0000 7f1b47800640 1 --2- 172.21.15.162:0/1785317150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b40141bb0 0x7f1b400ce160 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.677+0000 7f1b47800640 1 -- 172.21.15.162:0/1785317150 >> 172.21.15.162:0/1785317150 conn(0x7f1b4006a600 msgr2=0x7f1b4006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:08.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.677+0000 7f1b47800640 1 -- 172.21.15.162:0/1785317150 shutdown_connections 2024-01-20T11:10:08.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.677+0000 7f1b47800640 1 -- 172.21.15.162:0/1785317150 wait complete. 2024-01-20T11:10:08.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.679+0000 7f1b47800640 1 Processor -- start 2024-01-20T11:10:08.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.679+0000 7f1b47800640 1 -- start start 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b47800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4006cdf0 0x7f1b401e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b47800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b400ce6a0 0x7f1b400b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b47800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b40141bb0 0x7f1b400b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b47800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b1f80 con 0x7f1b4006cdf0 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b47800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b1050 con 0x7f1b40141bb0 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b47800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b3ab0 con 0x7f1b400ce6a0 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b44e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4006cdf0 0x7f1b401e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b44e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4006cdf0 0x7f1b401e3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60360/0 (socket says 172.21.15.162:60360) 2024-01-20T11:10:08.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b44e00640 1 -- 172.21.15.162:0/3940327168 learned_addr learned my addr 172.21.15.162:0/3940327168 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:08.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b45800640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b40141bb0 0x7f1b400b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.680+0000 7f1b3fe00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b400ce6a0 0x7f1b400b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b44e00640 1 -- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b400ce6a0 msgr2=0x7f1b400b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b44e00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b400ce6a0 0x7f1b400b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b44e00640 1 -- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b40141bb0 msgr2=0x7f1b400b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b44e00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b40141bb0 0x7f1b400b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b44e00640 1 -- 172.21.15.162:0/3940327168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009a70 con 0x7f1b4006cdf0 2024-01-20T11:10:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b3fe00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b400ce6a0 0x7f1b400b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b44e00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4006cdf0 0x7f1b401e3ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1b30037040 tx=0x7f1b30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b3cc00640 1 -- 172.21.15.162:0/3940327168 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30040650 con 0x7f1b4006cdf0 2024-01-20T11:10:08.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b3cc00640 1 -- 172.21.15.162:0/3940327168 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b300407b0 con 0x7f1b4006cdf0 2024-01-20T11:10:08.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b3cc00640 1 -- 172.21.15.162:0/3940327168 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30040b60 con 0x7f1b4006cdf0 2024-01-20T11:10:08.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b400b1ce0 con 0x7f1b4006cdf0 2024-01-20T11:10:08.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.681+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b400b2fd0 con 0x7f1b4006cdf0 2024-01-20T11:10:08.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.682+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4004e970 con 0x7f1b4006cdf0 2024-01-20T11:10:08.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.683+0000 7f1b3cc00640 1 -- 172.21.15.162:0/3940327168 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1b30040cc0 con 0x7f1b4006cdf0 2024-01-20T11:10:08.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.684+0000 7f1b3cc00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1b1806aed0 0x7f1b1806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:08.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.684+0000 7f1b3cc00640 1 -- 172.21.15.162:0/3940327168 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b300ac2d0 con 0x7f1b4006cdf0 2024-01-20T11:10:08.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.684+0000 7f1b3fe00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1b1806aed0 0x7f1b1806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:08.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.685+0000 7f1b3fe00640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1b1806aed0 0x7f1b1806d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1b4013e340 tx=0x7f1b28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:08.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.689+0000 7f1b3cc00640 1 -- 172.21.15.162:0/3940327168 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1b300774a0 con 0x7f1b4006cdf0 2024-01-20T11:10:08.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.880+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b40141460 con 0x7f1b1806aed0 2024-01-20T11:10:08.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.881+0000 7f1b3cc00640 1 -- 172.21.15.162:0/3940327168 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b40141460 con 0x7f1b1806aed0 2024-01-20T11:10:08.882 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 0 to deep-scrub 2024-01-20T11:10:08.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.883+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1b1806aed0 msgr2=0x7f1b1806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.883+0000 7f1b47800640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1b1806aed0 0x7f1b1806d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1b4013e340 tx=0x7f1b28009040 comp rx=0 tx=0).stop 2024-01-20T11:10:08.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.883+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4006cdf0 msgr2=0x7f1b401e3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:08.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.883+0000 7f1b47800640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4006cdf0 0x7f1b401e3ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1b30037040 tx=0x7f1b30004a40 comp rx=0 tx=0).stop 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 shutdown_connections 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f1b1806aed0 0x7f1b1806d390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b40141bb0 0x7f1b400b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b400ce6a0 0x7f1b400b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 --2- 172.21.15.162:0/3940327168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b4006cdf0 0x7f1b401e3ff0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 >> 172.21.15.162:0/3940327168 conn(0x7f1b4006a600 msgr2=0x7f1b4015c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 shutdown_connections 2024-01-20T11:10:08.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:08.884+0000 7f1b47800640 1 -- 172.21.15.162:0/3940327168 wait complete. 2024-01-20T11:10:08.903 INFO:tasks.ceph:Scrubbing osd.1 2024-01-20T11:10:08.903 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:09.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.114+0000 7f3327400640 1 Processor -- start 2024-01-20T11:10:09.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.114+0000 7f3327400640 1 -- start start 2024-01-20T11:10:09.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3327400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f33200d3a10 0x7f33200cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3327400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f33201612e0 0x7f332006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3327400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332015dbc0 con 0x7f332015d7e0 2024-01-20T11:10:09.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3327400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3320161850 con 0x7f33201612e0 2024-01-20T11:10:09.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3327400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3320161b30 con 0x7f33200d3a10 2024-01-20T11:10:09.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3324a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f332015d7e0 0x7f33200d3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42820/0 (socket says 172.21.15.162:42820) 2024-01-20T11:10:09.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3324a00640 1 -- 172.21.15.162:0/341016736 learned_addr learned my addr 172.21.15.162:0/341016736 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:09.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.116+0000 7f3325400640 1 --2- 172.21.15.162:0/341016736 >> v2:172.21.15.162:3300/0 conn(0x7f33201612e0 0x7f332006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.117+0000 7f331fe00640 1 --2- 172.21.15.162:0/341016736 >> v2:172.21.15.179:3300/0 conn(0x7f33200d3a10 0x7f33200cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.117+0000 7f3325400640 1 -- 172.21.15.162:0/341016736 >> v2:172.21.15.179:3300/0 conn(0x7f33200d3a10 msgr2=0x7f33200cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.117+0000 7f3325400640 1 --2- 172.21.15.162:0/341016736 >> v2:172.21.15.179:3300/0 conn(0x7f33200d3a10 0x7f33200cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.117+0000 7f3325400640 1 -- 172.21.15.162:0/341016736 >> v1:172.21.15.162:6789/0 conn(0x7f332015d7e0 legacy=0x7f33200d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.117+0000 7f331f400640 1 -- 172.21.15.162:0/341016736 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012624632 0 0) 0x7f3310001110 con 0x7f332015d7e0 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.117+0000 7f3325400640 1 -- 172.21.15.162:0/341016736 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320161e10 con 0x7f33201612e0 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.117+0000 7f331fe00640 1 --2- 172.21.15.162:0/341016736 >> v2:172.21.15.179:3300/0 conn(0x7f33200d3a10 0x7f33200cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.118+0000 7f3325400640 1 --2- 172.21.15.162:0/341016736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f332006c400 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f332006d860 tx=0x7f331802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91540d3f8515b378 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.118+0000 7f331f400640 1 -- 172.21.15.162:0/341016736 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331802cc80 con 0x7f33201612e0 2024-01-20T11:10:09.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.118+0000 7f331f400640 1 -- 172.21.15.162:0/341016736 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331802cde0 con 0x7f33201612e0 2024-01-20T11:10:09.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.118+0000 7f331f400640 1 -- 172.21.15.162:0/341016736 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318034660 con 0x7f33201612e0 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 -- 172.21.15.162:0/341016736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 msgr2=0x7f332006c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 --2- 172.21.15.162:0/341016736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f332006c400 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f332006d860 tx=0x7f331802bed0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 -- 172.21.15.162:0/341016736 shutdown_connections 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 --2- 172.21.15.162:0/341016736 >> v2:172.21.15.179:3300/0 conn(0x7f33200d3a10 0x7f33200cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 --2- 172.21.15.162:0/341016736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f332006c400 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 -- 172.21.15.162:0/341016736 >> 172.21.15.162:0/341016736 conn(0x7f332009c7e0 msgr2=0x7f332008afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 -- 172.21.15.162:0/341016736 shutdown_connections 2024-01-20T11:10:09.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.119+0000 7f3327400640 1 -- 172.21.15.162:0/341016736 wait complete. 2024-01-20T11:10:09.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.121+0000 7f3327400640 1 Processor -- start 2024-01-20T11:10:09.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.121+0000 7f3327400640 1 -- start start 2024-01-20T11:10:09.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3327400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33200d3a10 0x7f33201f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3327400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f332015d7e0 0x7f33200b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3327400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f33200b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3327400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33201f3ed0 con 0x7f33201612e0 2024-01-20T11:10:09.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3327400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33201f32c0 con 0x7f332015d7e0 2024-01-20T11:10:09.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3327400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33201f35a0 con 0x7f33200d3a10 2024-01-20T11:10:09.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f33200b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f33200b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60378/0 (socket says 172.21.15.162:60378) 2024-01-20T11:10:09.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 -- 172.21.15.162:0/2984876282 learned_addr learned my addr 172.21.15.162:0/2984876282 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:09.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f331fe00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f332015d7e0 0x7f33200b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3324a00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33200d3a10 0x7f33201f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 -- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33200d3a10 msgr2=0x7f33201f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33200d3a10 0x7f33201f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 -- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f332015d7e0 msgr2=0x7f33200b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f332015d7e0 0x7f33200b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3325400640 1 -- 172.21.15.162:0/2984876282 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318009a70 con 0x7f33201612e0 2024-01-20T11:10:09.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f331fe00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f332015d7e0 0x7f33200b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:09.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.123+0000 7f3324a00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33200d3a10 0x7f33201f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:09.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.124+0000 7f3325400640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f33200b6570 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3318009e80 tx=0x7f3318004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.124+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318040650 con 0x7f33201612e0 2024-01-20T11:10:09.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.124+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33180407b0 con 0x7f33201612e0 2024-01-20T11:10:09.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.124+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33201f3880 con 0x7f33201612e0 2024-01-20T11:10:09.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.124+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318040b60 con 0x7f33201612e0 2024-01-20T11:10:09.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.124+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33200b10c0 con 0x7f33201612e0 2024-01-20T11:10:09.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.125+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f332006bee0 con 0x7f33201612e0 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.126+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3318040cc0 con 0x7f33201612e0 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.127+0000 7f331cc00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f32f806aed0 0x7f32f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.127+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f33180ac250 con 0x7f33201612e0 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.127+0000 7f3324a00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f32f806aed0 0x7f32f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.127+0000 7f331cc00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f32f8070d30 0x7f32f8073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.127+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 --> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32f8073800 con 0x7f32f8070d30 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.127+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33180ae830 con 0x7f33201612e0 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.128+0000 7f331fe00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f32f8070d30 0x7f32f8073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.128+0000 7f3324a00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f32f806aed0 0x7f32f806d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3310001370 tx=0x7f3310009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.128+0000 7f331fe00640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f32f8070d30 0x7f32f8073150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.129+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== osd.1 v2:172.21.15.162:6816/1182855875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f32f8073800 con 0x7f32f8070d30 2024-01-20T11:10:09.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.143+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 --> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f332004e970 con 0x7f32f8070d30 2024-01-20T11:10:09.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f331cc00640 1 -- 172.21.15.162:0/2984876282 <== osd.1 v2:172.21.15.162:6816/1182855875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f332004e970 con 0x7f32f8070d30 2024-01-20T11:10:09.144 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:09.144 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:09.145 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f32f8070d30 msgr2=0x7f32f8073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f3327400640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6816/1182855875,v1:172.21.15.162:6817/1182855875] conn(0x7f32f8070d30 0x7f32f8073150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f32f806aed0 msgr2=0x7f32f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f3327400640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f32f806aed0 0x7f32f806d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3310001370 tx=0x7f3310009040 comp rx=0 tx=0).stop 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 msgr2=0x7f33200b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f3327400640 1 --2- 172.21.15.162:0/2984876282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33201612e0 0x7f33200b6570 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3318009e80 tx=0x7f3318004a40 comp rx=0 tx=0).stop 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.144+0000 7f3325400640 1 -- 172.21.15.162:0/2984876282 reap_dead start 2024-01-20T11:10:09.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.145+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 shutdown_connections 2024-01-20T11:10:09.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.145+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 >> 172.21.15.162:0/2984876282 conn(0x7f332009c7e0 msgr2=0x7f33200cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:09.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.145+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 shutdown_connections 2024-01-20T11:10:09.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.145+0000 7f3327400640 1 -- 172.21.15.162:0/2984876282 wait complete. 2024-01-20T11:10:09.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-20T11:10:09.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.359+0000 7f12c9400640 1 Processor -- start 2024-01-20T11:10:09.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.360+0000 7f12c9400640 1 -- start start 2024-01-20T11:10:09.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.361+0000 7f12c9400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c4141bb0 0x7f12c40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.361+0000 7f12c9400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12c40ce6a0 0x7f12c406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.361+0000 7f12c9400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c40cee70 con 0x7f12c40cdc30 2024-01-20T11:10:09.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.361+0000 7f12c9400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40cd7a0 con 0x7f12c40ce6a0 2024-01-20T11:10:09.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.361+0000 7f12c9400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40ceb90 con 0x7f12c4141bb0 2024-01-20T11:10:09.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.362+0000 7f12b9c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12c40ce6a0 0x7f12c406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.362+0000 7f12c2800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c4141bb0 0x7f12c40ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.362+0000 7f12b9c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12c40ce6a0 0x7f12c406c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:53096/0 (socket says 172.21.15.162:53096) 2024-01-20T11:10:09.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.362+0000 7f12b9c00640 1 -- 172.21.15.162:0/3863446689 learned_addr learned my addr 172.21.15.162:0/3863446689 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:09.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.363+0000 7f12b9c00640 1 -- 172.21.15.162:0/3863446689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c4141bb0 msgr2=0x7f12c40ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:09.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.363+0000 7f12b9c00640 1 --2- 172.21.15.162:0/3863446689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c4141bb0 0x7f12c40ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.363+0000 7f12b9c00640 1 -- 172.21.15.162:0/3863446689 >> v1:172.21.15.179:6789/0 conn(0x7f12c40cdc30 legacy=0x7f12c415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.363+0000 7f12b9c00640 1 -- 172.21.15.162:0/3863446689 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40cd150 con 0x7f12c40ce6a0 2024-01-20T11:10:09.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.364+0000 7f12b9c00640 1 --2- 172.21.15.162:0/3863446689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 0x7f12c406c6e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009870 tx=0x7f12ac02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb084b1f4ee2191 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c1e00640 1 -- 172.21.15.162:0/3863446689 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac031640 con 0x7f12c40ce6a0 2024-01-20T11:10:09.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c1e00640 1 -- 172.21.15.162:0/3863446689 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac0317a0 con 0x7f12c40ce6a0 2024-01-20T11:10:09.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c1e00640 1 -- 172.21.15.162:0/3863446689 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac031b30 con 0x7f12c40ce6a0 2024-01-20T11:10:09.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c9400640 1 -- 172.21.15.162:0/3863446689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 msgr2=0x7f12c406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c9400640 1 --2- 172.21.15.162:0/3863446689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 0x7f12c406c6e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009870 tx=0x7f12ac02b8f0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c9400640 1 -- 172.21.15.162:0/3863446689 shutdown_connections 2024-01-20T11:10:09.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c9400640 1 --2- 172.21.15.162:0/3863446689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 0x7f12c406c6e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.365+0000 7f12c9400640 1 --2- 172.21.15.162:0/3863446689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c4141bb0 0x7f12c40ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.366+0000 7f12c9400640 1 -- 172.21.15.162:0/3863446689 >> 172.21.15.162:0/3863446689 conn(0x7f12c406a600 msgr2=0x7f12c406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:09.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.366+0000 7f12c9400640 1 -- 172.21.15.162:0/3863446689 shutdown_connections 2024-01-20T11:10:09.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.366+0000 7f12c9400640 1 -- 172.21.15.162:0/3863446689 wait complete. 2024-01-20T11:10:09.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.367+0000 7f12c9400640 1 Processor -- start 2024-01-20T11:10:09.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.367+0000 7f12c9400640 1 -- start start 2024-01-20T11:10:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.368+0000 7f12c9400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c40cdc30 0x7f12c41f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.368+0000 7f12c9400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 0x7f12c40b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.368+0000 7f12c9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c4141bb0 0x7f12c415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.368+0000 7f12c9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41f4440 con 0x7f12c4141bb0 2024-01-20T11:10:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.368+0000 7f12c9400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40b34a0 con 0x7f12c40ce6a0 2024-01-20T11:10:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.368+0000 7f12c9400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c415b490 con 0x7f12c40cdc30 2024-01-20T11:10:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c4141bb0 0x7f12c415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c4141bb0 0x7f12c415af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60384/0 (socket says 172.21.15.162:60384) 2024-01-20T11:10:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 -- 172.21.15.162:0/4001720478 learned_addr learned my addr 172.21.15.162:0/4001720478 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:09.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c2800640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c40cdc30 0x7f12c41f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12b9c00640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 0x7f12c40b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 -- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c40cdc30 msgr2=0x7f12c41f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c40cdc30 0x7f12c41f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 -- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 msgr2=0x7f12c40b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 0x7f12c40b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.369+0000 7f12c3200640 1 -- 172.21.15.162:0/4001720478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0094d0 con 0x7f12c4141bb0 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.370+0000 7f12c3200640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c4141bb0 0x7f12c415af50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c7a0 tx=0x7f12bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.370+0000 7f12bb400640 1 -- 172.21.15.162:0/4001720478 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc003b70 con 0x7f12c4141bb0 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.370+0000 7f12bb400640 1 -- 172.21.15.162:0/4001720478 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc003cf0 con 0x7f12c4141bb0 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.370+0000 7f12bb400640 1 -- 172.21.15.162:0/4001720478 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc003ea0 con 0x7f12c4141bb0 2024-01-20T11:10:09.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.370+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c40b1ec0 con 0x7f12c4141bb0 2024-01-20T11:10:09.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.370+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c40b2480 con 0x7f12c4141bb0 2024-01-20T11:10:09.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.371+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c404e970 con 0x7f12c4141bb0 2024-01-20T11:10:09.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.372+0000 7f12bb400640 1 -- 172.21.15.162:0/4001720478 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f12bc00aa90 con 0x7f12c4141bb0 2024-01-20T11:10:09.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.373+0000 7f12bb400640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f129c06af00 0x7f129c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.373+0000 7f12bb400640 1 -- 172.21.15.162:0/4001720478 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f12bc088fe0 con 0x7f12c4141bb0 2024-01-20T11:10:09.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.373+0000 7f12c2800640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f129c06af00 0x7f129c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.374+0000 7f12c2800640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f129c06af00 0x7f129c06d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f12c4141500 tx=0x7f12b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.377+0000 7f12bb400640 1 -- 172.21.15.162:0/4001720478 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f12bc054170 con 0x7f12c4141bb0 2024-01-20T11:10:09.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.567+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f12c40cee70 con 0x7f129c06af00 2024-01-20T11:10:09.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.568+0000 7f12bb400640 1 -- 172.21.15.162:0/4001720478 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f12c40cee70 con 0x7f129c06af00 2024-01-20T11:10:09.568 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 1 to deep-scrub 2024-01-20T11:10:09.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f129c06af00 msgr2=0x7f129c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f129c06af00 0x7f129c06d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f12c4141500 tx=0x7f12b4008040 comp rx=0 tx=0).stop 2024-01-20T11:10:09.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c4141bb0 msgr2=0x7f12c415af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c4141bb0 0x7f12c415af50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c7a0 tx=0x7f12bc00cc60 comp rx=0 tx=0).stop 2024-01-20T11:10:09.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 shutdown_connections 2024-01-20T11:10:09.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c4141bb0 0x7f12c415af50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f129c06af00 0x7f129c06d3c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c40ce6a0 0x7f12c40b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 --2- 172.21.15.162:0/4001720478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c40cdc30 0x7f12c41f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.570+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 >> 172.21.15.162:0/4001720478 conn(0x7f12c406a600 msgr2=0x7f12c40ade90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:09.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.571+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 shutdown_connections 2024-01-20T11:10:09.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.571+0000 7f12c9400640 1 -- 172.21.15.162:0/4001720478 wait complete. 2024-01-20T11:10:09.590 INFO:tasks.ceph:Scrubbing osd.2 2024-01-20T11:10:09.590 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:09.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.809+0000 7f7e30800640 1 Processor -- start 2024-01-20T11:10:09.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.809+0000 7f7e30800640 1 -- start start 2024-01-20T11:10:09.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e30800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e280ca490 0x7f7e280cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e30800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280d0070 con 0x7f7e2806dc50 2024-01-20T11:10:09.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e30800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280b27d0 con 0x7f7e28152290 2024-01-20T11:10:09.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e30800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e280cf7d0 con 0x7f7e280ca490 2024-01-20T11:10:09.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e2d400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7e2806dc50 0x7f7e280cb9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42830/0 (socket says 172.21.15.162:42830) 2024-01-20T11:10:09.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e2d400640 1 -- 172.21.15.162:0/3402254636 learned_addr learned my addr 172.21.15.162:0/3402254636 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:09.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e2e800640 1 --2- 172.21.15.162:0/3402254636 >> v2:172.21.15.179:3300/0 conn(0x7f7e280ca490 0x7f7e280cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001692856 0 0) 0x7f7e280d0070 con 0x7f7e2806dc50 2024-01-20T11:10:09.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.811+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e08003520 con 0x7f7e2806dc50 2024-01-20T11:10:09.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 911943082 0 0) 0x7f7e08003520 con 0x7f7e2806dc50 2024-01-20T11:10:09.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 >> v2:172.21.15.179:3300/0 conn(0x7f7e280ca490 msgr2=0x7f7e280cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 --2- 172.21.15.162:0/3402254636 >> v2:172.21.15.179:3300/0 conn(0x7f7e280ca490 0x7f7e280cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 >> v1:172.21.15.179:6789/0 conn(0x7f7e28152290 legacy=0x7f7e2806d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280cfab0 con 0x7f7e2806dc50 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f7e10001670 con 0x7f7e2806dc50 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 >> v1:172.21.15.162:6789/0 conn(0x7f7e2806dc50 legacy=0x7f7e280cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08003970 0x7f7e08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e080047c0 0x7f7e08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e0800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280cf7d0 con 0x7f7e08005180 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0800c120 con 0x7f7e08003970 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0800c2e0 con 0x7f7e080047c0 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.812+0000 7f7e2e800640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e0800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.813+0000 7f7e2e800640 1 -- 172.21.15.162:0/3402254636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e080047c0 msgr2=0x7f7e08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.813+0000 7f7e2e800640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e080047c0 0x7f7e08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.813+0000 7f7e2e800640 1 -- 172.21.15.162:0/3402254636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08003970 msgr2=0x7f7e08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.813+0000 7f7e2e800640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08003970 0x7f7e08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.813+0000 7f7e2e800640 1 -- 172.21.15.162:0/3402254636 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08003520 con 0x7f7e08005180 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.813+0000 7f7e2e800640 1 -- 172.21.15.162:0/3402254636 reap_dead start 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.814+0000 7f7e2e800640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e0800b980 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009fc0 tx=0x7f7e080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b218369f5ef62c7a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.814+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2002cc60 con 0x7f7e08005180 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.814+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2000f040 con 0x7f7e08005180 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.814+0000 7f7e2ca00640 1 -- 172.21.15.162:0/3402254636 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20003990 con 0x7f7e08005180 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.814+0000 7f7e30800640 1 -- 172.21.15.162:0/3402254636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 msgr2=0x7f7e0800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.814+0000 7f7e30800640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e0800b980 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009fc0 tx=0x7f7e080057f0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.815+0000 7f7e30800640 1 -- 172.21.15.162:0/3402254636 shutdown_connections 2024-01-20T11:10:09.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.815+0000 7f7e30800640 1 --2- 172.21.15.162:0/3402254636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e0800b980 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.815+0000 7f7e30800640 1 -- 172.21.15.162:0/3402254636 >> 172.21.15.162:0/3402254636 conn(0x7f7e2806a600 msgr2=0x7f7e2806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:09.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.815+0000 7f7e30800640 1 -- 172.21.15.162:0/3402254636 shutdown_connections 2024-01-20T11:10:09.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.815+0000 7f7e30800640 1 -- 172.21.15.162:0/3402254636 wait complete. 2024-01-20T11:10:09.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.816+0000 7f7e30800640 1 Processor -- start 2024-01-20T11:10:09.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.817+0000 7f7e30800640 1 -- start start 2024-01-20T11:10:09.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.817+0000 7f7e30800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e2815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.817+0000 7f7e30800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2815c160 0x7f7e281f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.817+0000 7f7e30800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e28071cc0 0x7f7e28072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.817+0000 7f7e30800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28072680 con 0x7f7e08005180 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.817+0000 7f7e30800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2815c8d0 con 0x7f7e2815c160 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.817+0000 7f7e30800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2815cbb0 con 0x7f7e28071cc0 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e2815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e2815e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60398/0 (socket says 172.21.15.162:60398) 2024-01-20T11:10:09.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 -- 172.21.15.162:0/2150186323 learned_addr learned my addr 172.21.15.162:0/2150186323 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2e800640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e28071cc0 0x7f7e28072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2d400640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2815c160 0x7f7e281f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 -- 172.21.15.162:0/2150186323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e28071cc0 msgr2=0x7f7e28072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e28071cc0 0x7f7e28072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 -- 172.21.15.162:0/2150186323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2815c160 msgr2=0x7f7e281f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2815c160 0x7f7e281f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.818+0000 7f7e2de00640 1 -- 172.21.15.162:0/2150186323 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2815ce90 con 0x7f7e08005180 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.819+0000 7f7e2de00640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e2815e3c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c400 tx=0x7f7e1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.819+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180052d0 con 0x7f7e08005180 2024-01-20T11:10:09.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.819+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18005470 con 0x7f7e08005180 2024-01-20T11:10:09.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.819+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18003830 con 0x7f7e08005180 2024-01-20T11:10:09.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.819+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e281f0eb0 con 0x7f7e08005180 2024-01-20T11:10:09.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.819+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e281f0b10 con 0x7f7e08005180 2024-01-20T11:10:09.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.820+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e281f0d30 con 0x7f7e08005180 2024-01-20T11:10:09.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.821+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7e18003990 con 0x7f7e08005180 2024-01-20T11:10:09.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.822+0000 7f7e26000640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7e0006af00 0x7f7e0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.822+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7e18088490 con 0x7f7e08005180 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.822+0000 7f7e26000640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f7e00070d60 0x7f7e00073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.822+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 --> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e00073830 con 0x7f7e00070d60 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.822+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e1808aa70 con 0x7f7e08005180 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.822+0000 7f7e2d400640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7e0006af00 0x7f7e0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.822+0000 7f7e2e800640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f7e00070d60 0x7f7e00073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.823+0000 7f7e2d400640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7e0006af00 0x7f7e0006d3c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7e10000ff0 tx=0x7f7e10009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.823+0000 7f7e2e800640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f7e00070d60 0x7f7e00073180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:09.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.824+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== osd.2 v2:172.21.15.162:6818/1945956166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7e00073830 con 0x7f7e00070d60 2024-01-20T11:10:09.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.838+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 --> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7e280b34c0 con 0x7f7e00070d60 2024-01-20T11:10:09.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e26000640 1 -- 172.21.15.162:0/2150186323 <== osd.2 v2:172.21.15.162:6818/1945956166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7e280b34c0 con 0x7f7e00070d60 2024-01-20T11:10:09.839 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:09.840 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:09.840 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:09.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f7e00070d60 msgr2=0x7f7e00073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6818/1945956166,v1:172.21.15.162:6820/1945956166] conn(0x7f7e00070d60 0x7f7e00073180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7e0006af00 msgr2=0x7f7e0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f7e0006af00 0x7f7e0006d3c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7e10000ff0 tx=0x7f7e10009040 comp rx=0 tx=0).stop 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 msgr2=0x7f7e2815e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 --2- 172.21.15.162:0/2150186323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08005180 0x7f7e2815e3c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c400 tx=0x7f7e1800c8c0 comp rx=0 tx=0).stop 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e2e800640 1 -- 172.21.15.162:0/2150186323 reap_dead start 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 shutdown_connections 2024-01-20T11:10:09.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 >> 172.21.15.162:0/2150186323 conn(0x7f7e2806a600 msgr2=0x7f7e280b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:09.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.839+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 shutdown_connections 2024-01-20T11:10:09.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:09.840+0000 7f7e30800640 1 -- 172.21.15.162:0/2150186323 wait complete. 2024-01-20T11:10:09.858 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-20T11:10:10.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.070+0000 7fdf40a00640 1 Processor -- start 2024-01-20T11:10:10.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.071+0000 7fdf40a00640 1 -- start start 2024-01-20T11:10:10.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.072+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf3806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.072+0000 7fdf40a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf381618e0 0x7fdf38161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.072+0000 7fdf40a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf380ae130 con 0x7fdf380b2040 2024-01-20T11:10:10.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.072+0000 7fdf40a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf380ae410 con 0x7fdf381618e0 2024-01-20T11:10:10.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.072+0000 7fdf40a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf380ae6f0 con 0x7fdf3815d5b0 2024-01-20T11:10:10.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.073+0000 7fdf3d600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf381618e0 0x7fdf38161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.073+0000 7fdf3e000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf3806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.073+0000 7fdf3e000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf3806c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:51968/0 (socket says 172.21.15.162:51968) 2024-01-20T11:10:10.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.073+0000 7fdf3d600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf381618e0 0x7fdf38161d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:53130/0 (socket says 172.21.15.162:53130) 2024-01-20T11:10:10.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.073+0000 7fdf3e000640 1 -- 172.21.15.162:0/3442111307 learned_addr learned my addr 172.21.15.162:0/3442111307 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:10.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.074+0000 7fdf3e000640 1 -- 172.21.15.162:0/3442111307 >> v2:172.21.15.179:3300/0 conn(0x7fdf381618e0 msgr2=0x7fdf38161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:10.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.074+0000 7fdf3e000640 1 --2- 172.21.15.162:0/3442111307 >> v2:172.21.15.179:3300/0 conn(0x7fdf381618e0 0x7fdf38161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.074+0000 7fdf3e000640 1 -- 172.21.15.162:0/3442111307 >> v1:172.21.15.179:6789/0 conn(0x7fdf380b2040 legacy=0x7fdf380cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.074+0000 7fdf3e000640 1 -- 172.21.15.162:0/3442111307 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf381613c0 con 0x7fdf3815d5b0 2024-01-20T11:10:10.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.074+0000 7fdf3d600640 1 --2- 172.21.15.162:0/3442111307 >> v2:172.21.15.179:3300/0 conn(0x7fdf381618e0 0x7fdf38161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:10:10.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.075+0000 7fdf3e000640 1 --2- 172.21.15.162:0/3442111307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf3806c3b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009870 tx=0x7fdf3002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cca3ce4ef9ef723c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.076+0000 7fdf3cc00640 1 -- 172.21.15.162:0/3442111307 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30031640 con 0x7fdf3815d5b0 2024-01-20T11:10:10.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.076+0000 7fdf3cc00640 1 -- 172.21.15.162:0/3442111307 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf300317a0 con 0x7fdf3815d5b0 2024-01-20T11:10:10.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.076+0000 7fdf3cc00640 1 -- 172.21.15.162:0/3442111307 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30031b30 con 0x7fdf3815d5b0 2024-01-20T11:10:10.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 -- 172.21.15.162:0/3442111307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 msgr2=0x7fdf3806c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3442111307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf3806c3b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009870 tx=0x7fdf3002b8f0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 -- 172.21.15.162:0/3442111307 shutdown_connections 2024-01-20T11:10:10.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3442111307 >> v2:172.21.15.179:3300/0 conn(0x7fdf381618e0 0x7fdf38161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3442111307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf3806c3b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 -- 172.21.15.162:0/3442111307 >> 172.21.15.162:0/3442111307 conn(0x7fdf3806a600 msgr2=0x7fdf3806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:10.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 -- 172.21.15.162:0/3442111307 shutdown_connections 2024-01-20T11:10:10.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.077+0000 7fdf40a00640 1 -- 172.21.15.162:0/3442111307 wait complete. 2024-01-20T11:10:10.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.079+0000 7fdf40a00640 1 Processor -- start 2024-01-20T11:10:10.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.079+0000 7fdf40a00640 1 -- start start 2024-01-20T11:10:10.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf380b2040 0x7fdf381f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf380b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf40a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf381618e0 0x7fdf380c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf40a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381f4680 con 0x7fdf381618e0 2024-01-20T11:10:10.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf40a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3815b4c0 con 0x7fdf380b2040 2024-01-20T11:10:10.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf40a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3815b7a0 con 0x7fdf3815d5b0 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf3ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf381618e0 0x7fdf380c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf3ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf381618e0 0x7fdf380c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60408/0 (socket says 172.21.15.162:60408) 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf3ea00640 1 -- 172.21.15.162:0/3534095136 learned_addr learned my addr 172.21.15.162:0/3534095136 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf3e000640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf380b2040 0x7fdf381f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.080+0000 7fdf3d600640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf380b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf3ea00640 1 -- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 msgr2=0x7fdf380b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf3ea00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf380b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf3ea00640 1 -- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf380b2040 msgr2=0x7fdf381f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf3ea00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf380b2040 0x7fdf381f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf3ea00640 1 -- 172.21.15.162:0/3534095136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28009a70 con 0x7fdf381618e0 2024-01-20T11:10:10.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf3ea00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf381618e0 0x7fdf380c4c60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdf20001eb0 tx=0x7fdf2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf36000640 1 -- 172.21.15.162:0/3534095136 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200052d0 con 0x7fdf381618e0 2024-01-20T11:10:10.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf36000640 1 -- 172.21.15.162:0/3534095136 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20005430 con 0x7fdf381618e0 2024-01-20T11:10:10.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf36000640 1 -- 172.21.15.162:0/3534095136 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20003810 con 0x7fdf381618e0 2024-01-20T11:10:10.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.081+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf300094d0 con 0x7fdf381618e0 2024-01-20T11:10:10.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.082+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3815bd60 con 0x7fdf381618e0 2024-01-20T11:10:10.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.083+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3804e970 con 0x7fdf381618e0 2024-01-20T11:10:10.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.084+0000 7fdf36000640 1 -- 172.21.15.162:0/3534095136 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdf20003970 con 0x7fdf381618e0 2024-01-20T11:10:10.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.085+0000 7fdf36000640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdf1006aed0 0x7fdf1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.085+0000 7fdf36000640 1 -- 172.21.15.162:0/3534095136 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdf200889b0 con 0x7fdf381618e0 2024-01-20T11:10:10.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.085+0000 7fdf3e000640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdf1006aed0 0x7fdf1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.086+0000 7fdf3e000640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdf1006aed0 0x7fdf1006d390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf30036000 tx=0x7fdf3003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.089+0000 7fdf36000640 1 -- 172.21.15.162:0/3534095136 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdf20053ae0 con 0x7fdf381618e0 2024-01-20T11:10:10.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.284+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf380adce0 con 0x7fdf1006aed0 2024-01-20T11:10:10.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.284+0000 7fdf36000640 1 -- 172.21.15.162:0/3534095136 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdf30031990 con 0x7fdf1006aed0 2024-01-20T11:10:10.285 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 2 to deep-scrub 2024-01-20T11:10:10.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdf1006aed0 msgr2=0x7fdf1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdf1006aed0 0x7fdf1006d390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf30036000 tx=0x7fdf3003c040 comp rx=0 tx=0).stop 2024-01-20T11:10:10.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf381618e0 msgr2=0x7fdf380c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf381618e0 0x7fdf380c4c60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdf20001eb0 tx=0x7fdf2000c890 comp rx=0 tx=0).stop 2024-01-20T11:10:10.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 shutdown_connections 2024-01-20T11:10:10.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf381618e0 0x7fdf380c4c60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf3815d5b0 0x7fdf380b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fdf1006aed0 0x7fdf1006d390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 --2- 172.21.15.162:0/3534095136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf380b2040 0x7fdf381f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 >> 172.21.15.162:0/3534095136 conn(0x7fdf3806a600 msgr2=0x7fdf380cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:10.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 shutdown_connections 2024-01-20T11:10:10.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.287+0000 7fdf40a00640 1 -- 172.21.15.162:0/3534095136 wait complete. 2024-01-20T11:10:10.307 INFO:tasks.ceph:Scrubbing osd.3 2024-01-20T11:10:10.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:10.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.522+0000 7fa2b1c00640 1 Processor -- start 2024-01-20T11:10:10.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.523+0000 7fa2b1c00640 1 -- start start 2024-01-20T11:10:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.524+0000 7fa2b1c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2ac0c93e0 0x7fa2ac161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.524+0000 7fa2b1c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac06e430 0x7fa2ac161650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.524+0000 7fa2b1c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac15dd30 con 0x7fa2ac0cba90 2024-01-20T11:10:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.524+0000 7fa2b1c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac06e0a0 con 0x7fa2ac0c93e0 2024-01-20T11:10:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.524+0000 7fa2b1c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac157fe0 con 0x7fa2ac06e430 2024-01-20T11:10:10.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.524+0000 7fa2aaa00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa2ac0cba90 0x7fa2ac0cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42832/0 (socket says 172.21.15.162:42832) 2024-01-20T11:10:10.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.524+0000 7fa2aaa00640 1 -- 172.21.15.162:0/2490872140 learned_addr learned my addr 172.21.15.162:0/2490872140 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905347847 0 0) 0x7fa2ac15dd30 con 0x7fa2ac0cba90 2024-01-20T11:10:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa28c003520 con 0x7fa2ac0cba90 2024-01-20T11:10:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2aa000640 1 --2- 172.21.15.162:0/2490872140 >> v2:172.21.15.179:3300/0 conn(0x7fa2ac0c93e0 0x7fa2ac161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2ab400640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac06e430 0x7fa2ac161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495065422 0 0) 0x7fa28c003520 con 0x7fa2ac0cba90 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac06e430 msgr2=0x7fa2ac161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac06e430 0x7fa2ac161650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 >> v2:172.21.15.179:3300/0 conn(0x7fa2ac0c93e0 msgr2=0x7fa2ac161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 --2- 172.21.15.162:0/2490872140 >> v2:172.21.15.179:3300/0 conn(0x7fa2ac0c93e0 0x7fa2ac161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac15e010 con 0x7fa2ac0cba90 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7fa29c001670 con 0x7fa2ac0cba90 2024-01-20T11:10:10.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 >> v1:172.21.15.162:6789/0 conn(0x7fa2ac0cba90 legacy=0x7fa2ac0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28c003970 0x7fa28c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.525+0000 7fa2a9600640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c0047c0 0x7fa28c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2a9600640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac06e430 0x7fa28c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06e0a0 con 0x7fa28c003970 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac157fe0 con 0x7fa28c0047c0 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c00ba80 con 0x7fa2ac06e430 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aaa00640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28c003970 0x7fa28c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aa000640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c0047c0 0x7fa28c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aaa00640 1 -- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac06e430 msgr2=0x7fa28c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aaa00640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac06e430 0x7fa28c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aaa00640 1 -- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c0047c0 msgr2=0x7fa28c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aaa00640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c0047c0 0x7fa28c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aaa00640 1 -- 172.21.15.162:0/2490872140 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c003520 con 0x7fa28c003970 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.526+0000 7fa2aa000640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c0047c0 0x7fa28c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.527+0000 7fa2aaa00640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28c003970 0x7fa28c003d90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c0e0 tx=0x7fa28c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c67f9d14ae9158 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c005ad0 con 0x7fa28c003970 2024-01-20T11:10:10.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c005c50 con 0x7fa28c003970 2024-01-20T11:10:10.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2a9600640 1 -- 172.21.15.162:0/2490872140 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c02c7d0 con 0x7fa28c003970 2024-01-20T11:10:10.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2b1c00640 1 -- 172.21.15.162:0/2490872140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28c003970 msgr2=0x7fa28c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2b1c00640 1 --2- 172.21.15.162:0/2490872140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28c003970 0x7fa28c003d90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c0e0 tx=0x7fa28c0057f0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2ab400640 1 -- 172.21.15.162:0/2490872140 reap_dead start 2024-01-20T11:10:10.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2b1c00640 1 -- 172.21.15.162:0/2490872140 shutdown_connections 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2b1c00640 1 -- 172.21.15.162:0/2490872140 >> 172.21.15.162:0/2490872140 conn(0x7fa2ac06a600 msgr2=0x7fa2ac06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2b1c00640 1 -- 172.21.15.162:0/2490872140 shutdown_connections 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.528+0000 7fa2b1c00640 1 -- 172.21.15.162:0/2490872140 wait complete. 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.530+0000 7fa2b1c00640 1 Processor -- start 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.530+0000 7fa2b1c00640 1 -- start start 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2b1c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c003970 0x7fa2ac14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2b1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac071d50 0x7fa2ac0721d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2b1c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac1f6a20 0x7fa2ac1f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2b1c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac072710 con 0x7fa2ac071d50 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2b1c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1f7750 con 0x7fa28c003970 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2b1c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0cd820 con 0x7fa2ac1f6a20 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2aa000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac071d50 0x7fa2ac0721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2aa000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac071d50 0x7fa2ac0721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60424/0 (socket says 172.21.15.162:60424) 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.531+0000 7fa2aa000640 1 -- 172.21.15.162:0/1681972444 learned_addr learned my addr 172.21.15.162:0/1681972444 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2aaa00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c003970 0x7fa2ac14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2ab400640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac1f6a20 0x7fa2ac1f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2aa000640 1 -- 172.21.15.162:0/1681972444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac1f6a20 msgr2=0x7fa2ac1f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2aa000640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2ac1f6a20 0x7fa2ac1f6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2aa000640 1 -- 172.21.15.162:0/1681972444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c003970 msgr2=0x7fa2ac14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2aa000640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c003970 0x7fa2ac14b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2aa000640 1 -- 172.21.15.162:0/1681972444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0ccef0 con 0x7fa2ac071d50 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2aa000640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac071d50 0x7fa2ac0721d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa29400e840 tx=0x7fa29400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400c670 con 0x7fa2ac071d50 2024-01-20T11:10:10.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29400c7d0 con 0x7fa2ac071d50 2024-01-20T11:10:10.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400cb80 con 0x7fa2ac071d50 2024-01-20T11:10:10.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.532+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac0cd1d0 con 0x7fa2ac071d50 2024-01-20T11:10:10.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.533+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac1f73e0 con 0x7fa2ac071d50 2024-01-20T11:10:10.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.533+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2ac06dd30 con 0x7fa2ac071d50 2024-01-20T11:10:10.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.535+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa29400cce0 con 0x7fa2ac071d50 2024-01-20T11:10:10.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.535+0000 7fa2a2a00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa28406af00 0x7fa28406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.535+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa294089060 con 0x7fa2ac071d50 2024-01-20T11:10:10.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.536+0000 7fa2aaa00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa28406af00 0x7fa28406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.536+0000 7fa2a2a00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7fa284070d60 0x7fa284073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.536+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 --> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa284073830 con 0x7fa284070d60 2024-01-20T11:10:10.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.536+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa29408b5e0 con 0x7fa2ac071d50 2024-01-20T11:10:10.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.536+0000 7fa2ab400640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7fa284070d60 0x7fa284073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.536+0000 7fa2aaa00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa28406af00 0x7fa28406d3c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa29c034000 tx=0x7fa29c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.537+0000 7fa2ab400640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7fa284070d60 0x7fa284073180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.541 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.537+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== osd.3 v2:172.21.15.162:6807/6791816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa284073830 con 0x7fa284070d60 2024-01-20T11:10:10.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.552+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 --> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa2ac15e5d0 con 0x7fa284070d60 2024-01-20T11:10:10.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.552+0000 7fa2a2a00640 1 -- 172.21.15.162:0/1681972444 <== osd.3 v2:172.21.15.162:6807/6791816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa2a4009bf0 con 0x7fa284070d60 2024-01-20T11:10:10.553 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:10.553 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:10.553 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:10.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7fa284070d60 msgr2=0x7fa284073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6807/6791816,v1:172.21.15.162:6809/6791816] conn(0x7fa284070d60 0x7fa284073180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa28406af00 msgr2=0x7fa28406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa28406af00 0x7fa28406d3c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa29c034000 tx=0x7fa29c007000 comp rx=0 tx=0).stop 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac071d50 msgr2=0x7fa2ac0721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 --2- 172.21.15.162:0/1681972444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac071d50 0x7fa2ac0721d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa29400e840 tx=0x7fa29400ed00 comp rx=0 tx=0).stop 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2ab400640 1 -- 172.21.15.162:0/1681972444 reap_dead start 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 shutdown_connections 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 >> 172.21.15.162:0/1681972444 conn(0x7fa2ac06a600 msgr2=0x7fa2ac0b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:10.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 shutdown_connections 2024-01-20T11:10:10.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.553+0000 7fa2b1c00640 1 -- 172.21.15.162:0/1681972444 wait complete. 2024-01-20T11:10:10.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-20T11:10:10.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.783+0000 7fada5200640 1 Processor -- start 2024-01-20T11:10:10.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.783+0000 7fada5200640 1 -- start start 2024-01-20T11:10:10.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fada5200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fada0071cc0 0x7fada00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fada5200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fada00cd880 0x7fada00cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fada5200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada0071830 con 0x7fada0144a10 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fada5200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada0070c20 con 0x7fada00cd880 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fada5200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada0070f00 con 0x7fada0071cc0 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fad9fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fada00cd880 0x7fada00cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fad9fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fada00cd880 0x7fada00cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60438/0 (socket says 172.21.15.162:60438) 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.785+0000 7fad9fe00640 1 -- 172.21.15.162:0/415465677 learned_addr learned my addr 172.21.15.162:0/415465677 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.786+0000 7fad9fe00640 1 -- 172.21.15.162:0/415465677 >> v2:172.21.15.179:3300/0 conn(0x7fada0071cc0 msgr2=0x7fada00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.786+0000 7fad97e00640 1 --2- 172.21.15.162:0/415465677 >> v2:172.21.15.179:3300/0 conn(0x7fada0071cc0 0x7fada00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.786+0000 7fad9fe00640 1 --2- 172.21.15.162:0/415465677 >> v2:172.21.15.179:3300/0 conn(0x7fada0071cc0 0x7fada00ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.786+0000 7fad9fe00640 1 -- 172.21.15.162:0/415465677 >> v1:172.21.15.162:6789/0 conn(0x7fada0144a10 legacy=0x7fada00703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.786+0000 7fad9fe00640 1 -- 172.21.15.162:0/415465677 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00711e0 con 0x7fada00cd880 2024-01-20T11:10:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.786+0000 7fad97e00640 1 --2- 172.21.15.162:0/415465677 >> v2:172.21.15.179:3300/0 conn(0x7fada0071cc0 0x7fada00ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.787+0000 7fad9fe00640 1 --2- 172.21.15.162:0/415465677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada00cd880 0x7fada00cdcd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fada00cca70 tx=0x7fad9802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e85f48ddedec29a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.787+0000 7fad9ea00640 1 -- 172.21.15.162:0/415465677 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9802cb10 con 0x7fada00cd880 2024-01-20T11:10:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.787+0000 7fad9ea00640 1 -- 172.21.15.162:0/415465677 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9802cc70 con 0x7fada00cd880 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.787+0000 7fad9ea00640 1 -- 172.21.15.162:0/415465677 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad980343f0 con 0x7fada00cd880 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 -- 172.21.15.162:0/415465677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada00cd880 msgr2=0x7fada00cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 --2- 172.21.15.162:0/415465677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada00cd880 0x7fada00cdcd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fada00cca70 tx=0x7fad9802bf70 comp rx=0 tx=0).stop 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 -- 172.21.15.162:0/415465677 shutdown_connections 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 --2- 172.21.15.162:0/415465677 >> v2:172.21.15.179:3300/0 conn(0x7fada0071cc0 0x7fada00ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 --2- 172.21.15.162:0/415465677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada00cd880 0x7fada00cdcd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 -- 172.21.15.162:0/415465677 >> 172.21.15.162:0/415465677 conn(0x7fada00b0c40 msgr2=0x7fada00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 -- 172.21.15.162:0/415465677 shutdown_connections 2024-01-20T11:10:10.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.788+0000 7fada5200640 1 -- 172.21.15.162:0/415465677 wait complete. 2024-01-20T11:10:10.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.790+0000 7fada5200640 1 Processor -- start 2024-01-20T11:10:10.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.790+0000 7fada5200640 1 -- start start 2024-01-20T11:10:10.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fada5200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fada0071cc0 0x7fada015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fada5200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fada00cd880 0x7fada00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fada5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada0144a10 0x7fada00c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fada5200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada00c55f0 con 0x7fada0144a10 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fada5200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada015af60 con 0x7fada00cd880 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fada5200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada00c4970 con 0x7fada0071cc0 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad9fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada0144a10 0x7fada00c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad9fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada0144a10 0x7fada00c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60452/0 (socket says 172.21.15.162:60452) 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad9fe00640 1 -- 172.21.15.162:0/2618538411 learned_addr learned my addr 172.21.15.162:0/2618538411 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad9f400640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fada0071cc0 0x7fada015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad9fe00640 1 -- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fada0071cc0 msgr2=0x7fada015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad9fe00640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fada0071cc0 0x7fada015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad9fe00640 1 -- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fada00cd880 msgr2=0x7fada00c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.791+0000 7fad97e00640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fada00cd880 0x7fada00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fad9fe00640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fada00cd880 0x7fada00c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fad9fe00640 1 -- 172.21.15.162:0/2618538411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98009b30 con 0x7fada0144a10 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fad97e00640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fada00cd880 0x7fada00c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fad9fe00640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada0144a10 0x7fada00c3eb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fad98036040 tx=0x7fad98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fad97400640 1 -- 172.21.15.162:0/2618538411 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98009510 con 0x7fada0144a10 2024-01-20T11:10:10.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fad97400640 1 -- 172.21.15.162:0/2618538411 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9803e450 con 0x7fada0144a10 2024-01-20T11:10:10.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada00c4c50 con 0x7fada0144a10 2024-01-20T11:10:10.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fad97400640 1 -- 172.21.15.162:0/2618538411 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9803e800 con 0x7fada0144a10 2024-01-20T11:10:10.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.792+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada00c5210 con 0x7fada0144a10 2024-01-20T11:10:10.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.794+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0074a30 con 0x7fada0144a10 2024-01-20T11:10:10.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.794+0000 7fad97400640 1 -- 172.21.15.162:0/2618538411 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fad9803e960 con 0x7fada0144a10 2024-01-20T11:10:10.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.795+0000 7fad97400640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad7806aed0 0x7fad7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:10.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.795+0000 7fad97400640 1 -- 172.21.15.162:0/2618538411 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad980ac220 con 0x7fada0144a10 2024-01-20T11:10:10.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.796+0000 7fad9f400640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad7806aed0 0x7fad7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:10.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.796+0000 7fad9f400640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad7806aed0 0x7fad7806d390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fad90007fd0 tx=0x7fad90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:10.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.800+0000 7fad97400640 1 -- 172.21.15.162:0/2618538411 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fad98077480 con 0x7fada0144a10 2024-01-20T11:10:10.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.992+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fada0144df0 con 0x7fad7806aed0 2024-01-20T11:10:10.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.993+0000 7fad97400640 1 -- 172.21.15.162:0/2618538411 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fad900050d0 con 0x7fad7806aed0 2024-01-20T11:10:10.993 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 3 to deep-scrub 2024-01-20T11:10:10.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad7806aed0 msgr2=0x7fad7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad7806aed0 0x7fad7806d390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fad90007fd0 tx=0x7fad90009040 comp rx=0 tx=0).stop 2024-01-20T11:10:10.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada0144a10 msgr2=0x7fada00c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:10.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada0144a10 0x7fada00c3eb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fad98036040 tx=0x7fad98004a40 comp rx=0 tx=0).stop 2024-01-20T11:10:10.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 shutdown_connections 2024-01-20T11:10:10.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fada0144a10 0x7fada00c3eb0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fad7806aed0 0x7fad7806d390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fada00cd880 0x7fada00c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 --2- 172.21.15.162:0/2618538411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fada0071cc0 0x7fada015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:10.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 >> 172.21.15.162:0/2618538411 conn(0x7fada00b0c40 msgr2=0x7fada006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:10.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.995+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 shutdown_connections 2024-01-20T11:10:10.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:10.996+0000 7fada5200640 1 -- 172.21.15.162:0/2618538411 wait complete. 2024-01-20T11:10:11.016 INFO:tasks.ceph:Scrubbing osd.4 2024-01-20T11:10:11.016 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:11.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.230+0000 7fd8c7400640 1 Processor -- start 2024-01-20T11:10:11.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.231+0000 7fd8c7400640 1 -- start start 2024-01-20T11:10:11.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.232+0000 7fd8c7400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd8c0157fa0 0x7fd8c00cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c7400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00ceef0 0x7fd8c00ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c7400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c006d530 con 0x7fd8c00cd320 2024-01-20T11:10:11.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c7400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c00cd7d0 con 0x7fd8c0157fa0 2024-01-20T11:10:11.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c7400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c006c920 con 0x7fd8c00ceef0 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c4a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd8c0157fa0 0x7fd8c00cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c4a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd8c0157fa0 0x7fd8c00cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60458/0 (socket says 172.21.15.162:60458) 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c4a00640 1 -- 172.21.15.162:0/3688398240 learned_addr learned my addr 172.21.15.162:0/3688398240 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8bfe00640 1 --2- 172.21.15.162:0/3688398240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00ceef0 0x7fd8c00ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c4a00640 1 -- 172.21.15.162:0/3688398240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00ceef0 msgr2=0x7fd8c00ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c4a00640 1 --2- 172.21.15.162:0/3688398240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00ceef0 0x7fd8c00ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c4a00640 1 -- 172.21.15.162:0/3688398240 >> v1:172.21.15.162:6789/0 conn(0x7fd8c00cd320 legacy=0x7fd8c015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8c4a00640 1 -- 172.21.15.162:0/3688398240 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c006cc00 con 0x7fd8c0157fa0 2024-01-20T11:10:11.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.233+0000 7fd8bfe00640 1 --2- 172.21.15.162:0/3688398240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00ceef0 0x7fd8c00ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.235+0000 7fd8c4a00640 1 --2- 172.21.15.162:0/3688398240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00cf470 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000d150 tx=0x7fd8b002e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65acb56c44c465c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.235+0000 7fd8bf400640 1 -- 172.21.15.162:0/3688398240 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000b0d0 con 0x7fd8c0157fa0 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.235+0000 7fd8bf400640 1 -- 172.21.15.162:0/3688398240 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000b230 con 0x7fd8c0157fa0 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.235+0000 7fd8bf400640 1 -- 172.21.15.162:0/3688398240 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0009600 con 0x7fd8c0157fa0 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 -- 172.21.15.162:0/3688398240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 msgr2=0x7fd8c00cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 --2- 172.21.15.162:0/3688398240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00cf470 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000d150 tx=0x7fd8b002e160 comp rx=0 tx=0).stop 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 -- 172.21.15.162:0/3688398240 shutdown_connections 2024-01-20T11:10:11.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 --2- 172.21.15.162:0/3688398240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00ceef0 0x7fd8c00ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 --2- 172.21.15.162:0/3688398240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00cf470 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 -- 172.21.15.162:0/3688398240 >> 172.21.15.162:0/3688398240 conn(0x7fd8c006a600 msgr2=0x7fd8c006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:11.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 -- 172.21.15.162:0/3688398240 shutdown_connections 2024-01-20T11:10:11.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.236+0000 7fd8c7400640 1 -- 172.21.15.162:0/3688398240 wait complete. 2024-01-20T11:10:11.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.237+0000 7fd8c7400640 1 Processor -- start 2024-01-20T11:10:11.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.238+0000 7fd8c7400640 1 -- start start 2024-01-20T11:10:11.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.238+0000 7fd8c7400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00cd320 0x7fd8c01f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.238+0000 7fd8c7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.238+0000 7fd8c7400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8c00addc0 0x7fd8c00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8c7400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c015bbd0 con 0x7fd8c0157fa0 2024-01-20T11:10:11.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8c7400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00ae360 con 0x7fd8c00addc0 2024-01-20T11:10:11.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8c7400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00ae640 con 0x7fd8c00cd320 2024-01-20T11:10:11.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60462/0 (socket says 172.21.15.162:60462) 2024-01-20T11:10:11.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 -- 172.21.15.162:0/2544153212 learned_addr learned my addr 172.21.15.162:0/2544153212 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 -- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00cd320 msgr2=0x7fd8c01f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c00cd320 0x7fd8c01f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 -- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8c00addc0 msgr2=0x7fd8c00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8c00addc0 0x7fd8c00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.239+0000 7fd8bfe00640 1 -- 172.21.15.162:0/2544153212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b000bd40 con 0x7fd8c0157fa0 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.240+0000 7fd8bfe00640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00ad880 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c7f0 tx=0x7fd8a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.240+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8007a30 con 0x7fd8c0157fa0 2024-01-20T11:10:11.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.240+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8007b90 con 0x7fd8c0157fa0 2024-01-20T11:10:11.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.240+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800ce40 con 0x7fd8c0157fa0 2024-01-20T11:10:11.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.240+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c015b510 con 0x7fd8c0157fa0 2024-01-20T11:10:11.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.240+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c01f2260 con 0x7fd8c0157fa0 2024-01-20T11:10:11.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.241+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8c006d1c0 con 0x7fd8c0157fa0 2024-01-20T11:10:11.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.242+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd8a80113f0 con 0x7fd8c0157fa0 2024-01-20T11:10:11.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.243+0000 7fd8bcc00640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd89806aed0 0x7fd89806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.243+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8a8089490 con 0x7fd8c0157fa0 2024-01-20T11:10:11.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.243+0000 7fd8c4a00640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd89806aed0 0x7fd89806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.243+0000 7fd8bcc00640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7fd898070d30 0x7fd898073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.243+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 --> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd898073800 con 0x7fd898070d30 2024-01-20T11:10:11.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.243+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8a808ba70 con 0x7fd8c0157fa0 2024-01-20T11:10:11.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.244+0000 7fd8c4a00640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd89806aed0 0x7fd89806d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0037000 tx=0x7fd8b0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.244+0000 7fd8c5400640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7fd898070d30 0x7fd898073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.245+0000 7fd8c5400640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7fd898070d30 0x7fd898073150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.247+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== osd.4 v2:172.21.15.179:6806/4012736393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd898073800 con 0x7fd898070d30 2024-01-20T11:10:11.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.262+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 --> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd8c015bd10 con 0x7fd898070d30 2024-01-20T11:10:11.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8bcc00640 1 -- 172.21.15.162:0/2544153212 <== osd.4 v2:172.21.15.179:6806/4012736393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd8c015bd10 con 0x7fd898070d30 2024-01-20T11:10:11.263 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:11.264 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:11.264 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:11.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7fd898070d30 msgr2=0x7fd898073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.179:6806/4012736393,v1:172.21.15.179:6809/4012736393] conn(0x7fd898070d30 0x7fd898073150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd89806aed0 msgr2=0x7fd89806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fd89806aed0 0x7fd89806d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0037000 tx=0x7fd8b0030000 comp rx=0 tx=0).stop 2024-01-20T11:10:11.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 msgr2=0x7fd8c00ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 --2- 172.21.15.162:0/2544153212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8c0157fa0 0x7fd8c00ad880 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c7f0 tx=0x7fd8a800cbf0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c5400640 1 -- 172.21.15.162:0/2544153212 reap_dead start 2024-01-20T11:10:11.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 shutdown_connections 2024-01-20T11:10:11.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.263+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 >> 172.21.15.162:0/2544153212 conn(0x7fd8c006a600 msgr2=0x7fd8c00b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:11.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.264+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 shutdown_connections 2024-01-20T11:10:11.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.264+0000 7fd8c7400640 1 -- 172.21.15.162:0/2544153212 wait complete. 2024-01-20T11:10:11.282 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-20T11:10:11.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.485+0000 7f2541e00640 1 Processor -- start 2024-01-20T11:10:11.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.486+0000 7f2541e00640 1 -- start start 2024-01-20T11:10:11.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.487+0000 7f2541e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f253c159100 0x7f253c0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.487+0000 7f2541e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 0x7f253c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.487+0000 7f2541e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f253c06eae0 0x7f253c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.487+0000 7f2541e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c0cc300 con 0x7f253c06eae0 2024-01-20T11:10:11.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.487+0000 7f2541e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c070ab0 con 0x7f253c159100 2024-01-20T11:10:11.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.487+0000 7f2541e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c06f880 con 0x7f253c070f40 2024-01-20T11:10:11.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f253c06eae0 0x7f253c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f253c06eae0 0x7f253c06ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60474/0 (socket says 172.21.15.162:60474) 2024-01-20T11:10:11.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 -- 172.21.15.162:0/4039132241 learned_addr learned my addr 172.21.15.162:0/4039132241 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:11.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 -- 172.21.15.162:0/4039132241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 msgr2=0x7f253c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:11.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 --2- 172.21.15.162:0/4039132241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 0x7f253c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 -- 172.21.15.162:0/4039132241 >> v2:172.21.15.179:3300/0 conn(0x7f253c159100 msgr2=0x7f253c0cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:11.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 --2- 172.21.15.162:0/4039132241 >> v2:172.21.15.179:3300/0 conn(0x7f253c159100 0x7f253c0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.488+0000 7f253b400640 1 -- 172.21.15.162:0/4039132241 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c070180 con 0x7f253c06eae0 2024-01-20T11:10:11.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.489+0000 7f253b400640 1 --2- 172.21.15.162:0/4039132241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c06ef90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f253c074450 tx=0x7f253402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f84b313c3ffc43c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.490+0000 7f2539600640 1 -- 172.21.15.162:0/4039132241 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253402ca70 con 0x7f253c06eae0 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.490+0000 7f2539600640 1 -- 172.21.15.162:0/4039132241 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253402cbd0 con 0x7f253c06eae0 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.490+0000 7f2539600640 1 -- 172.21.15.162:0/4039132241 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340343f0 con 0x7f253c06eae0 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 -- 172.21.15.162:0/4039132241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 msgr2=0x7f253c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 --2- 172.21.15.162:0/4039132241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c06ef90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f253c074450 tx=0x7f253402bed0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 -- 172.21.15.162:0/4039132241 shutdown_connections 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 --2- 172.21.15.162:0/4039132241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c06ef90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 --2- 172.21.15.162:0/4039132241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 0x7f253c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 --2- 172.21.15.162:0/4039132241 >> v2:172.21.15.179:3300/0 conn(0x7f253c159100 0x7f253c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 -- 172.21.15.162:0/4039132241 >> 172.21.15.162:0/4039132241 conn(0x7f253c0d1230 msgr2=0x7f253c0d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:11.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 -- 172.21.15.162:0/4039132241 shutdown_connections 2024-01-20T11:10:11.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.491+0000 7f2541e00640 1 -- 172.21.15.162:0/4039132241 wait complete. 2024-01-20T11:10:11.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.493+0000 7f2541e00640 1 Processor -- start 2024-01-20T11:10:11.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.493+0000 7f2541e00640 1 -- start start 2024-01-20T11:10:11.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f2541e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f2541e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 0x7f253c1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f2541e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c159100 0x7f253c1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f2541e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15cb90 con 0x7f253c06eae0 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f2541e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15ce70 con 0x7f253c159100 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f2541e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15d150 con 0x7f253c070f40 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60478/0 (socket says 172.21.15.162:60478) 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 -- 172.21.15.162:0/1703165804 learned_addr learned my addr 172.21.15.162:0/1703165804 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 -- 172.21.15.162:0/1703165804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 msgr2=0x7f253c1f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 0x7f253c1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 -- 172.21.15.162:0/1703165804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c159100 msgr2=0x7f253c1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c159100 0x7f253c1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.494+0000 7f253aa00640 1 -- 172.21.15.162:0/1703165804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009b30 con 0x7f253c06eae0 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.495+0000 7f253aa00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c15c570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f252c00b4a0 tx=0x7f252c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.495+0000 7f2533400640 1 -- 172.21.15.162:0/1703165804 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c010610 con 0x7f253c06eae0 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.495+0000 7f2533400640 1 -- 172.21.15.162:0/1703165804 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c010770 con 0x7f253c06eae0 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.495+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c15d430 con 0x7f253c06eae0 2024-01-20T11:10:11.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.495+0000 7f2533400640 1 -- 172.21.15.162:0/1703165804 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c010b20 con 0x7f253c06eae0 2024-01-20T11:10:11.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.495+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c141c30 con 0x7f253c06eae0 2024-01-20T11:10:11.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.496+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c15d950 con 0x7f253c06eae0 2024-01-20T11:10:11.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.497+0000 7f2533400640 1 -- 172.21.15.162:0/1703165804 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f252c010c80 con 0x7f253c06eae0 2024-01-20T11:10:11.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.498+0000 7f2533400640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f251406af00 0x7f251406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.498+0000 7f2533400640 1 -- 172.21.15.162:0/1703165804 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f252c088fd0 con 0x7f253c06eae0 2024-01-20T11:10:11.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.498+0000 7f253a000640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f251406af00 0x7f251406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.499+0000 7f253a000640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f251406af00 0x7f251406d3c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f253c144fd0 tx=0x7f2524006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.502+0000 7f2533400640 1 -- 172.21.15.162:0/1703165804 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f253c15d950 con 0x7f253c06eae0 2024-01-20T11:10:11.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.695+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f253c15cfe0 con 0x7f251406af00 2024-01-20T11:10:11.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.696+0000 7f2533400640 1 -- 172.21.15.162:0/1703165804 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f253c15cfe0 con 0x7f251406af00 2024-01-20T11:10:11.697 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 4 to deep-scrub 2024-01-20T11:10:11.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.698+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f251406af00 msgr2=0x7f251406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.698+0000 7f2541e00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f251406af00 0x7f251406d3c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f253c144fd0 tx=0x7f2524006c90 comp rx=0 tx=0).stop 2024-01-20T11:10:11.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.698+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 msgr2=0x7f253c15c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.698+0000 7f2541e00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c15c570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f252c00b4a0 tx=0x7f252c00b960 comp rx=0 tx=0).stop 2024-01-20T11:10:11.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 shutdown_connections 2024-01-20T11:10:11.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f251406af00 0x7f251406d3c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c159100 0x7f253c1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c070f40 0x7f253c1f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 --2- 172.21.15.162:0/1703165804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f253c06eae0 0x7f253c15c570 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 >> 172.21.15.162:0/1703165804 conn(0x7f253c0d1230 msgr2=0x7f253c15a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:11.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 shutdown_connections 2024-01-20T11:10:11.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.699+0000 7f2541e00640 1 -- 172.21.15.162:0/1703165804 wait complete. 2024-01-20T11:10:11.716 INFO:tasks.ceph:Scrubbing osd.5 2024-01-20T11:10:11.717 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:11.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.925+0000 7fa599c00640 1 Processor -- start 2024-01-20T11:10:11.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.925+0000 7fa599c00640 1 -- start start 2024-01-20T11:10:11.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa599c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa5940ceef0 0x7fa5940ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa599c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa5940cd320 0x7fa59415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa599c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59406d530 con 0x7fa594157fa0 2024-01-20T11:10:11.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa599c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5940cd7b0 con 0x7fa5940ceef0 2024-01-20T11:10:11.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa599c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5940cfb80 con 0x7fa5940cd320 2024-01-20T11:10:11.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa58be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa5940ceef0 0x7fa5940ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa58be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa5940ceef0 0x7fa5940ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60482/0 (socket says 172.21.15.162:60482) 2024-01-20T11:10:11.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa58be00640 1 -- 172.21.15.162:0/2984235069 learned_addr learned my addr 172.21.15.162:0/2984235069 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:11.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa593400640 1 --2- 172.21.15.162:0/2984235069 >> v2:172.21.15.179:3300/0 conn(0x7fa5940cd320 0x7fa59415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa58be00640 1 -- 172.21.15.162:0/2984235069 >> v2:172.21.15.179:3300/0 conn(0x7fa5940cd320 msgr2=0x7fa59415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:11.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa58be00640 1 --2- 172.21.15.162:0/2984235069 >> v2:172.21.15.179:3300/0 conn(0x7fa5940cd320 0x7fa59415bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa58be00640 1 -- 172.21.15.162:0/2984235069 >> v1:172.21.15.179:6789/0 conn(0x7fa594157fa0 legacy=0x7fa5940cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:11.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa58be00640 1 -- 172.21.15.162:0/2984235069 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59406c920 con 0x7fa5940ceef0 2024-01-20T11:10:11.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.927+0000 7fa593400640 1 --2- 172.21.15.162:0/2984235069 >> v2:172.21.15.179:3300/0 conn(0x7fa5940cd320 0x7fa59415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:11.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.928+0000 7fa58be00640 1 --2- 172.21.15.162:0/2984235069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940ceef0 0x7fa5940ccde0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa5940ceaa0 tx=0x7fa57c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c37a7f4e30ab37b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.929+0000 7fa592000640 1 -- 172.21.15.162:0/2984235069 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c031870 con 0x7fa5940ceef0 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.929+0000 7fa592000640 1 -- 172.21.15.162:0/2984235069 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c0319d0 con 0x7fa5940ceef0 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.929+0000 7fa592000640 1 -- 172.21.15.162:0/2984235069 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c031d60 con 0x7fa5940ceef0 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.929+0000 7fa599c00640 1 -- 172.21.15.162:0/2984235069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940ceef0 msgr2=0x7fa5940ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.929+0000 7fa599c00640 1 --2- 172.21.15.162:0/2984235069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940ceef0 0x7fa5940ccde0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa5940ceaa0 tx=0x7fa57c02b910 comp rx=0 tx=0).stop 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.930+0000 7fa599c00640 1 -- 172.21.15.162:0/2984235069 shutdown_connections 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.930+0000 7fa599c00640 1 --2- 172.21.15.162:0/2984235069 >> v2:172.21.15.179:3300/0 conn(0x7fa5940cd320 0x7fa59415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.930+0000 7fa599c00640 1 --2- 172.21.15.162:0/2984235069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940ceef0 0x7fa5940ccde0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.930+0000 7fa599c00640 1 -- 172.21.15.162:0/2984235069 >> 172.21.15.162:0/2984235069 conn(0x7fa59406a600 msgr2=0x7fa59406a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:11.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.930+0000 7fa599c00640 1 -- 172.21.15.162:0/2984235069 shutdown_connections 2024-01-20T11:10:11.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.930+0000 7fa599c00640 1 -- 172.21.15.162:0/2984235069 wait complete. 2024-01-20T11:10:11.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.931+0000 7fa599c00640 1 Processor -- start 2024-01-20T11:10:11.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.932+0000 7fa599c00640 1 -- start start 2024-01-20T11:10:11.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa599c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cd320 0x7fa594098700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa599c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594157fa0 0x7fa5940724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa599c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5940709c0 0x7fa594070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa599c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594098c40 con 0x7fa5940cd320 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa599c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594071440 con 0x7fa5940709c0 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa599c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa594071720 con 0x7fa594157fa0 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cd320 0x7fa594098700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cd320 0x7fa594098700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60490/0 (socket says 172.21.15.162:60490) 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 -- 172.21.15.162:0/1134354471 learned_addr learned my addr 172.21.15.162:0/1134354471 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:11.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa593400640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5940709c0 0x7fa594070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 -- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594157fa0 msgr2=0x7fa5940724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594157fa0 0x7fa5940724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 -- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5940709c0 msgr2=0x7fa594070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5940709c0 0x7fa594070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa592a00640 1 -- 172.21.15.162:0/1134354471 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0094d0 con 0x7fa5940cd320 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.933+0000 7fa593400640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5940709c0 0x7fa594070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.934+0000 7fa592a00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cd320 0x7fa594098700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa58400b3e0 tx=0x7fa58400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.934+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584011830 con 0x7fa5940cd320 2024-01-20T11:10:11.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.934+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5840119b0 con 0x7fa5940cd320 2024-01-20T11:10:11.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.934+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584011d60 con 0x7fa5940cd320 2024-01-20T11:10:11.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.934+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa594071a00 con 0x7fa5940cd320 2024-01-20T11:10:11.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.934+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa594071fc0 con 0x7fa5940cd320 2024-01-20T11:10:11.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.935+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa59406d1c0 con 0x7fa5940cd320 2024-01-20T11:10:11.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.936+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa58401a400 con 0x7fa5940cd320 2024-01-20T11:10:11.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.937+0000 7fa58aa00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa56c06aed0 0x7fa56c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.937+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa584089470 con 0x7fa5940cd320 2024-01-20T11:10:11.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.937+0000 7fa58be00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa56c06aed0 0x7fa56c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.937+0000 7fa58aa00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fa56c070d30 0x7fa56c073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:11.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.937+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 --> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa56c073800 con 0x7fa56c070d30 2024-01-20T11:10:11.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.937+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa58408bb00 con 0x7fa5940cd320 2024-01-20T11:10:11.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.938+0000 7fa58be00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa56c06aed0 0x7fa56c06d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa57c036000 tx=0x7fa57c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.938+0000 7fa593400640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fa56c070d30 0x7fa56c073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:11.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.939+0000 7fa593400640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fa56c070d30 0x7fa56c073150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:11.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.941+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== osd.5 v2:172.21.15.179:6805/2271063545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa56c073800 con 0x7fa56c070d30 2024-01-20T11:10:11.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.955+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 --> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa59406cee0 con 0x7fa56c070d30 2024-01-20T11:10:11.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.956+0000 7fa58aa00640 1 -- 172.21.15.162:0/1134354471 <== osd.5 v2:172.21.15.179:6805/2271063545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa58c00d510 con 0x7fa56c070d30 2024-01-20T11:10:11.957 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:11.957 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:11.957 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:11.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fa56c070d30 msgr2=0x7fa56c073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.179:6805/2271063545,v1:172.21.15.179:6808/2271063545] conn(0x7fa56c070d30 0x7fa56c073150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa56c06aed0 msgr2=0x7fa56c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fa56c06aed0 0x7fa56c06d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa57c036000 tx=0x7fa57c030000 comp rx=0 tx=0).stop 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cd320 msgr2=0x7fa594098700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 --2- 172.21.15.162:0/1134354471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cd320 0x7fa594098700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa58400b3e0 tx=0x7fa58400b8a0 comp rx=0 tx=0).stop 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa593400640 1 -- 172.21.15.162:0/1134354471 reap_dead start 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 shutdown_connections 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 >> 172.21.15.162:0/1134354471 conn(0x7fa59406a600 msgr2=0x7fa59415c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.957+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 shutdown_connections 2024-01-20T11:10:11.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:11.958+0000 7fa599c00640 1 -- 172.21.15.162:0/1134354471 wait complete. 2024-01-20T11:10:11.976 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-20T11:10:12.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.193+0000 7f0146a00640 1 Processor -- start 2024-01-20T11:10:12.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.193+0000 7f0146a00640 1 -- start start 2024-01-20T11:10:12.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.194+0000 7f0146a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f014015a380 0x7f014015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.194+0000 7f0146a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f01400707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.194+0000 7f0146a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f01400cf060 0x7f01400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.194+0000 7f0146a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014015ee30 con 0x7f01400cf060 2024-01-20T11:10:12.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.194+0000 7f0146a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400cfa30 con 0x7f014015a380 2024-01-20T11:10:12.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.194+0000 7f0146a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400b2ec0 con 0x7f01400b2040 2024-01-20T11:10:12.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.194+0000 7f0144a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f01400cf060 0x7f01400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0144a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f01400cf060 0x7f01400cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60498/0 (socket says 172.21.15.162:60498) 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0144a00640 1 -- 172.21.15.162:0/3136665335 learned_addr learned my addr 172.21.15.162:0/3136665335 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0137200640 1 --2- 172.21.15.162:0/3136665335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f01400707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f013fe00640 1 --2- 172.21.15.162:0/3136665335 >> v2:172.21.15.179:3300/0 conn(0x7f014015a380 0x7f014015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0144a00640 1 -- 172.21.15.162:0/3136665335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 msgr2=0x7f01400707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0144a00640 1 --2- 172.21.15.162:0/3136665335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f01400707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0144a00640 1 -- 172.21.15.162:0/3136665335 >> v2:172.21.15.179:3300/0 conn(0x7f014015a380 msgr2=0x7f014015e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0144a00640 1 --2- 172.21.15.162:0/3136665335 >> v2:172.21.15.179:3300/0 conn(0x7f014015a380 0x7f014015e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0144a00640 1 -- 172.21.15.162:0/3136665335 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400ce700 con 0x7f01400cf060 2024-01-20T11:10:12.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.195+0000 7f0137200640 1 --2- 172.21.15.162:0/3136665335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f01400707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:12.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.196+0000 7f0144a00640 1 --2- 172.21.15.162:0/3136665335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f01400cf4f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f01400cf030 tx=0x7f013802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca60ed06199420 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.196+0000 7f013f400640 1 -- 172.21.15.162:0/3136665335 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01380317c0 con 0x7f01400cf060 2024-01-20T11:10:12.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.196+0000 7f013f400640 1 -- 172.21.15.162:0/3136665335 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138031920 con 0x7f01400cf060 2024-01-20T11:10:12.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.196+0000 7f013f400640 1 -- 172.21.15.162:0/3136665335 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138031cb0 con 0x7f01400cf060 2024-01-20T11:10:12.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 -- 172.21.15.162:0/3136665335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 msgr2=0x7f01400cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 --2- 172.21.15.162:0/3136665335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f01400cf4f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f01400cf030 tx=0x7f013802b860 comp rx=0 tx=0).stop 2024-01-20T11:10:12.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 -- 172.21.15.162:0/3136665335 shutdown_connections 2024-01-20T11:10:12.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 --2- 172.21.15.162:0/3136665335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f01400cf4f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 --2- 172.21.15.162:0/3136665335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f01400707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 --2- 172.21.15.162:0/3136665335 >> v2:172.21.15.179:3300/0 conn(0x7f014015a380 0x7f014015e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 -- 172.21.15.162:0/3136665335 >> 172.21.15.162:0/3136665335 conn(0x7f014006a600 msgr2=0x7f014006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:12.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 -- 172.21.15.162:0/3136665335 shutdown_connections 2024-01-20T11:10:12.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.197+0000 7f0146a00640 1 -- 172.21.15.162:0/3136665335 wait complete. 2024-01-20T11:10:12.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.199+0000 7f0146a00640 1 Processor -- start 2024-01-20T11:10:12.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.200+0000 7f0146a00640 1 -- start start 2024-01-20T11:10:12.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0146a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f0140148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0146a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f014015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0146a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f014015a380 0x7f014015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0146a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140154750 con 0x7f01400cf060 2024-01-20T11:10:12.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0146a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401e4190 con 0x7f014015a380 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0146a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01401549f0 con 0x7f01400b2040 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0137200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f014015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0137200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f014015ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60514/0 (socket says 172.21.15.162:60514) 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f0137200640 1 -- 172.21.15.162:0/3470687034 learned_addr learned my addr 172.21.15.162:0/3470687034 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.201+0000 7f013fe00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f0140148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0144a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f014015a380 0x7f014015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0137200640 1 -- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 msgr2=0x7f0140148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0137200640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f0140148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0137200640 1 -- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f014015a380 msgr2=0x7f014015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0137200640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f014015a380 0x7f014015bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0137200640 1 -- 172.21.15.162:0/3470687034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380094d0 con 0x7f01400cf060 2024-01-20T11:10:12.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0144a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f014015a380 0x7f014015bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:12.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f013fe00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f0140148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:12.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0137200640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f014015ba10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f012800ce30 tx=0x7f012800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f013cc00640 1 -- 172.21.15.162:0/3470687034 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800f680 con 0x7f01400cf060 2024-01-20T11:10:12.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f013cc00640 1 -- 172.21.15.162:0/3470687034 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012800f7e0 con 0x7f01400cf060 2024-01-20T11:10:12.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140154cd0 con 0x7f01400cf060 2024-01-20T11:10:12.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f013cc00640 1 -- 172.21.15.162:0/3470687034 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800fb90 con 0x7f01400cf060 2024-01-20T11:10:12.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.202+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01401491d0 con 0x7f01400cf060 2024-01-20T11:10:12.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.203+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01401551f0 con 0x7f01400cf060 2024-01-20T11:10:12.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.205+0000 7f013cc00640 1 -- 172.21.15.162:0/3470687034 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f012800b040 con 0x7f01400cf060 2024-01-20T11:10:12.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.205+0000 7f013cc00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f011806af00 0x7f011806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.206+0000 7f013cc00640 1 -- 172.21.15.162:0/3470687034 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0128089d90 con 0x7f01400cf060 2024-01-20T11:10:12.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.206+0000 7f013fe00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f011806af00 0x7f011806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.206+0000 7f013fe00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f011806af00 0x7f011806d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01401f6870 tx=0x7f0130008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.210+0000 7f013cc00640 1 -- 172.21.15.162:0/3470687034 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f01401551f0 con 0x7f01400cf060 2024-01-20T11:10:12.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.402+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f01400cec30 con 0x7f011806af00 2024-01-20T11:10:12.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.403+0000 7f013cc00640 1 -- 172.21.15.162:0/3470687034 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f013000c040 con 0x7f011806af00 2024-01-20T11:10:12.404 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 5 to deep-scrub 2024-01-20T11:10:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f011806af00 msgr2=0x7f011806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f011806af00 0x7f011806d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01401f6870 tx=0x7f0130008040 comp rx=0 tx=0).stop 2024-01-20T11:10:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 msgr2=0x7f014015ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f014015ba10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f012800ce30 tx=0x7f012800a650 comp rx=0 tx=0).stop 2024-01-20T11:10:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 shutdown_connections 2024-01-20T11:10:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f011806af00 0x7f011806d3c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f014015a380 0x7f014015bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01400cf060 0x7f014015ba10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 --2- 172.21.15.162:0/3470687034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b2040 0x7f0140148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 >> 172.21.15.162:0/3470687034 conn(0x7f014006a600 msgr2=0x7f0140071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:12.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 shutdown_connections 2024-01-20T11:10:12.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.406+0000 7f0146a00640 1 -- 172.21.15.162:0/3470687034 wait complete. 2024-01-20T11:10:12.425 INFO:tasks.ceph:Scrubbing osd.6 2024-01-20T11:10:12.426 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:12.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.632+0000 7f56e5a00640 1 Processor -- start 2024-01-20T11:10:12.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.633+0000 7f56e5a00640 1 -- start start 2024-01-20T11:10:12.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56e5a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56e015e710 0x7f56e00cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56e5a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e0160f00 con 0x7f56e00d01e0 2024-01-20T11:10:12.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56e5a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e015ef00 con 0x7f56e0160b20 2024-01-20T11:10:12.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56e5a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00d0670 con 0x7f56e015e710 2024-01-20T11:10:12.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56df400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56e015e710 0x7f56e00cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56df400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56e015e710 0x7f56e00cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60530/0 (socket says 172.21.15.162:60530) 2024-01-20T11:10:12.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56df400640 1 -- 172.21.15.162:0/845121846 learned_addr learned my addr 172.21.15.162:0/845121846 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:12.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.634+0000 7f56e5000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f56e00d01e0 0x7f56e015cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42866/0 (socket says 172.21.15.162:42866) 2024-01-20T11:10:12.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.635+0000 7f56df400640 1 -- 172.21.15.162:0/845121846 >> v1:172.21.15.179:6789/0 conn(0x7f56e0160b20 legacy=0x7f56e00cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:12.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.635+0000 7f56df400640 1 -- 172.21.15.162:0/845121846 >> v1:172.21.15.162:6789/0 conn(0x7f56e00d01e0 legacy=0x7f56e015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.635+0000 7f56df400640 1 -- 172.21.15.162:0/845121846 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00ce6b0 con 0x7f56e015e710 2024-01-20T11:10:12.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.636+0000 7f56df400640 1 --2- 172.21.15.162:0/845121846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e00cfca0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009870 tx=0x7f56c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a3537c5cf13037 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.636+0000 7f56dea00640 1 -- 172.21.15.162:0/845121846 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8030860 con 0x7f56e015e710 2024-01-20T11:10:12.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.636+0000 7f56dea00640 1 -- 172.21.15.162:0/845121846 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80309c0 con 0x7f56e015e710 2024-01-20T11:10:12.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.636+0000 7f56dea00640 1 -- 172.21.15.162:0/845121846 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8030d50 con 0x7f56e015e710 2024-01-20T11:10:12.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.637+0000 7f56e5a00640 1 -- 172.21.15.162:0/845121846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 msgr2=0x7f56e00cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.637+0000 7f56e5a00640 1 --2- 172.21.15.162:0/845121846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e00cfca0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009870 tx=0x7f56c802b9a0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.637+0000 7f56e5a00640 1 -- 172.21.15.162:0/845121846 shutdown_connections 2024-01-20T11:10:12.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.637+0000 7f56e5a00640 1 --2- 172.21.15.162:0/845121846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e00cfca0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.637+0000 7f56e5a00640 1 -- 172.21.15.162:0/845121846 >> 172.21.15.162:0/845121846 conn(0x7f56e009c5d0 msgr2=0x7f56e00d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:12.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.637+0000 7f56e5a00640 1 -- 172.21.15.162:0/845121846 shutdown_connections 2024-01-20T11:10:12.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.637+0000 7f56e5a00640 1 -- 172.21.15.162:0/845121846 wait complete. 2024-01-20T11:10:12.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.639+0000 7f56e5a00640 1 Processor -- start 2024-01-20T11:10:12.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.639+0000 7f56e5a00640 1 -- start start 2024-01-20T11:10:12.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00d01e0 0x7f56e01e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e01e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e0160b20 0x7f56e01e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01e7130 con 0x7f56e015e710 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01e7410 con 0x7f56e0160b20 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01e76f0 con 0x7f56e00d01e0 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e01e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e01e8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60538/0 (socket says 172.21.15.162:60538) 2024-01-20T11:10:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 -- 172.21.15.162:0/2496270956 learned_addr learned my addr 172.21.15.162:0/2496270956 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5000640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e0160b20 0x7f56e01e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56dfe00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00d01e0 0x7f56e01e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 -- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00d01e0 msgr2=0x7f56e01e81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00d01e0 0x7f56e01e81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 -- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e0160b20 msgr2=0x7f56e01e8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e0160b20 0x7f56e01e8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56df400640 1 -- 172.21.15.162:0/2496270956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80094d0 con 0x7f56e015e710 2024-01-20T11:10:12.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.640+0000 7f56e5000640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e0160b20 0x7f56e01e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:12.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.641+0000 7f56df400640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e01e8710 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009870 tx=0x7f56c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.641+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8030810 con 0x7f56e015e710 2024-01-20T11:10:12.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.641+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8043400 con 0x7f56e015e710 2024-01-20T11:10:12.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.641+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e01e79d0 con 0x7f56e015e710 2024-01-20T11:10:12.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.641+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80437b0 con 0x7f56e015e710 2024-01-20T11:10:12.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.641+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e01e9190 con 0x7f56e015e710 2024-01-20T11:10:12.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.642+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56e00cef50 con 0x7f56e015e710 2024-01-20T11:10:12.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.643+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f56c8043910 con 0x7f56e015e710 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.644+0000 7f56d7e00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f56b806aed0 0x7f56b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.644+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56c803e070 con 0x7f56e015e710 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.644+0000 7f56dfe00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f56b806aed0 0x7f56b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.644+0000 7f56d7e00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7f56b8070d30 0x7f56b8073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.644+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 --> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56b8073800 con 0x7f56b8070d30 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.644+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c80aeb20 con 0x7f56e015e710 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.645+0000 7f56dfe00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f56b806aed0 0x7f56b806d390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f56d0003d90 tx=0x7f56d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.645+0000 7f56e5000640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7f56b8070d30 0x7f56b8073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.646+0000 7f56e5000640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7f56b8070d30 0x7f56b8073150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.648+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== osd.6 v2:172.21.15.179:6800/1904262509 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f56b8073800 con 0x7f56b8070d30 2024-01-20T11:10:12.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.662+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 --> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56e00cec70 con 0x7f56b8070d30 2024-01-20T11:10:12.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.663+0000 7f56d7e00640 1 -- 172.21.15.162:0/2496270956 <== osd.6 v2:172.21.15.179:6800/1904262509 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f56d8001e30 con 0x7f56b8070d30 2024-01-20T11:10:12.664 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:12.664 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:12.664 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:12.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7f56b8070d30 msgr2=0x7f56b8073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.179:6800/1904262509,v1:172.21.15.179:6801/1904262509] conn(0x7f56b8070d30 0x7f56b8073150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f56b806aed0 msgr2=0x7f56b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f56b806aed0 0x7f56b806d390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f56d0003d90 tx=0x7f56d0009040 comp rx=0 tx=0).stop 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 msgr2=0x7f56e01e8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 --2- 172.21.15.162:0/2496270956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56e015e710 0x7f56e01e8710 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009870 tx=0x7f56c8004730 comp rx=0 tx=0).stop 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5000640 1 -- 172.21.15.162:0/2496270956 reap_dead start 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 shutdown_connections 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 >> 172.21.15.162:0/2496270956 conn(0x7f56e009c5d0 msgr2=0x7f56e0161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 shutdown_connections 2024-01-20T11:10:12.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.664+0000 7f56e5a00640 1 -- 172.21.15.162:0/2496270956 wait complete. 2024-01-20T11:10:12.680 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-20T11:10:12.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.880+0000 7f60a8200640 1 Processor -- start 2024-01-20T11:10:12.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.881+0000 7f60a8200640 1 -- start start 2024-01-20T11:10:12.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.882+0000 7f60a8200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a0144ce0 0x7f60a00cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.882+0000 7f60a8200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00cccb0 con 0x7f60a015c0b0 2024-01-20T11:10:12.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.882+0000 7f60a8200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a015c900 con 0x7f60a006a600 2024-01-20T11:10:12.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.882+0000 7f60a8200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00cf400 con 0x7f60a0144ce0 2024-01-20T11:10:12.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.883+0000 7f60a6200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f60a015c0b0 0x7f60a00715d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:42876/0 (socket says 172.21.15.162:42876) 2024-01-20T11:10:12.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.883+0000 7f60a6200640 1 -- 172.21.15.162:0/973111161 learned_addr learned my addr 172.21.15.162:0/973111161 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-01-20T11:10:12.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.883+0000 7f60a5800640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a0144ce0 0x7f60a00cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.883+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186070284 0 0) 0x7f60a00cccb0 con 0x7f60a015c0b0 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.883+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6080003520 con 0x7f60a015c0b0 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2148845807 0 0) 0x7f6080003520 con 0x7f60a015c0b0 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a0144ce0 msgr2=0x7f60a00cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a0144ce0 0x7f60a00cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 >> v1:172.21.15.179:6789/0 conn(0x7f60a006a600 legacy=0x7f60a015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a01450c0 con 0x7f60a015c0b0 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2373204478 0 0) 0x7f60980019f0 con 0x7f60a015c0b0 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 >> v1:172.21.15.162:6789/0 conn(0x7f60a015c0b0 legacy=0x7f60a00715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800039a0 0x7f6080003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800047c0 0x7f6080004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a0144ce0 0x7f6080005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00cf400 con 0x7f60800039a0 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608000ba30 con 0x7f60800047c0 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608000bba0 con 0x7f60a0144ce0 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f60a5800640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800039a0 0x7f6080003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f60a5800640 1 -- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a0144ce0 msgr2=0x7f6080005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f60a5800640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a0144ce0 0x7f6080005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f60a5800640 1 -- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800047c0 msgr2=0x7f6080004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:12.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f60a5800640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800047c0 0x7f6080004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.884+0000 7f60a5800640 1 -- 172.21.15.162:0/973111161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080003520 con 0x7f60800039a0 2024-01-20T11:10:12.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.886+0000 7f60a5800640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800039a0 0x7f6080003d80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6090009a90 tx=0x7f60800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3a61fa1503eee1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.886+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609002c690 con 0x7f60800039a0 2024-01-20T11:10:12.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.886+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609002c7f0 con 0x7f60800039a0 2024-01-20T11:10:12.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.886+0000 7f609fe00640 1 -- 172.21.15.162:0/973111161 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609002cb80 con 0x7f60800039a0 2024-01-20T11:10:12.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.886+0000 7f60a8200640 1 -- 172.21.15.162:0/973111161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800039a0 msgr2=0x7f6080003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.886+0000 7f60a8200640 1 --2- 172.21.15.162:0/973111161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60800039a0 0x7f6080003d80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6090009a90 tx=0x7f60800057f0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.886+0000 7f60a6200640 1 -- 172.21.15.162:0/973111161 reap_dead start 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.887+0000 7f60a8200640 1 -- 172.21.15.162:0/973111161 shutdown_connections 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.887+0000 7f60a8200640 1 -- 172.21.15.162:0/973111161 >> 172.21.15.162:0/973111161 conn(0x7f60a00d00e0 msgr2=0x7f60a00d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.887+0000 7f60a8200640 1 -- 172.21.15.162:0/973111161 shutdown_connections 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.887+0000 7f60a8200640 1 -- 172.21.15.162:0/973111161 wait complete. 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.888+0000 7f60a8200640 1 Processor -- start 2024-01-20T11:10:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.888+0000 7f60a8200640 1 -- start start 2024-01-20T11:10:12.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.889+0000 7f60a8200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800039a0 0x7f60a00acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.889+0000 7f60a8200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60a013fbe0 0x7f60a00b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.889+0000 7f60a8200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00ad2e0 0x7f60a00ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.889+0000 7f60a8200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00adca0 con 0x7f60a013fbe0 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.889+0000 7f60a8200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0142b20 con 0x7f60800039a0 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.889+0000 7f60a8200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a01427f0 con 0x7f60a00ad2e0 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60a013fbe0 0x7f60a00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60a013fbe0 0x7f60a00b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60546/0 (socket says 172.21.15.162:60546) 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 -- 172.21.15.162:0/1156505746 learned_addr learned my addr 172.21.15.162:0/1156505746 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:12.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a5800640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800039a0 0x7f60a00acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a6200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00ad2e0 0x7f60a00ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 -- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00ad2e0 msgr2=0x7f60a00ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00ad2e0 0x7f60a00ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 -- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800039a0 msgr2=0x7f60a00acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800039a0 0x7f60a00acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 -- 172.21.15.162:0/1156505746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0140060 con 0x7f60a013fbe0 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a5800640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800039a0 0x7f60a00acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a6200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00ad2e0 0x7f60a00ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:12.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.890+0000 7f60a4e00640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60a013fbe0 0x7f60a00b06d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f608800c780 tx=0x7f608800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.891+0000 7f609d600640 1 -- 172.21.15.162:0/1156505746 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088005270 con 0x7f60a013fbe0 2024-01-20T11:10:12.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.891+0000 7f609d600640 1 -- 172.21.15.162:0/1156505746 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60880053d0 con 0x7f60a013fbe0 2024-01-20T11:10:12.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.891+0000 7f609d600640 1 -- 172.21.15.162:0/1156505746 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608800a880 con 0x7f60a013fbe0 2024-01-20T11:10:12.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.891+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a00b0f20 con 0x7f60a013fbe0 2024-01-20T11:10:12.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.891+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a00b14e0 con 0x7f60a013fbe0 2024-01-20T11:10:12.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.892+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a00cd2e0 con 0x7f60a013fbe0 2024-01-20T11:10:12.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.893+0000 7f609d600640 1 -- 172.21.15.162:0/1156505746 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f608800a9e0 con 0x7f60a013fbe0 2024-01-20T11:10:12.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.894+0000 7f609d600640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f607806af00 0x7f607806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:12.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.894+0000 7f609d600640 1 -- 172.21.15.162:0/1156505746 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6088088990 con 0x7f60a013fbe0 2024-01-20T11:10:12.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.894+0000 7f60a5800640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f607806af00 0x7f607806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:12.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.895+0000 7f60a5800640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f607806af00 0x7f607806d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6090036000 tx=0x7f6090030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:12.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:12.899+0000 7f609d600640 1 -- 172.21.15.162:0/1156505746 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6088053c20 con 0x7f60a013fbe0 2024-01-20T11:10:13.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.091+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f60a00cf090 con 0x7f607806af00 2024-01-20T11:10:13.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.092+0000 7f609d600640 1 -- 172.21.15.162:0/1156505746 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60900040c0 con 0x7f607806af00 2024-01-20T11:10:13.092 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 6 to deep-scrub 2024-01-20T11:10:13.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f607806af00 msgr2=0x7f607806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f607806af00 0x7f607806d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6090036000 tx=0x7f6090030000 comp rx=0 tx=0).stop 2024-01-20T11:10:13.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60a013fbe0 msgr2=0x7f60a00b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60a013fbe0 0x7f60a00b06d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f608800c780 tx=0x7f608800cc40 comp rx=0 tx=0).stop 2024-01-20T11:10:13.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 shutdown_connections 2024-01-20T11:10:13.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00ad2e0 0x7f60a00ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60a013fbe0 0x7f60a00b06d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f607806af00 0x7f607806d3c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 --2- 172.21.15.162:0/1156505746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60800039a0 0x7f60a00acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 >> 172.21.15.162:0/1156505746 conn(0x7f60a00d00e0 msgr2=0x7f60a0072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:13.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 shutdown_connections 2024-01-20T11:10:13.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.094+0000 7f60a8200640 1 -- 172.21.15.162:0/1156505746 wait complete. 2024-01-20T11:10:13.114 INFO:tasks.ceph:Scrubbing osd.7 2024-01-20T11:10:13.115 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-20T11:10:13.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.331+0000 7f2275800640 1 Processor -- start 2024-01-20T11:10:13.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.331+0000 7f2275800640 1 -- start start 2024-01-20T11:10:13.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.332+0000 7f2275800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2270152290 0x7f22700cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.332+0000 7f2275800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22700ca490 0x7f227015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.332+0000 7f2275800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700d0070 con 0x7f227006d540 2024-01-20T11:10:13.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.332+0000 7f2275800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227015c910 con 0x7f22700ca490 2024-01-20T11:10:13.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.332+0000 7f2275800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700b27d0 con 0x7f2270152290 2024-01-20T11:10:13.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.333+0000 7f2267e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22700ca490 0x7f227015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.333+0000 7f2267e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22700ca490 0x7f227015c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:53248/0 (socket says 172.21.15.162:53248) 2024-01-20T11:10:13.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.333+0000 7f2267e00640 1 -- 172.21.15.162:0/28691782 learned_addr learned my addr 172.21.15.162:0/28691782 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:13.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.333+0000 7f226ea00640 1 --2- 172.21.15.162:0/28691782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2270152290 0x7f22700cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.334+0000 7f226ea00640 1 -- 172.21.15.162:0/28691782 >> v2:172.21.15.179:3300/0 conn(0x7f22700ca490 msgr2=0x7f227015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:13.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.334+0000 7f226ea00640 1 --2- 172.21.15.162:0/28691782 >> v2:172.21.15.179:3300/0 conn(0x7f22700ca490 0x7f227015c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.334+0000 7f226ea00640 1 -- 172.21.15.162:0/28691782 >> v1:172.21.15.179:6789/0 conn(0x7f227006d540 legacy=0x7f22700cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.334+0000 7f226ea00640 1 -- 172.21.15.162:0/28691782 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700cf7d0 con 0x7f2270152290 2024-01-20T11:10:13.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.334+0000 7f2267e00640 1 --2- 172.21.15.162:0/28691782 >> v2:172.21.15.179:3300/0 conn(0x7f22700ca490 0x7f227015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T11:10:13.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.335+0000 7f226ea00640 1 --2- 172.21.15.162:0/28691782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2270152290 0x7f22700cf110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22600097a0 tx=0x7f226002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cd2f99acab6d706 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:13.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f226e000640 1 -- 172.21.15.162:0/28691782 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260031780 con 0x7f2270152290 2024-01-20T11:10:13.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f226e000640 1 -- 172.21.15.162:0/28691782 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600318e0 con 0x7f2270152290 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f226e000640 1 -- 172.21.15.162:0/28691782 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260031c70 con 0x7f2270152290 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 -- 172.21.15.162:0/28691782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2270152290 msgr2=0x7f22700cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 --2- 172.21.15.162:0/28691782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2270152290 0x7f22700cf110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22600097a0 tx=0x7f226002b820 comp rx=0 tx=0).stop 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 -- 172.21.15.162:0/28691782 shutdown_connections 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 --2- 172.21.15.162:0/28691782 >> v2:172.21.15.179:3300/0 conn(0x7f22700ca490 0x7f227015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 --2- 172.21.15.162:0/28691782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2270152290 0x7f22700cf110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 -- 172.21.15.162:0/28691782 >> 172.21.15.162:0/28691782 conn(0x7f227006a600 msgr2=0x7f227006a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 -- 172.21.15.162:0/28691782 shutdown_connections 2024-01-20T11:10:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.336+0000 7f2275800640 1 -- 172.21.15.162:0/28691782 wait complete. 2024-01-20T11:10:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.338+0000 7f2275800640 1 Processor -- start 2024-01-20T11:10:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.338+0000 7f2275800640 1 -- start start 2024-01-20T11:10:13.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2275800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f227006d540 0x7f2270072600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2275800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22700ca490 0x7f22701517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2275800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2270152290 0x7f22700ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2275800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270072b40 con 0x7f22700ca490 2024-01-20T11:10:13.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2275800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270151cf0 con 0x7f2270152290 2024-01-20T11:10:13.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2275800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700ce1f0 con 0x7f227006d540 2024-01-20T11:10:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2267e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22700ca490 0x7f22701517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.339+0000 7f2267e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22700ca490 0x7f22701517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60562/0 (socket says 172.21.15.162:60562) 2024-01-20T11:10:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f2267e00640 1 -- 172.21.15.162:0/2919698304 learned_addr learned my addr 172.21.15.162:0/2919698304 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f226ea00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f227006d540 0x7f2270072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f2267e00640 1 -- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f227006d540 msgr2=0x7f2270072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f2267e00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f227006d540 0x7f2270072600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f2267e00640 1 -- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2270152290 msgr2=0x7f22700ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f2267e00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2270152290 0x7f22700ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f2267e00640 1 -- 172.21.15.162:0/2919698304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580094d0 con 0x7f22700ca490 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.340+0000 7f2267e00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22700ca490 0x7f22701517b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f225800e9d0 tx=0x7f225800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.341+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800ca60 con 0x7f22700ca490 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.341+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225800cbc0 con 0x7f22700ca490 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.341+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2260009400 con 0x7f22700ca490 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.341+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258013470 con 0x7f22700ca490 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.341+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22700ce7b0 con 0x7f22700ca490 2024-01-20T11:10:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.342+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22700cfd90 con 0x7f22700ca490 2024-01-20T11:10:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.343+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f22580135d0 con 0x7f22700ca490 2024-01-20T11:10:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.344+0000 7f2266a00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f224806af00 0x7f224806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.344+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2258089660 con 0x7f22700ca490 2024-01-20T11:10:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.344+0000 7f226ea00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f224806af00 0x7f224806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.344+0000 7f2266a00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7f2248070d60 0x7f2248073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.344+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 --> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2248073830 con 0x7f2248070d60 2024-01-20T11:10:13.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.344+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f225808bc40 con 0x7f22700ca490 2024-01-20T11:10:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.345+0000 7f226f400640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7f2248070d60 0x7f2248073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.345+0000 7f226ea00640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f224806af00 0x7f224806d3c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2260036000 tx=0x7f226003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:13.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.346+0000 7f226f400640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7f2248070d60 0x7f2248073180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:13.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.348+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== osd.7 v2:172.21.15.179:6824/3678721212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2248073830 con 0x7f2248070d60 2024-01-20T11:10:13.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.362+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 --> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2270153d90 con 0x7f2248070d60 2024-01-20T11:10:13.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.363+0000 7f2266a00640 1 -- 172.21.15.162:0/2919698304 <== osd.7 v2:172.21.15.179:6824/3678721212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2270153d90 con 0x7f2248070d60 2024-01-20T11:10:13.364 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-01-20T11:10:13.364 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T11:10:13.364 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-01-20T11:10:13.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7f2248070d60 msgr2=0x7f2248073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.179:6824/3678721212,v1:172.21.15.179:6825/3678721212] conn(0x7f2248070d60 0x7f2248073180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f224806af00 msgr2=0x7f224806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f224806af00 0x7f224806d3c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2260036000 tx=0x7f226003d040 comp rx=0 tx=0).stop 2024-01-20T11:10:13.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22700ca490 msgr2=0x7f22701517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 --2- 172.21.15.162:0/2919698304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22700ca490 0x7f22701517b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f225800e9d0 tx=0x7f225800ee90 comp rx=0 tx=0).stop 2024-01-20T11:10:13.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f226f400640 1 -- 172.21.15.162:0/2919698304 reap_dead start 2024-01-20T11:10:13.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 shutdown_connections 2024-01-20T11:10:13.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.364+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 >> 172.21.15.162:0/2919698304 conn(0x7f227006a600 msgr2=0x7f227015f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:13.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.365+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 shutdown_connections 2024-01-20T11:10:13.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.365+0000 7f2275800640 1 -- 172.21.15.162:0/2919698304 wait complete. 2024-01-20T11:10:13.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-20T11:10:13.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.586+0000 7f0752c00640 1 Processor -- start 2024-01-20T11:10:13.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.587+0000 7f0752c00640 1 -- start start 2024-01-20T11:10:13.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.588+0000 7f0752c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f074c0cdc30 0x7f074c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.588+0000 7f0752c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f074c06cc20 0x7f074c0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.588+0000 7f0752c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c0cee70 con 0x7f074c141bb0 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.588+0000 7f0752c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c06d0d0 con 0x7f074c0cdc30 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.588+0000 7f0752c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0cd7a0 con 0x7f074c06cc20 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f074b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f074c0cdc30 0x7f074c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f074b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f074c0cdc30 0x7f074c06c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60564/0 (socket says 172.21.15.162:60564) 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f074b400640 1 -- 172.21.15.162:0/2503592303 learned_addr learned my addr 172.21.15.162:0/2503592303 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f0750c00640 1 --2- 172.21.15.162:0/2503592303 >> v2:172.21.15.179:3300/0 conn(0x7f074c06cc20 0x7f074c0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f074b400640 1 -- 172.21.15.162:0/2503592303 >> v2:172.21.15.179:3300/0 conn(0x7f074c06cc20 msgr2=0x7f074c0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:13.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f074b400640 1 --2- 172.21.15.162:0/2503592303 >> v2:172.21.15.179:3300/0 conn(0x7f074c06cc20 0x7f074c0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f074b400640 1 -- 172.21.15.162:0/2503592303 >> v1:172.21.15.179:6789/0 conn(0x7f074c141bb0 legacy=0x7f074c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:13.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.589+0000 7f074b400640 1 -- 172.21.15.162:0/2503592303 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0ceb90 con 0x7f074c0cdc30 2024-01-20T11:10:13.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.590+0000 7f074b400640 1 --2- 172.21.15.162:0/2503592303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c0cdc30 0x7f074c06c6e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f074c074280 tx=0x7f073402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ab9989152dce2e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:13.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.591+0000 7f074aa00640 1 -- 172.21.15.162:0/2503592303 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340317e0 con 0x7f074c0cdc30 2024-01-20T11:10:13.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.591+0000 7f074aa00640 1 -- 172.21.15.162:0/2503592303 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0734031940 con 0x7f074c0cdc30 2024-01-20T11:10:13.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.591+0000 7f074aa00640 1 -- 172.21.15.162:0/2503592303 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734031cd0 con 0x7f074c0cdc30 2024-01-20T11:10:13.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 -- 172.21.15.162:0/2503592303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c0cdc30 msgr2=0x7f074c06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 --2- 172.21.15.162:0/2503592303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c0cdc30 0x7f074c06c6e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f074c074280 tx=0x7f073402b880 comp rx=0 tx=0).stop 2024-01-20T11:10:13.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 -- 172.21.15.162:0/2503592303 shutdown_connections 2024-01-20T11:10:13.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 --2- 172.21.15.162:0/2503592303 >> v2:172.21.15.179:3300/0 conn(0x7f074c06cc20 0x7f074c0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 --2- 172.21.15.162:0/2503592303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c0cdc30 0x7f074c06c6e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 -- 172.21.15.162:0/2503592303 >> 172.21.15.162:0/2503592303 conn(0x7f074c06a600 msgr2=0x7f074c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:13.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 -- 172.21.15.162:0/2503592303 shutdown_connections 2024-01-20T11:10:13.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.592+0000 7f0752c00640 1 -- 172.21.15.162:0/2503592303 wait complete. 2024-01-20T11:10:13.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.594+0000 7f0752c00640 1 Processor -- start 2024-01-20T11:10:13.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.594+0000 7f0752c00640 1 -- start start 2024-01-20T11:10:13.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f0752c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c06cc20 0x7f074c1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f0752c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c0cdc30 0x7f074c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f0752c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c141bb0 0x7f074c13d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f0752c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c13b8a0 con 0x7f074c06cc20 2024-01-20T11:10:13.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f0752c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c13ba80 con 0x7f074c0cdc30 2024-01-20T11:10:13.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f0752c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c13bd60 con 0x7f074c141bb0 2024-01-20T11:10:13.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c06cc20 0x7f074c1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c06cc20 0x7f074c1f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60568/0 (socket says 172.21.15.162:60568) 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 -- 172.21.15.162:0/996610654 learned_addr learned my addr 172.21.15.162:0/996610654 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f0750c00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c141bb0 0x7f074c13d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074b400640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c0cdc30 0x7f074c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 -- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c141bb0 msgr2=0x7f074c13d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c141bb0 0x7f074c13d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 -- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c0cdc30 msgr2=0x7f074c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c0cdc30 0x7f074c159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074be00640 1 -- 172.21.15.162:0/996610654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07340094d0 con 0x7f074c06cc20 2024-01-20T11:10:13.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.595+0000 7f074b400640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c0cdc30 0x7f074c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:13.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.596+0000 7f074be00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c06cc20 0x7f074c1f4110 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f073c00c430 tx=0x7f073c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:13.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.596+0000 7f0743e00640 1 -- 172.21.15.162:0/996610654 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011790 con 0x7f074c06cc20 2024-01-20T11:10:13.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.596+0000 7f0743e00640 1 -- 172.21.15.162:0/996610654 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c0118f0 con 0x7f074c06cc20 2024-01-20T11:10:13.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.596+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c13c040 con 0x7f074c06cc20 2024-01-20T11:10:13.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.596+0000 7f0743e00640 1 -- 172.21.15.162:0/996610654 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011ce0 con 0x7f074c06cc20 2024-01-20T11:10:13.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.596+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c13c600 con 0x7f074c06cc20 2024-01-20T11:10:13.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.597+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c13f010 con 0x7f074c06cc20 2024-01-20T11:10:13.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.598+0000 7f0743e00640 1 -- 172.21.15.162:0/996610654 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f073c01c460 con 0x7f074c06cc20 2024-01-20T11:10:13.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.599+0000 7f0743e00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f072406aed0 0x7f072406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:13.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.599+0000 7f0743e00640 1 -- 172.21.15.162:0/996610654 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f073c0892a0 con 0x7f074c06cc20 2024-01-20T11:10:13.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.599+0000 7f074b400640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f072406aed0 0x7f072406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:13.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.600+0000 7f074b400640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f072406aed0 0x7f072406d390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0734036000 tx=0x7f073403d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:13.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.604+0000 7f0743e00640 1 -- 172.21.15.162:0/996610654 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f073c054470 con 0x7f074c06cc20 2024-01-20T11:10:13.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.800+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f074c0ce870 con 0x7f072406aed0 2024-01-20T11:10:13.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.801+0000 7f0743e00640 1 -- 172.21.15.162:0/996610654 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0734031b30 con 0x7f072406aed0 2024-01-20T11:10:13.802 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 7 to deep-scrub 2024-01-20T11:10:13.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.803+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f072406aed0 msgr2=0x7f072406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.803+0000 7f0752c00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f072406aed0 0x7f072406d390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0734036000 tx=0x7f073403d040 comp rx=0 tx=0).stop 2024-01-20T11:10:13.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.803+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c06cc20 msgr2=0x7f074c1f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.803+0000 7f0752c00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c06cc20 0x7f074c1f4110 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f073c00c430 tx=0x7f073c00c8f0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 shutdown_connections 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c141bb0 0x7f074c13d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f072406aed0 0x7f072406d390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c0cdc30 0x7f074c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 --2- 172.21.15.162:0/996610654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f074c06cc20 0x7f074c1f4110 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 >> 172.21.15.162:0/996610654 conn(0x7f074c06a600 msgr2=0x7f074c13e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:13.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 shutdown_connections 2024-01-20T11:10:13.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:13.804+0000 7f0752c00640 1 -- 172.21.15.162:0/996610654 wait complete. 2024-01-20T11:10:13.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:10:14.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.027+0000 7efeafe00640 1 Processor -- start 2024-01-20T11:10:14.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.028+0000 7efeafe00640 1 -- start start 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.029+0000 7efeafe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb0143c70 0x7efeb0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.029+0000 7efeafe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efeb00b3ad0 0x7efeb00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.029+0000 7efeafe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00cfdb0 con 0x7efeb00cf960 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.029+0000 7efeafe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00cd300 con 0x7efeb00b3ad0 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.029+0000 7efeafe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00cc9d0 con 0x7efeb0143c70 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efea5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efeb00b3ad0 0x7efeb00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efea5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efeb00b3ad0 0x7efeb00cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60578/0 (socket says 172.21.15.162:60578) 2024-01-20T11:10:14.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efea5e00640 1 -- 172.21.15.162:0/6458443 learned_addr learned my addr 172.21.15.162:0/6458443 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:14.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efeaea00640 1 --2- 172.21.15.162:0/6458443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb0143c70 0x7efeb0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:14.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efea5e00640 1 -- 172.21.15.162:0/6458443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb0143c70 msgr2=0x7efeb0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:14.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efea5e00640 1 --2- 172.21.15.162:0/6458443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb0143c70 0x7efeb0070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efea5e00640 1 -- 172.21.15.162:0/6458443 >> v1:172.21.15.162:6789/0 conn(0x7efeb00cf960 legacy=0x7efeb00b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:14.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efea5e00640 1 -- 172.21.15.162:0/6458443 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00cccb0 con 0x7efeb00b3ad0 2024-01-20T11:10:14.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.030+0000 7efeae000640 1 -- 172.21.15.162:0/6458443 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121632689 0 0) 0x7efea8001490 con 0x7efeb00cf960 2024-01-20T11:10:14.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.031+0000 7efea5e00640 1 --2- 172.21.15.162:0/6458443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00b3ad0 0x7efeb00cf420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efe98009870 tx=0x7efe9802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8559fa7b973271e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeae000640 1 -- 172.21.15.162:0/6458443 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98030840 con 0x7efeb00b3ad0 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeae000640 1 -- 172.21.15.162:0/6458443 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe980309a0 con 0x7efeb00b3ad0 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeae000640 1 -- 172.21.15.162:0/6458443 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98030d30 con 0x7efeb00b3ad0 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 -- 172.21.15.162:0/6458443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00b3ad0 msgr2=0x7efeb00cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 --2- 172.21.15.162:0/6458443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00b3ad0 0x7efeb00cf420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efe98009870 tx=0x7efe9802b980 comp rx=0 tx=0).stop 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 -- 172.21.15.162:0/6458443 shutdown_connections 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 --2- 172.21.15.162:0/6458443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00b3ad0 0x7efeb00cf420 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 --2- 172.21.15.162:0/6458443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb0143c70 0x7efeb0070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 -- 172.21.15.162:0/6458443 >> 172.21.15.162:0/6458443 conn(0x7efeb006aa20 msgr2=0x7efeb006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:14.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 -- 172.21.15.162:0/6458443 shutdown_connections 2024-01-20T11:10:14.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.032+0000 7efeafe00640 1 -- 172.21.15.162:0/6458443 wait complete. 2024-01-20T11:10:14.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.034+0000 7efeafe00640 1 Processor -- start 2024-01-20T11:10:14.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.034+0000 7efeafe00640 1 -- start start 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.035+0000 7efeafe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb00b3ad0 0x7efeb00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.035+0000 7efeafe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00cf960 0x7efeb01e4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.035+0000 7efeafe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb0143c70 0x7efeb015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.035+0000 7efeafe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01e5300 con 0x7efeb00cf960 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.035+0000 7efeafe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01e55e0 con 0x7efeb0143c70 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.035+0000 7efeafe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01e58c0 con 0x7efeb00b3ad0 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.035+0000 7efea5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00cf960 0x7efeb01e4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:14.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00cf960 0x7efeb01e4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60584/0 (socket says 172.21.15.162:60584) 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 -- 172.21.15.162:0/2942613788 learned_addr learned my addr 172.21.15.162:0/2942613788 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efeaf400640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb0143c70 0x7efeb015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efeaea00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb00b3ad0 0x7efeb00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 -- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb00b3ad0 msgr2=0x7efeb00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb00b3ad0 0x7efeb00c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 -- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb0143c70 msgr2=0x7efeb015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb0143c70 0x7efeb015c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 -- 172.21.15.162:0/2942613788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980094d0 con 0x7efeb00cf960 2024-01-20T11:10:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efeaf400640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb0143c70 0x7efeb015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T11:10:14.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.036+0000 7efea5e00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00cf960 0x7efeb01e4980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efe98000c00 tx=0x7efe98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:14.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.037+0000 7efea7400640 1 -- 172.21.15.162:0/2942613788 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98039c90 con 0x7efeb00cf960 2024-01-20T11:10:14.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.037+0000 7efea7400640 1 -- 172.21.15.162:0/2942613788 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98039df0 con 0x7efeb00cf960 2024-01-20T11:10:14.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.037+0000 7efea7400640 1 -- 172.21.15.162:0/2942613788 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98043640 con 0x7efeb00cf960 2024-01-20T11:10:14.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.037+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb00b40b0 con 0x7efeb00cf960 2024-01-20T11:10:14.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.037+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb01e5e80 con 0x7efeb00cf960 2024-01-20T11:10:14.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.038+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0074a30 con 0x7efeb00cf960 2024-01-20T11:10:14.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.039+0000 7efea7400640 1 -- 172.21.15.162:0/2942613788 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7efe980437a0 con 0x7efeb00cf960 2024-01-20T11:10:14.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.040+0000 7efea7400640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7efe8806af20 0x7efe8806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:14.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.040+0000 7efea7400640 1 -- 172.21.15.162:0/2942613788 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efe9803e070 con 0x7efeb00cf960 2024-01-20T11:10:14.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.040+0000 7efeaea00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7efe8806af20 0x7efe8806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:14.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.041+0000 7efeaea00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7efe8806af20 0x7efe8806d3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efea0006fd0 tx=0x7efea0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:14.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.045+0000 7efea7400640 1 -- 172.21.15.162:0/2942613788 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efe980775c0 con 0x7efeb00cf960 2024-01-20T11:10:14.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.233+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efeb01e5750 con 0x7efe8806af20 2024-01-20T11:10:14.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.236+0000 7efea7400640 1 -- 172.21.15.162:0/2942613788 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48157 (secure 0 0 0) 0x7efeb01e5750 con 0x7efe8806af20 2024-01-20T11:10:14.237 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:10:14.238 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:10:14.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7efe8806af20 msgr2=0x7efe8806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:14.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7efe8806af20 0x7efe8806d3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efea0006fd0 tx=0x7efea0008040 comp rx=0 tx=0).stop 2024-01-20T11:10:14.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00cf960 msgr2=0x7efeb01e4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:14.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00cf960 0x7efeb01e4980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efe98000c00 tx=0x7efe98004730 comp rx=0 tx=0).stop 2024-01-20T11:10:14.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 shutdown_connections 2024-01-20T11:10:14.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7efe8806af20 0x7efe8806d3e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb0143c70 0x7efeb015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb00cf960 0x7efeb01e4980 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 --2- 172.21.15.162:0/2942613788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeb00b3ad0 0x7efeb00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:14.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 >> 172.21.15.162:0/2942613788 conn(0x7efeb006aa20 msgr2=0x7efeb0070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:14.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 shutdown_connections 2024-01-20T11:10:14.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:14.239+0000 7efeafe00640 1 -- 172.21.15.162:0/2942613788 wait complete. 2024-01-20T11:10:14.257 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-01-20T11:10:13.631791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":246940,"kb_used_data":5800,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727780,"statfs":{"total":773094113280,"available":772841246720,"internally_reserved":0,"allocated":5939200,"data_stored":3105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.875738"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-20T11:10:01.198656+0000","last_change":"2024-01-20T11:07:27.451230+0000","last_active":"2024-01-20T11:10:01.198656+0000","last_peered":"2024-01-20T11:10:01.198656+0000","last_clean":"2024-01-20T11:10:01.198656+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:10:01.198656+0000","last_undegraded":"2024-01-20T11:10:01.198656+0000","last_fullsized":"2024-01-20T11:10:01.198656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T11:07:26.368636+0000","last_clean_scrub_stamp":"2024-01-20T11:07:26.368636+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:08:33.350831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.409}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.2669999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.157}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.3600000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.48},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0269999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.5209999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.296,"5min":3.343,"15min":3.343},"last":1.347},{"interface":"front","average":{"1min":1.056,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6830000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.135}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.216,"15min":1.2410000000000001},"min":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.675,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.256},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4710000000000001,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3859999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2450000000000001,"15min":1.248},"min":{"1min":0.85699999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.514,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.468},{"interface":"front","average":{"1min":1.226,"5min":1.294,"15min":1.3049999999999999},"min":{"1min":0.82299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.694,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":1.512}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.284,"15min":1.2929999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.609,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.218},{"interface":"front","average":{"1min":1.353,"5min":1.4690000000000001,"15min":1.488},"min":{"1min":1.0700000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.708,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.413}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.4419999999999999},"min":{"1min":0.88600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.6399999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.292},{"interface":"front","average":{"1min":1.347,"5min":1.355,"15min":1.3560000000000001},"min":{"1min":0.88100000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.768,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.177}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5309999999999999,"15min":1.542},"min":{"1min":1.1180000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9099999999999999,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.5369999999999999,"15min":1.5509999999999999},"min":{"1min":0.94399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9370000000000001,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":1.542}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":1.034,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.853,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.673,"15min":1.6910000000000001},"min":{"1min":1.0680000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9950000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":0.90300000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.099},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1220000000000001,"15min":1.1180000000000001},"min":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1359999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.117,"15min":1.121},"min":{"1min":0.78200000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7130000000000001,"5min":1.845,"15min":1.845},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.129,"15min":1.121},"min":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.607,"5min":1.968,"15min":1.968},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.4850000000000001,"5min":1.544,"15min":1.544},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.371,"5min":1.202,"15min":1.1739999999999999},"min":{"1min":0.91600000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.1899999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2689999999999999,"15min":1.2669999999999999},"min":{"1min":0.86699999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.81599999999999995,"5min":0.748,"15min":0.748},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.393},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4710000000000001,"15min":1.4750000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8129999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.244}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.52,"15min":1.5169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.405,"15min":1.3899999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.968,"5min":2.069,"15min":2.069},"last":1.4770000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5640000000000001,"15min":1.577},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8149999999999999,"5min":1.956,"15min":1.956},"last":1.708},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6359999999999999,"15min":1.6339999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.089,"5min":2.105,"15min":2.105},"last":1.6439999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.115,"15min":1.103},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.72999999999999998}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.125,"15min":1.1259999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5249999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.21,"15min":1.216},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.704,"5min":1.954,"15min":1.954},"last":1.0049999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1679999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.218,"5min":1.1679999999999999,"15min":1.1599999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":1.853,"15min":1.853},"last":1.236}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.516,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3300000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.617,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.042}]},{"osd":5,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.361},{"interface":"front","average":{"1min":1.379,"5min":1.3580000000000001,"15min":1.3540000000000001},"min":{"1min":0.89200000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.839,"5min":2.681,"15min":2.681},"last":1.569}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.9119999999999999,"5min":2.968,"15min":2.968},"last":1.302},{"interface":"front","average":{"1min":1.552,"5min":1.472,"15min":1.458},"min":{"1min":0.88900000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.0510000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.617}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7490000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.5209999999999999,"15min":1.522},"min":{"1min":0.876,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.853,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.5089999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.72799999999999998}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.167}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.0940000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.89800000000000002}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.85999999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92600000000000005,"15min":0.85199999999999998},"min":{"1min":0.622,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":9.8870000000000005,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.1080000000000001,"15min":1.05},"min":{"1min":0.66900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.026,"5min":10.026,"15min":10.026},"last":1.0860000000000001}]},{"osd":1,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.137,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.367},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.2090000000000001,"15min":1.129},"min":{"1min":0.66600000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.231,"5min":11.231,"15min":11.231},"last":1.429}]},{"osd":3,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.21,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":11.414999999999999,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.536},{"interface":"front","average":{"1min":1.851,"5min":1.4359999999999999,"15min":1.367},"min":{"1min":0.95399999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":10.919,"5min":10.919,"15min":10.919},"last":1.212}]},{"osd":4,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.4990000000000001,"15min":1.4350000000000001},"min":{"1min":1.073,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":11.1,"5min":11.1,"15min":11.1},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.996,"5min":1.54,"15min":1.464},"min":{"1min":0.89600000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":11.141999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":1.5860000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.4199999999999999,"15min":1.3799999999999999},"min":{"1min":0.86899999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":10.077999999999999,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.401,"15min":1.3899999999999999},"min":{"1min":1.0920000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.7769999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":1.6499999999999999,"15min":1.5760000000000001},"min":{"1min":1.22,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":11.185,"5min":11.185,"15min":11.185},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.845,"5min":1.536,"15min":1.484},"min":{"1min":1.008,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":10.144,"5min":10.144,"15min":10.144},"last":1.0589999999999999}]},{"osd":7,"last update":"Sat Jan 20 11:09:27 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.52,"15min":1.4670000000000001},"min":{"1min":0.96999999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":10.234999999999999,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.341},{"interface":"front","average":{"1min":1.956,"5min":1.512,"15min":1.4379999999999999},"min":{"1min":1.2549999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":9.843,"5min":9.843,"15min":9.843},"last":1.6719999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.0549999999999999,"15min":1.01},"min":{"1min":0.38400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":12.061,"5min":12.061,"15min":12.061},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1739999999999999,"15min":1.165},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":10.976000000000001,"5min":10.976000000000001,"15min":10.976000000000001},"last":1.47}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.04,"15min":1.054},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.3929999999999998,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.889,"5min":1.3520000000000001,"15min":1.262},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.204999999999998,"5min":20.204999999999998,"15min":20.204999999999998},"last":1.347}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.278,"15min":1.232},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":11.978999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.1160000000000001,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":1.0669999999999999}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.325,"15min":1.3540000000000001},"min":{"1min":0.77900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6839999999999999,"5min":5.21,"15min":5.21},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.9339999999999999,"5min":1.528,"15min":1.46},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":15.596,"5min":15.596,"15min":15.596},"last":1.1919999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.5740000000000001,"15min":1.5649999999999999},"min":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.254},{"interface":"front","average":{"1min":1.296,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.966,"5min":5.242,"15min":5.242},"last":1.294}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.6040000000000001,"15min":1.5900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":10.784000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.333},{"interface":"front","average":{"1min":1.282,"5min":1.423,"15min":1.4470000000000001},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.931,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.4430000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.601,"15min":1.5569999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":12.023,"5min":12.023,"15min":12.023},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.7150000000000001,"15min":1.6990000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":10.869999999999999,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.407}]}]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.113,"5min":0.91000000000000003,"15min":0.876},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.1109999999999998,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":1.486}]},{"osd":2,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4,"5min":4,"15min":4},"last":1.02},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.90400000000000003,"15min":0.85999999999999999},"min":{"1min":0.48999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.976,"5min":5.976,"15min":5.976},"last":1.0800000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.03,"15min":1.006},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":1.194},{"interface":"front","average":{"1min":1.29,"5min":1.042,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.2110000000000003,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":1.153}]},{"osd":4,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.2450000000000001,"15min":1.2110000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.2640000000000002,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.25,"15min":1.234},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.387},{"interface":"front","average":{"1min":1.51,"5min":1.25,"15min":1.206},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":1.3580000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.2949999999999999,"15min":1.2749999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3899999999999999,"15min":1.3620000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5629999999999997,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.282}]},{"osd":7,"last update":"Sat Jan 20 11:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.337,"15min":1.296},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":6.1660000000000004,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3859999999999999,"15min":1.3839999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.528}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:10:14.262 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-20T11:07:26.368636+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=20, tm_hour=11, tm_min=7, tm_sec=26, tm_wday=5, tm_yday=20, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=20, tm_hour=11, tm_min=10, tm_sec=7, tm_wday=5, tm_yday=20, tm_isdst=0) 2024-01-20T11:10:14.262 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-20T11:10:27.911 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:10:27.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:10:34.264 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T11:10:34.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.482+0000 7fba84400640 1 Processor -- start 2024-01-20T11:10:34.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.482+0000 7fba84400640 1 -- start start 2024-01-20T11:10:34.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.483+0000 7fba84400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fba7c155a30 0x7fba7c0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.483+0000 7fba84400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c0ae6b0 0x7fba7c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.483+0000 7fba84400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c070b60 con 0x7fba7c070630 2024-01-20T11:10:34.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.483+0000 7fba84400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c15ba10 con 0x7fba7c155a30 2024-01-20T11:10:34.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.483+0000 7fba84400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15bc00 con 0x7fba7c0ae6b0 2024-01-20T11:10:34.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.484+0000 7fba81a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fba7c155a30 0x7fba7c0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.484+0000 7fba81a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fba7c155a30 0x7fba7c0ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43716/0 (socket says 172.21.15.162:43716) 2024-01-20T11:10:34.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.484+0000 7fba81a00640 1 -- 172.21.15.162:0/3992130105 learned_addr learned my addr 172.21.15.162:0/3992130105 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:34.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.484+0000 7fba82400640 1 --2- 172.21.15.162:0/3992130105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c0ae6b0 0x7fba7c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.484+0000 7fba81a00640 1 -- 172.21.15.162:0/3992130105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c0ae6b0 msgr2=0x7fba7c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:34.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.484+0000 7fba81a00640 1 --2- 172.21.15.162:0/3992130105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c0ae6b0 0x7fba7c06c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.484+0000 7fba81a00640 1 -- 172.21.15.162:0/3992130105 >> v1:172.21.15.179:6789/0 conn(0x7fba7c070630 legacy=0x7fba7c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:34.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.485+0000 7fba81a00640 1 -- 172.21.15.162:0/3992130105 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c15bee0 con 0x7fba7c155a30 2024-01-20T11:10:34.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.486+0000 7fba81a00640 1 --2- 172.21.15.162:0/3992130105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0ce800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009e50 tx=0x7fba6c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a73951fcaef773 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:34.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.486+0000 7fba7be00640 1 -- 172.21.15.162:0/3992130105 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c02c9e0 con 0x7fba7c155a30 2024-01-20T11:10:34.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.486+0000 7fba7be00640 1 -- 172.21.15.162:0/3992130105 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c02cb40 con 0x7fba7c155a30 2024-01-20T11:10:34.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.486+0000 7fba7be00640 1 -- 172.21.15.162:0/3992130105 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0343f0 con 0x7fba7c155a30 2024-01-20T11:10:34.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 -- 172.21.15.162:0/3992130105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 msgr2=0x7fba7c0ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 --2- 172.21.15.162:0/3992130105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0ce800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009e50 tx=0x7fba6c02be40 comp rx=0 tx=0).stop 2024-01-20T11:10:34.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 -- 172.21.15.162:0/3992130105 shutdown_connections 2024-01-20T11:10:34.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 --2- 172.21.15.162:0/3992130105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c0ae6b0 0x7fba7c06c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 --2- 172.21.15.162:0/3992130105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0ce800 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 -- 172.21.15.162:0/3992130105 >> 172.21.15.162:0/3992130105 conn(0x7fba7c0b0cd0 msgr2=0x7fba7c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:34.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 -- 172.21.15.162:0/3992130105 shutdown_connections 2024-01-20T11:10:34.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.487+0000 7fba84400640 1 -- 172.21.15.162:0/3992130105 wait complete. 2024-01-20T11:10:34.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.489+0000 7fba84400640 1 Processor -- start 2024-01-20T11:10:34.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.489+0000 7fba84400640 1 -- start start 2024-01-20T11:10:34.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.490+0000 7fba84400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c070630 0x7fba7c0af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.490+0000 7fba84400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba7c0ae6b0 0x7fba7c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.490+0000 7fba84400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.490+0000 7fba84400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0b04a0 con 0x7fba7c155a30 2024-01-20T11:10:34.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.490+0000 7fba84400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c9de0 con 0x7fba7c0ae6b0 2024-01-20T11:10:34.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.490+0000 7fba84400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c97d0 con 0x7fba7c070630 2024-01-20T11:10:34.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43720/0 (socket says 172.21.15.162:43720) 2024-01-20T11:10:34.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 -- 172.21.15.162:0/4174234861 learned_addr learned my addr 172.21.15.162:0/4174234861 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:34.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba81000640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba7c0ae6b0 0x7fba7c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba81a00640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c070630 0x7fba7c0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 -- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c070630 msgr2=0x7fba7c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c070630 0x7fba7c0af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 -- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba7c0ae6b0 msgr2=0x7fba7c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba7c0ae6b0 0x7fba7c0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.491+0000 7fba82400640 1 -- 172.21.15.162:0/4174234861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c009b30 con 0x7fba7c155a30 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.492+0000 7fba82400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0c8890 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c7f0 tx=0x7fba7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.492+0000 7fba79600640 1 -- 172.21.15.162:0/4174234861 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74004220 con 0x7fba7c155a30 2024-01-20T11:10:34.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.492+0000 7fba79600640 1 -- 172.21.15.162:0/4174234861 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74004380 con 0x7fba7c155a30 2024-01-20T11:10:34.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.492+0000 7fba79600640 1 -- 172.21.15.162:0/4174234861 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74007860 con 0x7fba7c155a30 2024-01-20T11:10:34.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.492+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0b01c0 con 0x7fba7c155a30 2024-01-20T11:10:34.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.492+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c0afe90 con 0x7fba7c155a30 2024-01-20T11:10:34.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.493+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0c9630 con 0x7fba7c155a30 2024-01-20T11:10:34.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.494+0000 7fba79600640 1 -- 172.21.15.162:0/4174234861 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fba74007bd0 con 0x7fba7c155a30 2024-01-20T11:10:34.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.495+0000 7fba79600640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fba5406aed0 0x7fba5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.495+0000 7fba79600640 1 -- 172.21.15.162:0/4174234861 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba74089240 con 0x7fba7c155a30 2024-01-20T11:10:34.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.495+0000 7fba81a00640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fba5406aed0 0x7fba5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.496+0000 7fba81a00640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fba5406aed0 0x7fba5406d390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fba6c035000 tx=0x7fba6c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:34.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.500+0000 7fba79600640 1 -- 172.21.15.162:0/4174234861 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fba7c0c9630 con 0x7fba7c155a30 2024-01-20T11:10:34.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.690+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 --> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba7c0ced40 con 0x7fba5406aed0 2024-01-20T11:10:34.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.693+0000 7fba79600640 1 -- 172.21.15.162:0/4174234861 <== mgr.4113 v2:172.21.15.162:6832/1143721842 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48198 (secure 0 0 0) 0x7fba6c044090 con 0x7fba5406aed0 2024-01-20T11:10:34.696 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:10:34.696 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-01-20T11:10:34.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.696+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fba5406aed0 msgr2=0x7fba5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.696+0000 7fba84400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fba5406aed0 0x7fba5406d390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fba6c035000 tx=0x7fba6c030000 comp rx=0 tx=0).stop 2024-01-20T11:10:34.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.696+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 msgr2=0x7fba7c0c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.696+0000 7fba84400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0c8890 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c7f0 tx=0x7fba7400ccb0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 shutdown_connections 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba7c155a30 0x7fba7c0c8890 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7fba5406aed0 0x7fba5406d390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba7c0ae6b0 0x7fba7c0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 --2- 172.21.15.162:0/4174234861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba7c070630 0x7fba7c0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 >> 172.21.15.162:0/4174234861 conn(0x7fba7c0b0cd0 msgr2=0x7fba7c0ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:34.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 shutdown_connections 2024-01-20T11:10:34.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.697+0000 7fba84400640 1 -- 172.21.15.162:0/4174234861 wait complete. 2024-01-20T11:10:34.718 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-01-20T11:10:33.639798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":246932,"kb_used_data":5800,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727788,"statfs":{"total":773094113280,"available":772841254912,"internally_reserved":0,"allocated":5939200,"data_stored":3105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003568"},"pg_stats":[{"pgid":"1.0","version":"50'119","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-01-20T11:10:14.523271+0000","last_change":"2024-01-20T11:10:14.523385+0000","last_active":"2024-01-20T11:10:14.523271+0000","last_peered":"2024-01-20T11:10:14.523271+0000","last_clean":"2024-01-20T11:10:14.523271+0000","last_became_active":"2024-01-20T11:07:27.448877+0000","last_became_peered":"2024-01-20T11:07:27.448877+0000","last_unstale":"2024-01-20T11:10:14.523271+0000","last_undegraded":"2024-01-20T11:10:14.523271+0000","last_fullsized":"2024-01-20T11:10:14.523271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'119","last_scrub_stamp":"2024-01-20T11:10:14.523082+0000","last_deep_scrub":"50'119","last_deep_scrub_stamp":"2024-01-20T11:10:14.523082+0000","last_clean_scrub_stamp":"2024-01-20T11:10:14.523082+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T22:26:38.631596+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.772,"5min":1.806,"15min":1.806},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.76800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5720000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1319999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.165,"15min":1.157},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5680000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.88700000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7030000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.3029999999999999}]},{"osd":2,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.139,"15min":1.131},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.8759999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.228},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.274},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6379999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1699999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.353,"15min":1.365},"min":{"1min":0.76500000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.748,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":1.3420000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3109999999999999,"15min":1.3220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8200000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4019999999999999,"15min":1.415},"min":{"1min":1.0860000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6659999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.3759999999999999}]},{"osd":5,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4670000000000001,"15min":1.4690000000000001},"min":{"1min":0.96999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.863,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.484,"15min":1.4890000000000001},"min":{"1min":1.0209999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2810000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.589}]},{"osd":6,"last update":"Sat Jan 20 11:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.573,"15min":1.577},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.0750000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5309999999999999,"15min":1.538},"min":{"1min":1.268,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.9770000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.6259999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.145,"15min":1.1599999999999999},"min":{"1min":0.91500000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6220000000000001,"5min":3.343,"15min":3.343},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1180000000000001,"15min":1.1499999999999999},"min":{"1min":0.67200000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.407,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.532}]},{"osd":1,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1910000000000001,"15min":1.2330000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5449999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.252},{"interface":"front","average":{"1min":1.089,"5min":1.1519999999999999,"15min":1.1879999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4099999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.113}]},{"osd":2,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2430000000000001,"15min":1.2470000000000001},"min":{"1min":0.81200000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4830000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.76100000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.528,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":1.2929999999999999}]},{"osd":3,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.266,"15min":1.2869999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.506,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.4319999999999999,"15min":1.476},"min":{"1min":0.98699999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.698,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":1.0700000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.355,"15min":1.4219999999999999},"min":{"1min":0.88400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.5589999999999999,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.002},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3260000000000001,"15min":1.3460000000000001},"min":{"1min":0.84199999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5620000000000001,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.347}]},{"osd":5,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.49,"15min":1.528},"min":{"1min":0.95399999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5880000000000001,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.506,"15min":1.5409999999999999},"min":{"1min":1.0049999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.665,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.76000000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.51,"15min":1.5529999999999999},"min":{"1min":1.0209999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.651,"5min":3.0289999999999999,"15min":3.0289999999999999},"last":1.204},{"interface":"front","average":{"1min":1.425,"5min":1.6180000000000001,"15min":1.673},"min":{"1min":0.90300000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5960000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.5820000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1220000000000001,"15min":1.1180000000000001},"min":{"1min":0.73899999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.98499999999999999}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.117,"15min":1.121},"min":{"1min":0.78200000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7130000000000001,"5min":1.845,"15min":1.845},"last":1.224},{"interface":"front","average":{"1min":1.177,"5min":1.129,"15min":1.121},"min":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.607,"5min":1.968,"15min":1.968},"last":1.5600000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.4850000000000001,"5min":1.544,"15min":1.544},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.371,"5min":1.202,"15min":1.1739999999999999},"min":{"1min":0.91600000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.3240000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2689999999999999,"15min":1.2669999999999999},"min":{"1min":0.86699999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.395},{"interface":"front","average":{"1min":1.381,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.81599999999999995,"5min":0.748,"15min":0.748},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.667}]},{"osd":4,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4710000000000001,"15min":1.4750000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8129999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.2669999999999999}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.52,"15min":1.5169999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.032},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.405,"15min":1.3899999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.968,"5min":2.069,"15min":2.069},"last":1.8500000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5640000000000001,"15min":1.577},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8149999999999999,"5min":1.956,"15min":1.956},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6359999999999999,"15min":1.6339999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.089,"5min":2.105,"15min":2.105},"last":1.135}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0509999999999999,"15min":1.0369999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.276},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.115,"15min":1.103},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.222}]},{"osd":1,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.125,"15min":1.1259999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5249999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.415},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.21,"15min":1.216},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.704,"5min":1.954,"15min":1.954},"last":1.4710000000000001}]},{"osd":2,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1679999999999999,"15min":1.161},"min":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.171},{"interface":"front","average":{"1min":1.218,"5min":1.1679999999999999,"15min":1.1599999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5069999999999999,"5min":1.853,"15min":1.853},"last":1.0580000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.516,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.321},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3300000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.617,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.25}]},{"osd":5,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3580000000000001,"15min":1.3540000000000001},"min":{"1min":0.89200000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.839,"5min":2.681,"15min":2.681},"last":1.119}]},{"osd":6,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.9119999999999999,"5min":2.968,"15min":2.968},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.552,"5min":1.472,"15min":1.458},"min":{"1min":0.88900000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.0510000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.532}]},{"osd":7,"last update":"Sat Jan 20 11:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3979999999999999,"15min":1.3919999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7490000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.5209999999999999,"15min":1.522},"min":{"1min":0.876,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.853,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.359}]}]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84799999999999998,"15min":0.86899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.755},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.48499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.157,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.075}]},{"osd":1,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3839999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4950000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.028}]},{"osd":2,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.532,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.27},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.1379999999999999},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.681,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.96399999999999997}]},{"osd":4,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2,"15min":1.21},"min":{"1min":0.872,"5min":0.75,"15min":0.75},"max":{"1min":1.577,"5min":2.028,"15min":2.028},"last":1.179},{"interface":"front","average":{"1min":1.353,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.93899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.595,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.466}]},{"osd":5,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.349,"15min":1.3560000000000001},"min":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7849999999999999,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7789999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":1.226}]},{"osd":6,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.847,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":1.403},{"interface":"front","average":{"1min":1.302,"5min":1.4550000000000001,"15min":1.4810000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.758,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.528}]},{"osd":7,"last update":"Sat Jan 20 11:09:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.429,"15min":1.4590000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.671,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.431},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.452,"15min":1.468},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.845,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.575}]}]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.92400000000000004,"15min":0.85099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3859999999999999,"5min":9.8870000000000005,"15min":9.8870000000000005},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.093,"15min":1.0449999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5429999999999999,"5min":10.026,"15min":10.026},"last":0.89200000000000002}]},{"osd":1,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.117,"15min":1.0449999999999999},"min":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.371,"5min":12.023,"15min":12.023},"last":1.371},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.1879999999999999,"15min":1.1220000000000001},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.429,"5min":11.231,"15min":11.231},"last":0.748}]},{"osd":3,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.208,"15min":1.1259999999999999},"min":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.536,"5min":11.414999999999999,"15min":11.414999999999999},"last":1.157},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.389,"15min":1.351},"min":{"1min":0.56699999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.552,"5min":10.919,"15min":10.919},"last":0.96799999999999997}]},{"osd":4,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.468,"15min":1.425},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.806,"5min":11.1,"15min":11.1},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.5189999999999999,"15min":1.4570000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.0289999999999999,"5min":11.141999999999999,"15min":11.141999999999999},"last":1.028}]},{"osd":5,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.365,"15min":1.361},"min":{"1min":0.81699999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.3140000000000001,"5min":10.077999999999999,"15min":10.077999999999999},"last":1.204},{"interface":"front","average":{"1min":1.286,"5min":1.381,"15min":1.383},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7769999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.5780000000000001}]},{"osd":6,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.6259999999999999,"15min":1.5680000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.1429999999999998,"5min":11.185,"15min":11.185},"last":1.244},{"interface":"front","average":{"1min":1.194,"5min":1.4830000000000001,"15min":1.4670000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5780000000000001,"5min":10.144,"15min":10.144},"last":1.3280000000000001}]},{"osd":7,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.4870000000000001,"15min":1.456},"min":{"1min":0.88600000000000001,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.599,"5min":10.234999999999999,"15min":10.234999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.4950000000000001,"15min":1.4319999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.994,"5min":9.843,"15min":9.843},"last":1.498}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":240566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 11:10:29 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.014,"15min":0.996},"min":{"1min":0.45800000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.2929999999999999,"5min":12.061,"15min":12.061},"last":1.1699999999999999},{"interface":"front","average":{"1min":1,"5min":1.1419999999999999,"15min":1.1539999999999999},"min":{"1min":0.51800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5009999999999999,"5min":10.976000000000001,"15min":10.976000000000001},"last":1.292}]},{"osd":2,"last update":"Sat Jan 20 11:10:29 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.998,"15min":1.04},"min":{"1min":0.435,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.671,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.302,"15min":1.246},"min":{"1min":0.495,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3819999999999999,"5min":20.204999999999998,"15min":20.204999999999998},"last":1.7130000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.25,"15min":1.222},"min":{"1min":0.53500000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.5089999999999999,"5min":11.978999999999999,"15min":11.978999999999999},"last":1.8759999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.129,"15min":1.069},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.6539999999999999,"5min":11.006,"15min":11.006},"last":1.5640000000000001}]},{"osd":4,"last update":"Sat Jan 20 11:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2809999999999999,"15min":1.339},"min":{"1min":0.79700000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.5580000000000001,"5min":5.21,"15min":5.21},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.4870000000000001,"15min":1.4470000000000001},"min":{"1min":0.79900000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.591,"5min":15.596,"15min":15.596},"last":1.6060000000000001}]},{"osd":5,"last update":"Sat Jan 20 11:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.518,"15min":1.546},"min":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7589999999999999,"5min":11.050000000000001,"15min":11.050000000000001},"last":1.9390000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.4279999999999999,"15min":1.4910000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.157,"5min":5.242,"15min":5.242},"last":1.508}]},{"osd":6,"last update":"Sat Jan 20 11:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.552,"15min":1.573},"min":{"1min":0.79800000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8380000000000001,"5min":10.784000000000001,"15min":10.784000000000001},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.389,"15min":1.4350000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.0779999999999998,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":1.758}]},{"osd":7,"last update":"Sat Jan 20 11:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.577,"15min":1.5489999999999999},"min":{"1min":1.0960000000000001,"5min":0.875,"15min":0.875},"max":{"1min":1.6970000000000001,"5min":12.023,"15min":12.023},"last":1.996},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.6579999999999999,"15min":1.6799999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.903,"5min":10.869999999999999,"15min":10.869999999999999},"last":1.7769999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1187840,"data_stored":830934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83199999999999996,"15min":0.79200000000000004},"min":{"1min":0.51600000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.407,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.052,"5min":0.94899999999999995,"15min":0.88900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.532,"5min":4.1109999999999998,"15min":4.1109999999999998},"last":1.115}]},{"osd":2,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.94199999999999995,"15min":0.90400000000000003},"min":{"1min":0.54500000000000004,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.454,"5min":4,"15min":4},"last":1.399},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.91300000000000003,"15min":0.86299999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":5.976,"15min":5.976},"last":1.0720000000000001}]},{"osd":3,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":1.0029999999999999,"15min":0.997},"min":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.256,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0720000000000001,"15min":1.0109999999999999},"min":{"1min":0.62,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7310000000000001,"5min":4.2110000000000003,"15min":4.2110000000000003},"last":0.96099999999999997}]},{"osd":4,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2390000000000001,"15min":1.2090000000000001},"min":{"1min":0.73099999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.9810000000000001,"5min":6.2640000000000002,"15min":6.2640000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.91100000000000003,"5min":0.622,"15min":0.622},"max":{"1min":1.853,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.234}]},{"osd":5,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.359,"15min":1.341},"min":{"1min":0.99299999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.6819999999999999,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.268,"15min":1.212},"min":{"1min":0.76000000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.883,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":1.512}]},{"osd":6,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.278},"min":{"1min":0.83799999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.738,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4019999999999999,"15min":1.3660000000000001},"min":{"1min":0.94199999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.925,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.26}]},{"osd":7,"last update":"Sat Jan 20 11:10:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.345,"15min":1.2989999999999999},"min":{"1min":0.89200000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.792,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3759999999999999,"15min":1.3799999999999999},"min":{"1min":0.80800000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.024,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.1619999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T11:10:34.720 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-20T11:10:34.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.919+0000 7f3f2e800640 1 Processor -- start 2024-01-20T11:10:34.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.919+0000 7f3f2e800640 1 -- start start 2024-01-20T11:10:34.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.920+0000 7f3f2e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f28144a10 0x7f3f280ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.920+0000 7f3f2e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 0x7f3f280703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.920+0000 7f3f2e800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f280cd880 0x7f3f280cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2e800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f28071830 con 0x7f3f28144a10 2024-01-20T11:10:34.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2e800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f28070c20 con 0x7f3f280cd880 2024-01-20T11:10:34.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2e800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28070f00 con 0x7f3f28071cc0 2024-01-20T11:10:34.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f28144a10 0x7f3f280ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f28144a10 0x7f3f280ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43726/0 (socket says 172.21.15.162:43726) 2024-01-20T11:10:34.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 -- 172.21.15.162:0/3799243463 learned_addr learned my addr 172.21.15.162:0/3799243463 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:34.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 -- 172.21.15.162:0/3799243463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 msgr2=0x7f3f280703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:34.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 --2- 172.21.15.162:0/3799243463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 0x7f3f280703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 -- 172.21.15.162:0/3799243463 >> v2:172.21.15.179:3300/0 conn(0x7f3f280cd880 msgr2=0x7f3f280cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:34.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 --2- 172.21.15.162:0/3799243463 >> v2:172.21.15.179:3300/0 conn(0x7f3f280cd880 0x7f3f280cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.921+0000 7f3f2d400640 1 -- 172.21.15.162:0/3799243463 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280711e0 con 0x7f3f28144a10 2024-01-20T11:10:34.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.922+0000 7f3f2d400640 1 --2- 172.21.15.162:0/3799243463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f28144a10 0x7f3f280ce950 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3f2806beb0 tx=0x7f3f1802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fce44f09ee8577a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:34.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.923+0000 7f3f27e00640 1 -- 172.21.15.162:0/3799243463 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18031860 con 0x7f3f28144a10 2024-01-20T11:10:34.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.923+0000 7f3f27e00640 1 -- 172.21.15.162:0/3799243463 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f180319c0 con 0x7f3f28144a10 2024-01-20T11:10:34.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.923+0000 7f3f27e00640 1 -- 172.21.15.162:0/3799243463 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18031d50 con 0x7f3f28144a10 2024-01-20T11:10:34.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.923+0000 7f3f2e800640 1 -- 172.21.15.162:0/3799243463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f28144a10 msgr2=0x7f3f280ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.923+0000 7f3f2e800640 1 --2- 172.21.15.162:0/3799243463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f28144a10 0x7f3f280ce950 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3f2806beb0 tx=0x7f3f1802b900 comp rx=0 tx=0).stop 2024-01-20T11:10:34.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.924+0000 7f3f2e800640 1 -- 172.21.15.162:0/3799243463 shutdown_connections 2024-01-20T11:10:34.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.924+0000 7f3f2e800640 1 --2- 172.21.15.162:0/3799243463 >> v2:172.21.15.179:3300/0 conn(0x7f3f280cd880 0x7f3f280cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.924+0000 7f3f2e800640 1 --2- 172.21.15.162:0/3799243463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 0x7f3f280703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.924+0000 7f3f2e800640 1 --2- 172.21.15.162:0/3799243463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f28144a10 0x7f3f280ce950 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.924+0000 7f3f2e800640 1 -- 172.21.15.162:0/3799243463 >> 172.21.15.162:0/3799243463 conn(0x7f3f280b0c40 msgr2=0x7f3f280b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:34.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.924+0000 7f3f2e800640 1 -- 172.21.15.162:0/3799243463 shutdown_connections 2024-01-20T11:10:34.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.924+0000 7f3f2e800640 1 -- 172.21.15.162:0/3799243463 wait complete. 2024-01-20T11:10:34.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.926+0000 7f3f2e800640 1 Processor -- start 2024-01-20T11:10:34.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.926+0000 7f3f2e800640 1 -- start start 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 0x7f3f28139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f280cd880 0x7f3f2815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2e800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f28144a10 0x7f3f2813c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815cf50 con 0x7f3f280cd880 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2e800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815c2d0 con 0x7f3f28144a10 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2e800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815c5b0 con 0x7f3f28071cc0 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f280cd880 0x7f3f2815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f280cd880 0x7f3f2815e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43730/0 (socket says 172.21.15.162:43730) 2024-01-20T11:10:34.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.927+0000 7f3f2ca00640 1 -- 172.21.15.162:0/382924976 learned_addr learned my addr 172.21.15.162:0/382924976 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2de00640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f28144a10 0x7f3f2813c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2d400640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 0x7f3f28139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2ca00640 1 -- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 msgr2=0x7f3f28139810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2ca00640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 0x7f3f28139810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2ca00640 1 -- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f28144a10 msgr2=0x7f3f2813c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2ca00640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f28144a10 0x7f3f2813c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2ca00640 1 -- 172.21.15.162:0/382924976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180094d0 con 0x7f3f280cd880 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f2ca00640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f280cd880 0x7f3f2815e390 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b410 tx=0x7f3f1000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.928+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10011830 con 0x7f3f280cd880 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.929+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f100119b0 con 0x7f3f280cd880 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.929+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10011d60 con 0x7f3f280cd880 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.929+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2815c890 con 0x7f3f280cd880 2024-01-20T11:10:34.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.929+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2813b980 con 0x7f3f280cd880 2024-01-20T11:10:34.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.930+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f28074a30 con 0x7f3f280cd880 2024-01-20T11:10:34.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.931+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3f1001a400 con 0x7f3f280cd880 2024-01-20T11:10:34.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.932+0000 7f3f25600640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f0006aed0 0x7f3f0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:34.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.932+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3f10089540 con 0x7f3f280cd880 2024-01-20T11:10:34.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.932+0000 7f3f2d400640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f0006aed0 0x7f3f0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:34.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.933+0000 7f3f2d400640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f0006aed0 0x7f3f0006d390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3f18036000 tx=0x7f3f1803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:34.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:34.937+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3f10054670 con 0x7f3f280cd880 2024-01-20T11:10:35.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.129+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3f280ad930 con 0x7f3f280cd880 2024-01-20T11:10:35.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.136+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3f100150c0 con 0x7f3f280cd880 2024-01-20T11:10:35.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.138+0000 7f3f25600640 1 -- 172.21.15.162:0/382924976 <== mon.0 v2:172.21.15.162:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3f10054670 con 0x7f3f280cd880 2024-01-20T11:10:35.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f0006aed0 msgr2=0x7f3f0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f0006aed0 0x7f3f0006d390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3f18036000 tx=0x7f3f1803c040 comp rx=0 tx=0).stop 2024-01-20T11:10:35.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f280cd880 msgr2=0x7f3f2815e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f280cd880 0x7f3f2815e390 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b410 tx=0x7f3f1000b8d0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 shutdown_connections 2024-01-20T11:10:35.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f3f0006aed0 0x7f3f0006d390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f28144a10 0x7f3f2813c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f280cd880 0x7f3f2815e390 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 --2- 172.21.15.162:0/382924976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f28071cc0 0x7f3f28139810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.139+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 >> 172.21.15.162:0/382924976 conn(0x7f3f280b0c40 msgr2=0x7f3f280ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:35.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.140+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 shutdown_connections 2024-01-20T11:10:35.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.140+0000 7f3f2e800640 1 -- 172.21.15.162:0/382924976 wait complete. 2024-01-20T11:10:35.160 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T11:10:35.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T11:10:35.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.367+0000 7f0a18a00640 1 Processor -- start 2024-01-20T11:10:35.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.368+0000 7f0a18a00640 1 -- start start 2024-01-20T11:10:35.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a18a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100d40d0 0x7f0a100d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a18a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a100ce4d0 0x7f0a100ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a18a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a100cee70 con 0x7f0a10160c60 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a18a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a100d2af0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a18a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100d1ee0 con 0x7f0a100d40d0 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a16a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a100ce4d0 0x7f0a100ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a16a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a100ce4d0 0x7f0a100ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43738/0 (socket says 172.21.15.162:43738) 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a16000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0a10160c60 0x7f0a100d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:58410/0 (socket says 172.21.15.162:58410) 2024-01-20T11:10:35.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.369+0000 7f0a16a00640 1 -- 172.21.15.162:0/3175796685 learned_addr learned my addr 172.21.15.162:0/3175796685 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:35.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.370+0000 7f0a15600640 1 --2- 172.21.15.162:0/3175796685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100d40d0 0x7f0a100d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:35.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.370+0000 7f0a16a00640 1 -- 172.21.15.162:0/3175796685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100d40d0 msgr2=0x7f0a100d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T11:10:35.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.370+0000 7f0a16a00640 1 --2- 172.21.15.162:0/3175796685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100d40d0 0x7f0a100d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.370+0000 7f0a16a00640 1 -- 172.21.15.162:0/3175796685 >> v1:172.21.15.162:6789/0 conn(0x7f0a10160c60 legacy=0x7f0a100d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.370+0000 7f0a16a00640 1 -- 172.21.15.162:0/3175796685 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100d21c0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.370+0000 7f0a14c00640 1 -- 172.21.15.162:0/3175796685 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194052992 0 0) 0x7f0a100cee70 con 0x7f0a10160c60 2024-01-20T11:10:35.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.370+0000 7f0a15600640 1 --2- 172.21.15.162:0/3175796685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100d40d0 0x7f0a100d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T11:10:35.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.371+0000 7f0a16a00640 1 --2- 172.21.15.162:0/3175796685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a100ce930 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009870 tx=0x7f0a0802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b7b0445c4d0cbd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:35.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.371+0000 7f0a14c00640 1 -- 172.21.15.162:0/3175796685 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08030840 con 0x7f0a100ce4d0 2024-01-20T11:10:35.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.371+0000 7f0a14c00640 1 -- 172.21.15.162:0/3175796685 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0a080309a0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.371+0000 7f0a14c00640 1 -- 172.21.15.162:0/3175796685 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08030d50 con 0x7f0a100ce4d0 2024-01-20T11:10:35.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 -- 172.21.15.162:0/3175796685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 msgr2=0x7f0a100ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 --2- 172.21.15.162:0/3175796685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a100ce930 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009870 tx=0x7f0a0802b980 comp rx=0 tx=0).stop 2024-01-20T11:10:35.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 -- 172.21.15.162:0/3175796685 shutdown_connections 2024-01-20T11:10:35.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 --2- 172.21.15.162:0/3175796685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100d40d0 0x7f0a100d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 --2- 172.21.15.162:0/3175796685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a100ce930 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 -- 172.21.15.162:0/3175796685 >> 172.21.15.162:0/3175796685 conn(0x7f0a1009c790 msgr2=0x7f0a100d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:35.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 -- 172.21.15.162:0/3175796685 shutdown_connections 2024-01-20T11:10:35.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.372+0000 7f0a18a00640 1 -- 172.21.15.162:0/3175796685 wait complete. 2024-01-20T11:10:35.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.374+0000 7f0a18a00640 1 Processor -- start 2024-01-20T11:10:35.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.374+0000 7f0a18a00640 1 -- start start 2024-01-20T11:10:35.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a18a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a101f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:35.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a18a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a100d40d0 0x7f0a10154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:35.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a18a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10160c60 0x7f0a100b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:35.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a18a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a101f7840 con 0x7f0a100ce4d0 2024-01-20T11:10:35.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a18a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c83e0 con 0x7f0a100d40d0 2024-01-20T11:10:35.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a18a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c86c0 con 0x7f0a10160c60 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a101f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a101f7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:43744/0 (socket says 172.21.15.162:43744) 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 -- 172.21.15.162:0/179711968 learned_addr learned my addr 172.21.15.162:0/179711968 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16a00640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10160c60 0x7f0a100b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 -- 172.21.15.162:0/179711968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10160c60 msgr2=0x7f0a100b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10160c60 0x7f0a100b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 -- 172.21.15.162:0/179711968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a100d40d0 msgr2=0x7f0a10154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a100d40d0 0x7f0a10154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.375+0000 7f0a16000640 1 -- 172.21.15.162:0/179711968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080094d0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.376+0000 7f0a16000640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a101f7300 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c7c0 tx=0x7f0a0000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:35.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.376+0000 7f0a0e000640 1 -- 172.21.15.162:0/179711968 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000a640 con 0x7f0a100ce4d0 2024-01-20T11:10:35.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.376+0000 7f0a0e000640 1 -- 172.21.15.162:0/179711968 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0a0000a7c0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.376+0000 7f0a0e000640 1 -- 172.21.15.162:0/179711968 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000ab90 con 0x7f0a100ce4d0 2024-01-20T11:10:35.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.376+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a100c89a0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.376+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a100c8f60 con 0x7f0a100ce4d0 2024-01-20T11:10:35.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.377+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a100c9180 con 0x7f0a100ce4d0 2024-01-20T11:10:35.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.378+0000 7f0a0e000640 1 -- 172.21.15.162:0/179711968 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0a0000acf0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.379+0000 7f0a0e000640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09e806aed0 0x7f09e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T11:10:35.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.379+0000 7f0a0e000640 1 -- 172.21.15.162:0/179711968 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a00088cc0 con 0x7f0a100ce4d0 2024-01-20T11:10:35.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.379+0000 7f0a15600640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09e806aed0 0x7f09e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T11:10:35.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.380+0000 7f0a15600640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09e806aed0 0x7f09e806d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f09f8006fd0 tx=0x7f09f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T11:10:35.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.385+0000 7f0a0e000640 1 -- 172.21.15.162:0/179711968 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0a0008f080 con 0x7f0a100ce4d0 2024-01-20T11:10:35.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.615+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a1004e970 con 0x7f0a100ce4d0 2024-01-20T11:10:35.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.616+0000 7f0a0e000640 1 -- 172.21.15.162:0/179711968 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f0a00018070 con 0x7f0a100ce4d0 2024-01-20T11:10:35.618 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-01-20T11:10:35.618 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3643822826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3643822826},{"type":"v1","addr":"172.21.15.162:6837","nonce":3643822826}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3084491175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3084491175},{"type":"v1","addr":"172.21.15.179:6834","nonce":3084491175}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4128595968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4128595968},{"type":"v1","addr":"172.21.15.179:6835","nonce":4128595968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3459133230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3459133230},{"type":"v1","addr":"172.21.15.162:6836","nonce":3459133230}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2024-01-20T11:10:35.619 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 25 2024-01-20T11:10:35.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09e806aed0 msgr2=0x7f09e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09e806aed0 0x7f09e806d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f09f8006fd0 tx=0x7f09f8008040 comp rx=0 tx=0).stop 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 msgr2=0x7f0a101f7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a101f7300 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c7c0 tx=0x7f0a0000cc80 comp rx=0 tx=0).stop 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 shutdown_connections 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10160c60 0x7f0a100b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:6832/1143721842,v1:172.21.15.162:6833/1143721842] conn(0x7f09e806aed0 0x7f09e806d390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a100d40d0 0x7f0a10154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 --2- 172.21.15.162:0/179711968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a100ce4d0 0x7f0a101f7300 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T11:10:35.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 >> 172.21.15.162:0/179711968 conn(0x7f0a1009c790 msgr2=0x7f0a100cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T11:10:35.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 shutdown_connections 2024-01-20T11:10:35.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-01-20T11:10:35.619+0000 7f0a18a00640 1 -- 172.21.15.162:0/179711968 wait complete. 2024-01-20T11:10:35.638 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-20T11:10:35.638 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-20T11:10:35.638 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-20T11:10:35.638 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:35.659 INFO:tasks.ceph.mds.a:Stopped 2024-01-20T11:10:35.659 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-20T11:10:35.659 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:35.719 INFO:tasks.ceph.mds.c:Stopped 2024-01-20T11:10:35.719 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-20T11:10:35.720 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:35.741 INFO:tasks.ceph.mds.b:Stopped 2024-01-20T11:10:35.742 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-20T11:10:35.742 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:35.805 INFO:tasks.ceph.mds.d:Stopped 2024-01-20T11:10:35.805 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-20T11:10:35.805 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-20T11:10:35.805 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:35.870 INFO:tasks.ceph.osd.0:Stopped 2024-01-20T11:10:35.870 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-20T11:10:35.870 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:35.937 INFO:tasks.ceph.osd.1:Stopped 2024-01-20T11:10:35.938 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-20T11:10:35.938 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.016 INFO:tasks.ceph.osd.2:Stopped 2024-01-20T11:10:36.017 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-20T11:10:36.017 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.064 INFO:tasks.ceph.osd.3:Stopped 2024-01-20T11:10:36.064 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-20T11:10:36.064 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.127 INFO:tasks.ceph.osd.4:Stopped 2024-01-20T11:10:36.127 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-20T11:10:36.127 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.211 INFO:tasks.ceph.osd.5:Stopped 2024-01-20T11:10:36.211 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-20T11:10:36.211 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.262 INFO:tasks.ceph.osd.6:Stopped 2024-01-20T11:10:36.262 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-20T11:10:36.262 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.325 INFO:tasks.ceph.osd.7:Stopped 2024-01-20T11:10:36.325 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-20T11:10:36.326 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-20T11:10:36.326 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.408 INFO:tasks.ceph.mgr.y:Stopped 2024-01-20T11:10:36.408 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-20T11:10:36.408 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.484 INFO:tasks.ceph.mgr.x:Stopped 2024-01-20T11:10:36.485 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-20T11:10:36.485 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-20T11:10:36.485 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.520 INFO:tasks.ceph.mon.a:Stopped 2024-01-20T11:10:36.520 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-20T11:10:36.520 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.560 INFO:tasks.ceph.mon.b:Stopped 2024-01-20T11:10:36.560 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-20T11:10:36.561 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T11:10:36.646 INFO:tasks.ceph.mon.c:Stopped 2024-01-20T11:10:36.646 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-20T11:10:36.647 DEBUG:teuthology.orchestra.run.smithi162:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-20T11:10:36.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:10:36.748 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-20T11:10:37.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:10:37.035 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-20T11:10:37.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:10:37.189 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-20T11:10:37.355 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:10:37.355 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-20T11:10:37.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:10:37.511 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-20T11:10:37.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:10:37.770 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-20T11:10:37.915 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:10:37.915 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-20T11:10:38.050 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:10:38.051 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-20T11:10:38.206 INFO:tasks.ceph:Archiving mon data... 2024-01-20T11:10:38.207 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/data/mon.a.tgz 2024-01-20T11:10:38.207 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-01-20T11:10:38.264 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.MuOSAuU6SI 2024-01-20T11:10:38.265 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MuOSAuU6SI 2024-01-20T11:10:38.471 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.MuOSAuU6SI 2024-01-20T11:10:38.621 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.MuOSAuU6SI is 328KB 2024-01-20T11:10:38.728 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.MuOSAuU6SI 2024-01-20T11:10:38.784 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/data/mon.b.tgz 2024-01-20T11:10:38.784 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-01-20T11:10:38.842 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.qeaYkjqeJ7 2024-01-20T11:10:38.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.qeaYkjqeJ7 2024-01-20T11:10:39.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.qeaYkjqeJ7 2024-01-20T11:10:39.200 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.qeaYkjqeJ7 is 435KB 2024-01-20T11:10:39.310 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.qeaYkjqeJ7 2024-01-20T11:10:39.368 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/data/mon.c.tgz 2024-01-20T11:10:39.368 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-01-20T11:10:39.416 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.EQ2ljQVm8O 2024-01-20T11:10:39.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.EQ2ljQVm8O 2024-01-20T11:10:39.600 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.EQ2ljQVm8O 2024-01-20T11:10:39.749 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.EQ2ljQVm8O is 435KB 2024-01-20T11:10:39.858 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.EQ2ljQVm8O 2024-01-20T11:10:39.914 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-20T11:10:39.914 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-20T11:10:39.922 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-20T11:10:40.069 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-20T11:10:40.125 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-20T11:10:40.126 INFO:tasks.ceph:Archiving crash dumps... 2024-01-20T11:10:40.127 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/remote/smithi162/crash 2024-01-20T11:10:40.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-20T11:10:40.225 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/remote/smithi179/crash 2024-01-20T11:10:40.226 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-20T11:10:40.316 INFO:tasks.ceph:Shutting down logrotate 2024-01-20T11:10:40.316 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:10:40.324 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T11:10:40.461 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-20T11:10:40.555 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-20T11:10:40.653 INFO:tasks.ceph:Compressing logs... 2024-01-20T11:10:40.653 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-20T11:10:40.661 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-20T11:10:40.749 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50842.log 2024-01-20T11:10:40.749 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45448.log 2024-01-20T11:10:40.750 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-20T11:10:40.751 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2024-01-20T11:10:40.751 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50842.log.gz 2024-01-20T11:10:40.751 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41643.log 2024-01-20T11:10:40.752 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45826.log 2024-01-20T11:10:40.752 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45448.log.gz 2024-01-20T11:10:40.753 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36534.log 2024-01-20T11:10:40.753 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2024-01-20T11:10:40.754 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2024-01-20T11:10:40.755 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.41643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41643.log.gz 2024-01-20T11:10:40.755 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36334.log 2024-01-20T11:10:40.755 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45826.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45826.log.gz /var/log/ceph/ceph-client.admin.52215.log 2024-01-20T11:10:40.756 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-01-20T11:10:40.756 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52993.log 2024-01-20T11:10:40.757 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2024-01-20T11:10:40.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52215.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52215.log.gz 2024-01-20T11:10:40.757 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46972.log 2024-01-20T11:10:40.758 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36534.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36534.log.gz 2024-01-20T11:10:40.758 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42065.log 2024-01-20T11:10:40.758 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36334.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-20T11:10:40.758 INFO:teuthology.orchestra.run.smithi179.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36334.log.gz 2024-01-20T11:10:40.759 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.42065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42065.log.gz 2024-01-20T11:10:40.759 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-20T11:10:40.760 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-20T11:10:40.761 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41114.log 2024-01-20T11:10:40.761 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52993.log.gz 2024-01-20T11:10:40.761 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46972.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-20T11:10:40.761 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46972.log.gz 2024-01-20T11:10:40.761 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52130.log 2024-01-20T11:10:40.761 INFO:teuthology.orchestra.run.smithi162.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41114.log.gz 2024-01-20T11:10:40.762 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2024-01-20T11:10:40.763 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52825.log 2024-01-20T11:10:40.763 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41662.log 2024-01-20T11:10:40.763 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-20T11:10:40.763 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36374.log 2024-01-20T11:10:40.764 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.41662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41662.log.gz 2024-01-20T11:10:40.765 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-20T11:10:40.765 INFO:teuthology.orchestra.run.smithi162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52130.log.gz 2024-01-20T11:10:40.766 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2024-01-20T11:10:40.766 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2024-01-20T11:10:40.767 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42668.log 2024-01-20T11:10:40.767 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52825.log.gz 2024-01-20T11:10:40.769 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36374.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-20T11:10:40.769 INFO:teuthology.orchestra.run.smithi179.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36374.log.gz 2024-01-20T11:10:40.769 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-01-20T11:10:40.769 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36294.log 2024-01-20T11:10:40.770 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48948.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2024-01-20T11:10:40.770 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47616.log 2024-01-20T11:10:40.770 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2024-01-20T11:10:40.770 INFO:teuthology.orchestra.run.smithi162.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42668.log.gz 2024-01-20T11:10:40.770 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2024-01-20T11:10:40.771 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47616.log.gz 2024-01-20T11:10:40.772 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-20T11:10:40.772 INFO:teuthology.orchestra.run.smithi179.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-01-20T11:10:40.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50992.log 2024-01-20T11:10:40.773 INFO:teuthology.orchestra.run.smithi162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2024-01-20T11:10:40.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42710.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2024-01-20T11:10:40.773 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46558.log 2024-01-20T11:10:40.773 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50716.log 2024-01-20T11:10:40.773 INFO:teuthology.orchestra.run.smithi162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50992.log.gz 2024-01-20T11:10:40.774 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-01-20T11:10:40.775 INFO:teuthology.orchestra.run.smithi179.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36294.log.gz 2024-01-20T11:10:40.775 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41406.log 2024-01-20T11:10:40.776 INFO:teuthology.orchestra.run.smithi162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46558.log.gz 2024-01-20T11:10:40.776 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48591.log 2024-01-20T11:10:40.776 INFO:teuthology.orchestra.run.smithi162.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50716.log.gz 2024-01-20T11:10:40.777 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41406.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.41406.log.gz /var/log/ceph/ceph-client.admin.41410.log 2024-01-20T11:10:40.777 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-01-20T11:10:40.778 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.36494.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-01-20T11:10:40.778 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36414.log 2024-01-20T11:10:40.778 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36454.log 2024-01-20T11:10:40.779 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51430.log 2024-01-20T11:10:40.779 INFO:teuthology.orchestra.run.smithi162.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48591.log.gz 2024-01-20T11:10:40.779 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2024-01-20T11:10:40.780 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41410.log.gz 2024-01-20T11:10:40.781 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-01-20T11:10:40.781 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51430.log.gz 2024-01-20T11:10:40.781 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36414.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36414.log.gz 2024-01-20T11:10:40.782 INFO:teuthology.orchestra.run.smithi179.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-20T11:10:40.782 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-20T11:10:40.782 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36454.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36454.log.gz 2024-01-20T11:10:40.782 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-20T11:10:40.783 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42061.log 2024-01-20T11:10:40.784 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41414.log 2024-01-20T11:10:40.784 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2024-01-20T11:10:40.784 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50884.log 2024-01-20T11:10:40.784 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-01-20T11:10:40.784 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44713.log 88.0% 2024-01-20T11:10:40.784 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41414.log.gz 2024-01-20T11:10:40.786 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51260.log 2024-01-20T11:10:40.787 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50884.log.gz 2024-01-20T11:10:40.787 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44713.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44713.log.gz 2024-01-20T11:10:40.787 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2024-01-20T11:10:40.787 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-20T11:10:40.788 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-20T11:10:40.788 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.42061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42061.log.gz 2024-01-20T11:10:40.788 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-20T11:10:40.789 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42836.log 2024-01-20T11:10:40.789 INFO:teuthology.orchestra.run.smithi162.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51260.log.gz 2024-01-20T11:10:40.790 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-01-20T11:10:40.790 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2024-01-20T11:10:40.790 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42836.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42836.log.gz 2024-01-20T11:10:40.792 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43400.log 2024-01-20T11:10:40.793 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42085.log 2024-01-20T11:10:40.793 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-01-20T11:10:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.0.43400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43400.log.gz 2024-01-20T11:10:40.794 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42878.log 2024-01-20T11:10:40.796 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51902.log 2024-01-20T11:10:40.796 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42085.log.gz 2024-01-20T11:10:40.797 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42878.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42878.log.gz 2024-01-20T11:10:40.797 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2024-01-20T11:10:40.798 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51902.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51902.log.gz 2024-01-20T11:10:40.798 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52531.log 2024-01-20T11:10:40.799 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41749.log 2024-01-20T11:10:40.799 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2024-01-20T11:10:40.800 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52531.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52531.log.gz 2024-01-20T11:10:40.801 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42500.log 2024-01-20T11:10:40.802 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53329.log 2024-01-20T11:10:40.802 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41749.log.gz 2024-01-20T11:10:40.802 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49940.log 2024-01-20T11:10:40.803 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42500.log.gz 2024-01-20T11:10:40.804 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43848.log 2024-01-20T11:10:40.804 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53329.log.gz 2024-01-20T11:10:40.805 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49940.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49940.log.gz 2024-01-20T11:10:40.805 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2024-01-20T11:10:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.2.43848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43848.log.gz 2024-01-20T11:10:40.806 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41156.log 2024-01-20T11:10:40.807 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-01-20T11:10:40.808 INFO:teuthology.orchestra.run.smithi162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2024-01-20T11:10:40.809 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2024-01-20T11:10:40.809 INFO:teuthology.orchestra.run.smithi162.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41156.log.gz 2024-01-20T11:10:40.810 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42794.log 2024-01-20T11:10:40.810 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-01-20T11:10:40.811 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44965.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2024-01-20T11:10:40.811 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41240.log 2024-01-20T11:10:40.812 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51818.log 2024-01-20T11:10:40.813 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42794.log.gz 2024-01-20T11:10:40.813 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50021.log 2024-01-20T11:10:40.814 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41240.log.gz 2024-01-20T11:10:40.815 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2024-01-20T11:10:40.815 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51818.log.gz 2024-01-20T11:10:40.816 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52341.log 2024-01-20T11:10:40.816 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50021.log.gz 2024-01-20T11:10:40.817 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51734.log 2024-01-20T11:10:40.817 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2024-01-20T11:10:40.818 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40862.log 2024-01-20T11:10:40.819 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52341.log.gz 2024-01-20T11:10:40.820 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51734.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51734.log.gz 2024-01-20T11:10:40.820 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45160.log 2024-01-20T11:10:40.821 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47448.log 2024-01-20T11:10:40.821 INFO:teuthology.orchestra.run.smithi162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40862.log.gz 2024-01-20T11:10:40.822 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46474.log 2024-01-20T11:10:40.822 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45160.log.gz 2024-01-20T11:10:40.823 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2024-01-20T11:10:40.824 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47448.log.gz 2024-01-20T11:10:40.825 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46474.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46474.log.gz 2024-01-20T11:10:40.825 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2024-01-20T11:10:40.826 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2024-01-20T11:10:40.826 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2024-01-20T11:10:40.827 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43852.log 2024-01-20T11:10:40.827 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2024-01-20T11:10:40.828 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 2024-01-20T11:10:40.828 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2024-01-20T11:10:40.829 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.2.43852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43852.log.gz 2024-01-20T11:10:40.830 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40536.log 2024-01-20T11:10:40.831 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44083.log 2024-01-20T11:10:40.831 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2024-01-20T11:10:40.832 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43419.log 2024-01-20T11:10:40.832 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40536.log.gz 2024-01-20T11:10:40.833 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52783.log 2024-01-20T11:10:40.833 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44083.log.gz 2024-01-20T11:10:40.834 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.0.43419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43419.log.gz 2024-01-20T11:10:40.834 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40734.log 2024-01-20T11:10:40.835 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50464.log 2024-01-20T11:10:40.836 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz 2024-01-20T11:10:40.836 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44503.log 2024-01-20T11:10:40.837 INFO:teuthology.orchestra.run.smithi162.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40734.log.gz 2024-01-20T11:10:40.838 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52741.log 2024-01-20T11:10:40.838 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50464.log.gz 2024-01-20T11:10:40.839 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52867.log 2024-01-20T11:10:40.839 INFO:teuthology.orchestra.run.smithi162.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44503.log.gz 2024-01-20T11:10:40.840 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50362.log 2024-01-20T11:10:40.840 INFO:teuthology.orchestra.run.smithi162.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52741.log.gz 2024-01-20T11:10:40.841 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40820.log 2024-01-20T11:10:40.841 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52867.log.gz 2024-01-20T11:10:40.842 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-20T11:10:40.843 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51388.log 2024-01-20T11:10:40.843 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50362.log.gz 2024-01-20T11:10:40.844 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40820.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40820.log.gz 2024-01-20T11:10:40.844 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47995.log 2024-01-20T11:10:40.845 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49032.log 2024-01-20T11:10:40.845 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51388.log.gz 2024-01-20T11:10:40.846 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.0.47995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47995.log.gz 2024-01-20T11:10:40.846 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51472.log 2024-01-20T11:10:40.847 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47182.log 2024-01-20T11:10:40.848 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49032.log.gz 2024-01-20T11:10:40.849 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40904.log 2024-01-20T11:10:40.849 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51472.log.gz 2024-01-20T11:10:40.850 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50674.log 2024-01-20T11:10:40.850 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2024-01-20T11:10:40.851 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46888.log 2024-01-20T11:10:40.851 INFO:teuthology.orchestra.run.smithi162.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40904.log.gz 2024-01-20T11:10:40.852 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2024-01-20T11:10:40.852 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50674.log.gz 2024-01-20T11:10:40.853 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46888.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46888.log.gz 2024-01-20T11:10:40.854 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52088.log 2024-01-20T11:10:40.854 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51556.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-20T11:10:40.855 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2024-01-20T11:10:40.856 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42092.log 2024-01-20T11:10:40.856 INFO:teuthology.orchestra.run.smithi162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52088.log.gz 2024-01-20T11:10:40.857 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48288.log 2024-01-20T11:10:40.858 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42092.log.gz 2024-01-20T11:10:40.858 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49555.log 2024-01-20T11:10:40.859 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-20T11:10:40.859 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48288.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48288.log.gz 2024-01-20T11:10:40.860 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50234.log 2024-01-20T11:10:40.860 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48492.log 2024-01-20T11:10:40.861 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49555.log.gz 2024-01-20T11:10:40.862 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44335.log 2024-01-20T11:10:40.862 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50234.log.gz 2024-01-20T11:10:40.863 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47490.log 2024-01-20T11:10:40.863 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48492.log.gz 2024-01-20T11:10:40.864 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46246.log 2024-01-20T11:10:40.864 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44335.log.gz 2024-01-20T11:10:40.865 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44587.log 2024-01-20T11:10:40.866 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47490.log.gz 2024-01-20T11:10:40.866 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49513.log 2024-01-20T11:10:40.867 INFO:teuthology.orchestra.run.smithi162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46246.log.gz 2024-01-20T11:10:40.868 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52257.log 2024-01-20T11:10:40.868 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44587.log.gz 2024-01-20T11:10:40.869 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2024-01-20T11:10:40.869 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49513.log.gz 2024-01-20T11:10:40.870 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49639.log 2024-01-20T11:10:40.870 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52257.log.gz 2024-01-20T11:10:40.871 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-01-20T11:10:40.871 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2024-01-20T11:10:40.873 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49639.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49639.log.gz -5 2024-01-20T11:10:40.873 INFO:teuthology.orchestra.run.smithi162.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40946.log 2024-01-20T11:10:40.874 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36173.log 2024-01-20T11:10:40.874 INFO:teuthology.orchestra.run.smithi162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-01-20T11:10:40.875 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44839.log 2024-01-20T11:10:40.875 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40946.log.gz 2024-01-20T11:10:40.876 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49116.log 2024-01-20T11:10:40.876 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36173.log.gz 2024-01-20T11:10:40.877 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44839.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44839.log.gz 2024-01-20T11:10:40.878 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42920.log 2024-01-20T11:10:40.878 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46930.log 2024-01-20T11:10:40.879 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49116.log.gz 2024-01-20T11:10:40.880 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49471.log 2024-01-20T11:10:40.880 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2024-01-20T11:10:40.881 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2024-01-20T11:10:40.881 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46930.log.gz 2024-01-20T11:10:40.882 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49471.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49471.log.gz 2024-01-20T11:10:40.882 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47808.log 2024-01-20T11:10:40.883 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48226.log 2024-01-20T11:10:40.884 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2024-01-20T11:10:40.885 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50063.log 2024-01-20T11:10:40.885 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47808.log.gz 2024-01-20T11:10:40.886 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2024-01-20T11:10:40.886 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48226.log.gz 2024-01-20T11:10:40.887 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50063.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50063.log.gz 2024-01-20T11:10:40.887 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35919.log 2024-01-20T11:10:40.888 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44125.log 2024-01-20T11:10:40.888 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz 2024-01-20T11:10:40.889 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.35919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48153.log 2024-01-20T11:10:40.890 INFO:teuthology.orchestra.run.smithi162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35919.log.gz 2024-01-20T11:10:40.891 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49242.log 2024-01-20T11:10:40.891 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2024-01-20T11:10:40.892 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45202.log 2024-01-20T11:10:40.892 INFO:teuthology.orchestra.run.smithi162.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48153.log.gz 2024-01-20T11:10:40.893 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53161.log 2024-01-20T11:10:40.893 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49242.log.gz 2024-01-20T11:10:40.894 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42091.log 2024-01-20T11:10:40.894 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45202.log.gz 2024-01-20T11:10:40.895 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44881.log 2024-01-20T11:10:40.896 INFO:teuthology.orchestra.run.smithi162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53161.log.gz 2024-01-20T11:10:40.897 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42091.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42091.log.gz 2024-01-20T11:10:40.897 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41030.log 2024-01-20T11:10:40.898 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41419.log 2024-01-20T11:10:40.898 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44881.log.gz 2024-01-20T11:10:40.899 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44419.log 2024-01-20T11:10:40.899 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41030.log.gz 2024-01-20T11:10:40.901 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41419.log.gz 2024-01-20T11:10:40.901 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-20T11:10:40.902 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-20T11:10:40.902 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44419.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44419.log.gz /var/log/ceph/ceph-client.admin.40482.log 2024-01-20T11:10:40.902 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-01-20T11:10:40.903 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-01-20T11:10:40.904 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49860.log 2024-01-20T11:10:40.904 INFO:teuthology.orchestra.run.smithi162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40482.log.gz 2024-01-20T11:10:40.905 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49597.log 2024-01-20T11:10:40.906 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-01-20T11:10:40.907 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49860.log: gzip -5 89.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.49860.log.gz -- 2024-01-20T11:10:40.907 INFO:teuthology.orchestra.run.smithi162.stderr: /var/log/ceph/ceph-client.admin.44041.log 2024-01-20T11:10:40.908 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41422.log 2024-01-20T11:10:40.908 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49597.log.gz 2024-01-20T11:10:40.909 INFO:teuthology.orchestra.run.smithi179.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-20T11:10:40.910 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44041.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44041.log.gz 2024-01-20T11:10:40.910 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49326.log 2024-01-20T11:10:40.911 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52951.log 2024-01-20T11:10:40.911 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41422.log.gz 2024-01-20T11:10:40.913 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49326.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49326.log.gz 2024-01-20T11:10:40.913 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50278.log 2024-01-20T11:10:40.914 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41072.log 2024-01-20T11:10:40.914 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52951.log.gz 2024-01-20T11:10:40.915 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50278.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50278.log.gz 2024-01-20T11:10:40.916 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2024-01-20T11:10:40.917 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47226.log 2024-01-20T11:10:40.917 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41072.log.gz 2024-01-20T11:10:40.918 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41757.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-01-20T11:10:40.918 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47742.log 2024-01-20T11:10:40.919 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41753.log 2024-01-20T11:10:40.920 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47226.log.gz 2024-01-20T11:10:40.921 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46330.log 2024-01-20T11:10:40.924 INFO:teuthology.orchestra.run.smithi162.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47742.log.gz 2024-01-20T11:10:40.924 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44671.log 2024-01-20T11:10:40.924 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41753.log.gz 2024-01-20T11:10:40.924 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46330.log.gz 2024-01-20T11:10:40.925 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46432.log 2024-01-20T11:10:40.925 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2024-01-20T11:10:40.925 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44671.log.gz 2024-01-20T11:10:40.927 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46432.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.46432.log.gz 2024-01-20T11:10:40.927 INFO:teuthology.orchestra.run.smithi162.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2024-01-20T11:10:40.928 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2024-01-20T11:10:40.928 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2024-01-20T11:10:40.929 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51514.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz /var/log/ceph/ceph-client.admin.52172.log 2024-01-20T11:10:40.930 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-01-20T11:10:40.931 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2024-01-20T11:10:40.931 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47014.log 2024-01-20T11:10:40.932 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42090.log 2024-01-20T11:10:40.932 INFO:teuthology.orchestra.run.smithi162.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52172.log.gz 2024-01-20T11:10:40.933 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47014.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2024-01-20T11:10:40.933 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-01-20T11:10:40.934 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53371.log 2024-01-20T11:10:40.934 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42090.log.gz 2024-01-20T11:10:40.935 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45952.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-01-20T11:10:40.935 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48812.log 2024-01-20T11:10:40.936 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41755.log 2024-01-20T11:10:40.936 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53371.log.gz 2024-01-20T11:10:40.938 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48812.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48812.log.gz 2024-01-20T11:10:40.938 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43981.log 2024-01-20T11:10:40.939 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44797.log 2024-01-20T11:10:40.939 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41755.log.gz 2024-01-20T11:10:40.940 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.43981.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43981.log.gz 2024-01-20T11:10:40.940 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51183.log 2024-01-20T11:10:40.941 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45706.log 2024-01-20T11:10:40.941 INFO:teuthology.orchestra.run.smithi162.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44797.log.gz 2024-01-20T11:10:40.942 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.0.51183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51183.log.gz 2024-01-20T11:10:40.942 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40593.log 2024-01-20T11:10:40.943 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47270.log 2024-01-20T11:10:40.943 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45706.log.gz 2024-01-20T11:10:40.944 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40593.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40593.log.gz 2024-01-20T11:10:40.944 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 2024-01-20T11:10:40.945 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47270.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-20T11:10:40.946 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47270.log.gz 2024-01-20T11:10:40.947 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50800.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz 2024-01-20T11:10:40.947 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40682.log 2024-01-20T11:10:40.948 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45076.log 2024-01-20T11:10:40.949 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40682.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40682.log.gz 2024-01-20T11:10:40.949 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49723.log 2024-01-20T11:10:40.950 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50506.log 2024-01-20T11:10:40.951 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45076.log: /var/log/ceph/ceph-client.admin.49723.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45076.log.gz 2024-01-20T11:10:40.952 INFO:teuthology.orchestra.run.smithi162.stderr:gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49723.log.gz -- 2024-01-20T11:10:40.952 INFO:teuthology.orchestra.run.smithi162.stderr: /var/log/ceph/ceph-client.admin.44461.log 2024-01-20T11:10:40.953 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50506.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50506.log.gz 2024-01-20T11:10:40.953 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50590.log 2024-01-20T11:10:40.954 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52657.log 2024-01-20T11:10:40.955 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44461.log: /var/log/ceph/ceph-client.admin.50590.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2024-01-20T11:10:40.956 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50590.log.gz 2024-01-20T11:10:40.956 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53245.log 2024-01-20T11:10:40.957 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52657.log.gz 2024-01-20T11:10:40.957 INFO:teuthology.orchestra.run.smithi179.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-20T11:10:40.958 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47574.log 2024-01-20T11:10:40.958 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50548.log 2024-01-20T11:10:40.959 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53245.log: /var/log/ceph/ceph-client.admin.47574.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53245.log.gz 2024-01-20T11:10:40.960 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47574.log.gz 2024-01-20T11:10:40.960 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45622.log 2024-01-20T11:10:40.961 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50548.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50548.log.gz 2024-01-20T11:10:40.961 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46804.log 2024-01-20T11:10:40.962 INFO:teuthology.orchestra.run.smithi162.stderr:gzip/var/log/ceph/ceph-client.admin.45622.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47362.log 2024-01-20T11:10:40.963 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46804.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45622.log.gz 2024-01-20T11:10:40.964 INFO:teuthology.orchestra.run.smithi162.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46804.log.gz 2024-01-20T11:10:40.964 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49681.log 2024-01-20T11:10:40.965 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47362.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47362.log.gz 2024-01-20T11:10:40.965 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-01-20T11:10:40.966 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49200.log 2024-01-20T11:10:40.967 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44629.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49681.log.gz 2024-01-20T11:10:40.968 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-01-20T11:10:40.968 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40408.log 2024-01-20T11:10:40.969 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49200.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49200.log.gz 2024-01-20T11:10:40.969 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41758.log 2024-01-20T11:10:40.970 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46036.log 2024-01-20T11:10:40.971 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41758.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40408.log.gz 2024-01-20T11:10:40.971 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.46204.log 2024-01-20T11:10:40.972 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41758.log.gz 2024-01-20T11:10:40.973 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46036.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46036.log.gz 2024-01-20T11:10:40.973 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46516.log 2024-01-20T11:10:40.974 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-01-20T11:10:40.975 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46516.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46204.log.gz 2024-01-20T11:10:40.975 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49368.log 2024-01-20T11:10:40.976 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46516.log.gz 2024-01-20T11:10:40.977 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42290.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-01-20T11:10:40.977 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49158.log 2024-01-20T11:10:40.978 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40988.log 2024-01-20T11:10:40.978 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49368.log.gz 2024-01-20T11:10:40.979 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45322.log 2024-01-20T11:10:40.979 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49158.log.gz 2024-01-20T11:10:40.981 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52699.log 2024-01-20T11:10:40.981 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40988.log.gz 2024-01-20T11:10:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45322.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45322.log.gz 2024-01-20T11:10:40.982 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47999.log 2024-01-20T11:10:40.983 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50320.log 2024-01-20T11:10:40.984 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52699.log.gz 2024-01-20T11:10:40.984 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.0.47999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47999.log.gz 2024-01-20T11:10:40.984 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-01-20T11:10:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50320.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50320.log.gz 2024-01-20T11:10:40.986 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52573.log 2024-01-20T11:10:40.987 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53035.log 2024-01-20T11:10:40.987 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-01-20T11:10:40.988 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52573.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52573.log.gz 2024-01-20T11:10:40.989 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50926.log 2024-01-20T11:10:40.989 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51860.log 2024-01-20T11:10:40.990 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53035.log.gz 2024-01-20T11:10:40.991 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2024-01-20T11:10:40.991 INFO:teuthology.orchestra.run.smithi162.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2024-01-20T11:10:40.992 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48368.log 2024-01-20T11:10:40.992 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51860.log.gz 2024-01-20T11:10:40.993 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53445.log 2024-01-20T11:10:40.994 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2024-01-20T11:10:40.995 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48368.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.48368.log.gz --verbose 2024-01-20T11:10:40.995 INFO:teuthology.orchestra.run.smithi162.stderr: -- /var/log/ceph/ceph-client.admin.46162.log 2024-01-20T11:10:40.995 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53445.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53445.log.gz 2024-01-20T11:10:40.996 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-20T11:10:40.997 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41750.log 2024-01-20T11:10:40.997 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46162.log.gz 2024-01-20T11:10:40.998 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-01-20T11:10:41.000 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51179.log 2024-01-20T11:10:41.000 INFO:teuthology.orchestra.run.smithi162.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41750.log.gz 2024-01-20T11:10:41.001 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50148.log 2024-01-20T11:10:41.001 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-01-20T11:10:41.002 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.0.51179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51179.log.gz 2024-01-20T11:10:41.002 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46390.log 2024-01-20T11:10:41.004 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-01-20T11:10:41.004 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50148.log.gz 2024-01-20T11:10:41.005 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46600.log 2024-01-20T11:10:41.005 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46390.log.gz 2024-01-20T11:10:41.007 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45244.log 2024-01-20T11:10:41.007 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-01-20T11:10:41.008 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52909.log 2024-01-20T11:10:41.008 INFO:teuthology.orchestra.run.smithi162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46600.log.gz 2024-01-20T11:10:41.009 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49074.log 2024-01-20T11:10:41.010 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45244.log.gz 2024-01-20T11:10:41.011 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45580.log 2024-01-20T11:10:41.011 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52909.log.gz 2024-01-20T11:10:41.012 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2024-01-20T11:10:41.012 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49074.log.gz 2024-01-20T11:10:41.014 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2024-01-20T11:10:41.014 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45580.log.gz 2024-01-20T11:10:41.015 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40778.log 2024-01-20T11:10:41.015 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2024-01-20T11:10:41.016 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2024-01-20T11:10:41.016 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2024-01-20T11:10:41.018 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47700.log 2024-01-20T11:10:41.018 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40778.log.gz 2024-01-20T11:10:41.019 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44545.log 2024-01-20T11:10:41.019 INFO:teuthology.orchestra.run.smithi162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2024-01-20T11:10:41.020 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47098.log 2024-01-20T11:10:41.021 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47700.log.gz 2024-01-20T11:10:41.022 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45364.log 2024-01-20T11:10:41.022 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44545.log.gz 2024-01-20T11:10:41.023 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2024-01-20T11:10:41.023 INFO:teuthology.orchestra.run.smithi162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47098.log.gz 2024-01-20T11:10:41.024 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50420.log 2024-01-20T11:10:41.024 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45364.log.gz 2024-01-20T11:10:41.026 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2024-01-20T11:10:41.026 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2024-01-20T11:10:41.027 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47320.log 2024-01-20T11:10:41.028 INFO:teuthology.orchestra.run.smithi162.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50420.log.gz 2024-01-20T11:10:41.028 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-20T11:10:41.029 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47658.log 2024-01-20T11:10:41.029 INFO:teuthology.orchestra.run.smithi162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2024-01-20T11:10:41.030 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41411.log 2024-01-20T11:10:41.030 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47320.log.gz 2024-01-20T11:10:41.031 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47658.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-20T11:10:41.032 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47658.log.gz 2024-01-20T11:10:41.032 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41411.log: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-20T11:10:41.032 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44167.log 2024-01-20T11:10:41.033 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41411.log.gz 2024-01-20T11:10:41.033 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2024-01-20T11:10:41.035 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44167.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44167.log.gz 2024-01-20T11:10:41.035 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53077.log 2024-01-20T11:10:41.036 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52044.log 2024-01-20T11:10:41.036 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2024-01-20T11:10:41.037 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53077.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53077.log.gz 2024-01-20T11:10:41.038 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2024-01-20T11:10:41.038 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51986.log 2024-01-20T11:10:41.039 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52044.log.gz 2024-01-20T11:10:41.040 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48728.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.43548.log 2024-01-20T11:10:41.041 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2024-01-20T11:10:41.042 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51986.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51986.log.gz 2024-01-20T11:10:41.042 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41416.log 2024-01-20T11:10:41.043 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.43548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49284.log 2024-01-20T11:10:41.043 INFO:teuthology.orchestra.run.smithi162.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43548.log.gz 2024-01-20T11:10:41.044 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41416.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41416.log.gz 2024-01-20T11:10:41.046 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.49284.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49284.log.gz 2024-01-20T11:10:41.047 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45664.log 2024-01-20T11:10:41.047 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-20T11:10:41.049 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2024-01-20T11:10:41.049 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45664.log.gz 2024-01-20T11:10:41.050 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-20T11:10:41.050 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-01-20T11:10:41.051 INFO:teuthology.orchestra.run.smithi162.stderr:gzip/var/log/ceph/ceph-client.admin.48686.log: -5 --verbose 85.0% -- -- replaced with /var/log/ceph/ceph.log.gz /var/log/ceph/ceph-client.admin.51692.log 2024-01-20T11:10:41.052 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-01-20T11:10:41.052 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44209.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2024-01-20T11:10:41.052 INFO:teuthology.orchestra.run.smithi162.stderr:gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz --verbose 2024-01-20T11:10:41.053 INFO:teuthology.orchestra.run.smithi162.stderr: -- /var/log/ceph/ceph-osd.2.log 2024-01-20T11:10:41.054 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.51692.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-20T11:10:41.054 INFO:teuthology.orchestra.run.smithi162.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51692.log.gz 2024-01-20T11:10:41.055 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50190.log 2024-01-20T11:10:41.056 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53203.log 2024-01-20T11:10:41.058 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.50190.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50190.log.gz 2024-01-20T11:10:41.059 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53203.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53203.log.gz 2024-01-20T11:10:41.059 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44755.log 2024-01-20T11:10:41.061 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2024-01-20T11:10:41.062 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44755.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44755.log.gz 2024-01-20T11:10:41.064 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46846.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2024-01-20T11:10:41.065 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44377.log 2024-01-20T11:10:41.066 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36303.log 2024-01-20T11:10:41.068 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.44377.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44377.log.gz 2024-01-20T11:10:41.070 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36303.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36303.log.gz 2024-01-20T11:10:41.070 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40640.log 2024-01-20T11:10:41.072 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43058.log 2024-01-20T11:10:41.073 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40640.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40640.log.gz 2024-01-20T11:10:41.075 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.43058.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43058.log.gz 2024-01-20T11:10:41.075 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2024-01-20T11:10:41.077 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48854.log 2024-01-20T11:10:41.078 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46288.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2024-01-20T11:10:41.080 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48854.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48854.log.gz 2024-01-20T11:10:41.080 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42542.log 2024-01-20T11:10:41.082 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2024-01-20T11:10:41.084 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42542.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2024-01-20T11:10:41.086 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53485.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2024-01-20T11:10:41.086 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45490.log 2024-01-20T11:10:41.088 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29848.log 2024-01-20T11:10:41.089 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45490.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45490.log.gz 2024-01-20T11:10:41.090 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.tmp-client.admin.29848.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29848.log.gz 2024-01-20T11:10:41.091 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41198.log 2024-01-20T11:10:41.093 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53287.log 2024-01-20T11:10:41.093 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-20T11:10:41.094 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41198.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41198.log.gz 2024-01-20T11:10:41.096 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53287.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53287.log.gz 2024-01-20T11:10:41.096 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-20T11:10:41.097 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2024-01-20T11:10:41.098 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48093.log 2024-01-20T11:10:41.100 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.45406.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2024-01-20T11:10:41.101 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48093.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48093.log.gz 2024-01-20T11:10:41.102 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42752.log 2024-01-20T11:10:41.103 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53119.log 2024-01-20T11:10:41.105 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42752.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42752.log.gz 2024-01-20T11:10:41.106 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.53119.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53119.log.gz 2024-01-20T11:10:41.107 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46078.log 2024-01-20T11:10:41.109 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52615.log 2024-01-20T11:10:41.110 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.46078.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46078.log.gz 2024-01-20T11:10:41.112 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.52615.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52615.log.gz 2024-01-20T11:10:41.112 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42584.log 2024-01-20T11:10:41.114 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40327.log 2024-01-20T11:10:41.115 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42584.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42584.log.gz 2024-01-20T11:10:41.117 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40327.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40327.log.gz 2024-01-20T11:10:41.117 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48990.log 2024-01-20T11:10:41.119 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41421.log 2024-01-20T11:10:41.121 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48990.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48990.log.gz 2024-01-20T11:10:41.122 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41421.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41421.log.gz 2024-01-20T11:10:41.122 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47406.log 2024-01-20T11:10:41.124 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-20T11:10:41.126 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.47406.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47406.log.gz 2024-01-20T11:10:41.131 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42094.log 2024-01-20T11:10:41.133 INFO:teuthology.orchestra.run.smithi162.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-20T11:10:41.133 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2024-01-20T11:10:41.133 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42094.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42094.log.gz 2024-01-20T11:10:41.133 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42053.log 2024-01-20T11:10:41.134 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41741.log 2024-01-20T11:10:41.135 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.42053.log: /var/log/ceph/ceph-client.admin.47056.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42053.log.gz 2024-01-20T11:10:41.135 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2024-01-20T11:10:41.136 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2024-01-20T11:10:41.137 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.41741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40231.log 2024-01-20T11:10:41.139 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.48535.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41741.log.gz 2024-01-20T11:10:41.139 INFO:teuthology.orchestra.run.smithi162.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2024-01-20T11:10:41.141 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.40231.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.40231.log.gz 2024-01-20T11:10:41.146 INFO:teuthology.orchestra.run.smithi179.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-20T11:10:41.151 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-01-20T11:10:41.151 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m0.439s 2024-01-20T11:10:41.152 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m1.687s 2024-01-20T11:10:41.152 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.282s 2024-01-20T11:10:41.300 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-20T11:10:41.312 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-20T11:10:41.352 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-20T11:10:41.365 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-20T11:10:43.085 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-20T11:10:43.089 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-01-20T11:10:43.089 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m2.382s 2024-01-20T11:10:43.089 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m3.577s 2024-01-20T11:10:43.090 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m1.093s 2024-01-20T11:10:43.091 INFO:tasks.ceph:Archiving logs... 2024-01-20T11:10:43.091 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/remote/smithi162/log 2024-01-20T11:10:43.092 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-20T11:10:43.858 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/remote/smithi179/log 2024-01-20T11:10:43.863 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-20T11:10:44.173 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-20T11:10:44.184 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-20T11:10:44.185 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-20T11:10:44.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-20T11:10:44.345 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-20T11:10:44.355 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-20T11:10:44.355 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T11:10:44.363 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T11:10:44.411 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-01-20T11:10:44.418 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-01-20T11:10:44.419 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T11:10:44.419 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-01-20T11:10:44.419 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +268us[ +268us] +/- 87ms 2024-01-20T11:10:44.419 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -937us[ -937us] +/- 55ms 2024-01-20T11:10:44.419 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +1115us[+1115us] +/- 75ms 2024-01-20T11:10:44.420 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:10:44.427 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T11:10:44.427 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-01-20T11:10:44.427 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 +259us[ +269us] +/- 87ms 2024-01-20T11:10:44.427 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 -937us[ -926us] +/- 55ms 2024-01-20T11:10:44.428 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +1109us[+1119us] +/- 75ms 2024-01-20T11:10:44.428 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T11:10:44.429 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-20T11:10:44.439 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-20T11:10:44.439 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-20T11:10:44.449 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-20T11:10:44.666 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-20T11:10:44.880 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T11:10:44.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:10:44.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T11:10:45.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:10:45.081 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-20T11:10:45.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-20T11:10:45.111 INFO:teuthology.task.internal:Duration was 878.310721 seconds 2024-01-20T11:10:45.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-20T11:10:45.124 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-20T11:10:45.124 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-20T11:10:45.133 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-20T11:10:45.288 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T11:10:45.291 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T11:10:45.636 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-20T11:10:45.636 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-01-20T11:10:45.636 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-20T11:10:45.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-01-20T11:10:45.709 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-20T11:10:45.780 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-20T11:10:45.781 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-20T11:10:45.789 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-20T11:10:45.876 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-20T11:10:45.876 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-20T11:10:45.882 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-20T11:10:46.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-20T11:10:46.071 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-20T11:10:46.071 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-20T11:10:46.160 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-20T11:10:46.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-20T11:10:46.260 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-20T11:10:46.268 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-20T11:10:46.371 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-01-20T11:10:46.375 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-01-20T11:10:46.427 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-20T11:10:46.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:10:46.473 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-20T11:10:46.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T11:10:46.528 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-20T11:10:46.538 INFO:teuthology.task.internal:Transferring archived files... 2024-01-20T11:10:46.539 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/remote/smithi162 2024-01-20T11:10:46.539 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-20T11:10:46.646 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617/remote/smithi179 2024-01-20T11:10:46.646 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-20T11:10:46.754 INFO:teuthology.task.internal:Removing archive directory... 2024-01-20T11:10:46.754 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-20T11:10:46.762 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-20T11:10:46.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-20T11:10:46.829 INFO:teuthology.task.internal:Not uploading archives. 2024-01-20T11:10:46.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-20T11:10:46.848 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-20T11:10:46.848 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-20T11:10:46.856 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-20T11:10:46.904 INFO:teuthology.orchestra.run.smithi162.stdout: 394039 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 20 11:10 /home/ubuntu/cephtest 2024-01-20T11:10:46.916 INFO:teuthology.orchestra.run.smithi179.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 20 11:10 /home/ubuntu/cephtest 2024-01-20T11:10:46.919 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-20T11:10:46.929 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-20T11:10:46.988 INFO:teuthology.nuke:Checking targets against current locks 2024-01-20T11:10:47.012 DEBUG:teuthology.nuke:shortname: smithi162 2024-01-20T11:10:47.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T11:10:47.033 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 10:46:45.791961', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdz4tlrW+p4p97mpnf38K/F5wSYtN2jYm1y4zfk8Zk5UvSBLOQEzAbLvHZ7b7C7gg4Vs+5DUgwZCWhH9bZej3Y='} 2024-01-20T11:10:47.037 DEBUG:teuthology.nuke:shortname: smithi179 2024-01-20T11:10:47.037 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T11:10:47.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522617', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 10:46:45.793935', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6aFtOJmsPEB7Lb/+0fkmqRqZmCHGK/g14gkygGM/HGu/bTjRcQVtOjX92KKZi8wChCpNaKMGsmF1KuCKQifIA='} 2024-01-20T11:10:47.088 INFO:teuthology.orchestra.console.smithi162:Power off 2024-01-20T11:10:47.088 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T11:10:47.113 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-01-20T11:10:47.113 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T11:10:47.128 INFO:teuthology.orchestra.console.smithi179:Power off 2024-01-20T11:10:47.128 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T11:10:47.139 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-01-20T11:10:47.151 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-01-20T11:10:47.151 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T11:10:47.172 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-01-20T11:10:51.140 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T11:10:51.174 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T11:10:51.250 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-01-20T11:10:51.284 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-01-20T11:10:55.252 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T11:10:55.285 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T11:10:55.364 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-01-20T11:10:55.396 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-01-20T11:10:55.496 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-01-20T11:10:59.366 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T11:10:59.480 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-01-20T11:10:59.581 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-01-20T11:10:59.686 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 client.1-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/strays} duration: 878.3107209205627 failure_reason: 'Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=72643f03030a4c31850dfed73a3e124c status: fail success: false 2024-01-20T11:10:59.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T11:10:59.787 INFO:teuthology.run:FAIL